**1**

vote

**0**answers

91 views

### Is there an efficient algorithm for sampling from the negative hypergeometric distribution? [closed]

I'm writing a small statistics library currently. One of the algorithms I'm implementing has two variants: one that samples the hypergeometric distribution and one that samples the negative ...

**3**

votes

**1**answer

216 views

### Proof for power-law tail of Poisson-Dirichlet distribution (Pitman-Yor process & Zipf's law)

I'm trying to understand the motivation of using Pitman-Yor (PY) processes in language modeling, in particular Teh's hierarchical LM based on PY processes. A motivation frequently stated in research ...

**3**

votes

**2**answers

264 views

### Is a function of complete statistics again complete?

suppose $T$ is a complete stats for a parameter $\theta$.
Is any function $f(T)$ again complete?
It sounds weird but the definition seems to confirm that $f(T)$ is indeed complete..

**1**

vote

**0**answers

40 views

### Bounds on product of CDF or Beta function

I have functions of the form
\begin{align}
I_i = \int_0^\infty F_0(x)^aF_1(x)^b(1-F_0(x))^c(1-F_1(x))^ddF_i(x),~~~~i = 0,1.
\end{align}
$F_0(x)$ and $F_1(x)$ are CDFs corresponding to the random ...

**2**

votes

**0**answers

104 views

### Mean and variance of a general multivariate skew normal distribution

I have a problem about a general multivariate skew normal distribution. There is a $p\times 1$ vector, $\mathbf{y}=(\mathbf{y}_1',\mathbf{y}_2',\ldots,\mathbf{y}_n')',p>n$, which has the density as
...

**6**

votes

**1**answer

180 views

### Closure of random rotations

Are matrix Fisher random variables closed under multiplication?
For those unfamiliar with the jargon, let me unpack the terms above and repose my question.
This is a question about probability ...

**5**

votes

**3**answers

361 views

### A. Markov's papers?

A. Markov published several papers on his chains, starting in 1906, so it is written, in the journal:
(1) Извѣстія Физико-математического общества при Казанском университете
I am surprised by the ...

**2**

votes

**1**answer

115 views

### Linear least squares with unordered response variable

In the classical linear regression model one considers the equation
$$ y = X \beta + \epsilon.$$
I was wondering whether there are also results when the ordering of the response variable $y$ is not ...

**1**

vote

**1**answer

69 views

### How to extend Dirichlet distribution to Dirichlet process

For a Dirichlet process, there are two parameter $\alpha$ and $H$, and the Dirichlet process $X$ is defined as
$$(X(B_1),\cdots,X(B_n))\sim Dir(\alpha H(B_1),\cdots,\alpha H(B_n))$$
...

**2**

votes

**1**answer

65 views

### Unbiased sample from a product

Let $X = (x_1,\ldots,x_n)$ be an i.i.d sample from distribution $F%$ and let $y = \prod_{i=1}^n x_i$
Can we derive a randomized, unbiased. estimator $\hat{y}$ of $y$ that on average considers only a ...

**5**

votes

**2**answers

308 views

### Random Vornoi Diagrams (particular measures)

This is my second question about Random Voronoi diagrams, in my first question was given some excellent advice but i was not clear in explaining what i was looking for.
I'm interested to know ...

**8**

votes

**2**answers

731 views

### Random Voronoi Diagrams

I'm interested in what research has already been done with regards to the statistics of random voronoi diagrams. I have had a look on google scholar and results are a little inconclusive. I'm ...

**1**

vote

**1**answer

104 views

### Distance between two distribution of image

I am looking for a common distance method to compare two distribution (ex: histogram of image). Please suggest to me some common method to do it. I found some method ex: Bhattacharyya distance , K-L ...

**2**

votes

**2**answers

253 views

### Distribution of a random walk on a directed line

Is there a closed formula for the distribution of $x_t$ in the following random process, describing a random walk on a directed line?
$x_0 = n$
$x_t$ is a uniformly random integer between 1 and ...

**1**

vote

**1**answer

65 views

### Multivariate Rayleigh [closed]

What is the closed form formula (pdf) for a multivariate Rayleigh distribution. Is it -
$x^T \Sigma^{-1} x \times \exp(\frac{-x^T \Sigma^{-1} x}{2})$
How do you prove it is from the exponential ...

**6**

votes

**0**answers

128 views

### Convergence of Maximum Likelihood Estimator

I apologize for the basic question. If $\{p_\theta(x): \theta\in K\subseteq\mathbb{R}\}$ is a smooth family of distributions, then the MLE $\hat{\theta}_n,$ under suitable regularity conditions ...

**3**

votes

**1**answer

145 views

### Two matrix Fisher distributions on SO(3)?

After the uniform distribution (normalized Haar measure), the matrix Fisher distribution seems to be the most popular probability distribution on the Lie group SO(3). The density is proportional to ...

**2**

votes

**1**answer

369 views

### Markov chain Monte Carlo: why is non-reversible MC MC not as popular?

I am new to methods for simulating Markov chains in order to sample from the target, unknown distribution. After a couple days of reading, I found out that even though people have realized that ...

**5**

votes

**1**answer

498 views

### How to check if a symmetric random variables is the difference of two iid symmetric random variables

I have the continuous symmetric random variable $X$ in $\mathbb{R}$. If I know its distribution function $F(x)$ what are the conditions on $F(x)$ so that $X=Y_1 - Y_2$ where $Y_i$ are also iid ...

**2**

votes

**2**answers

259 views

### Gaussian expectation of an exponentiated outer product

Given a normal random column vector $\mathbf{x} \sim N(\mu, \Sigma)$, I need the expectation,
$$ E\left[ \exp(\mathbf{xx}^\top)\right]$$
where $\exp(\cdot)$ is element-wise exponential function (not ...

**1**

vote

**1**answer

54 views

### How are two tailed p values (especially) and one tailed p values useful given the following? [closed]

So I'm a self-learner which is always dangerous because I don't have anything to test if I am understanding things correctly, so I wanted to ask what is wrong/right with my assumptions.
When reading ...

**1**

vote

**0**answers

46 views

### Can anything be said of the correlation of X and Y / X? [closed]

I apologize in advance if I overstep my (relatively minimal) statistical knowledge.
I am looking at two random variables X and Y, and am unhappy with the correlation between the two. On a whim, I ...

**5**

votes

**1**answer

423 views

### Is there a mistake in Vapnik's “Basic Lemma”?

I have a concern about the "Basic Lemma" which Valdimir Vapnik states and proves in his 1998 book Statistical Learning Theory (ch. 14.3, pp. 574–76): It seems like a certain coefficient should have ...

**3**

votes

**1**answer

179 views

### An efficient method to find the MLE of the combination of two point processes

I have a point process defined in two parts as follows. Consider first the main process which we call $A$ which is homogeneous Poisson process with conditional intensity
$$\lambda(t) = \mu$$
For ...

**0**

votes

**0**answers

372 views

### Cholesky decomposition of a large covariance matrix

I have a tricky problem concerning a covariance matrix cholesky decomposition.
What I need is to obtain the cholesky decomposition of the estimated variance matrix of the set of samples stored in a ...

**0**

votes

**1**answer

84 views

### higher-level independence of three or more correlated RVs

I'm hoping for some help in nailing down a vague idea about independence. It starts with finding the expectation of a product of three RVs (or more, but I'll stick to three for now). These are not ...

**0**

votes

**1**answer

206 views

### two correlated processes

I apologize if this question is not placed in the right place. But I am having a hard time to figure it out. It would be greatly appreciated if some one could help me out.
Assume that there are two ...

**2**

votes

**1**answer

73 views

### What is the problem with this model parameter estimation algorithm?

In a statistical model with parameters $\theta$ and unobserved laten variables $Z$, the model likelihood is
$$L(\theta;X)=Pr(X|\theta)=\sum_ZPr(X,Z|\theta)$$
The standard way to estimate $\theta$ ...

**0**

votes

**1**answer

51 views

### finite mixture of order statistics

Let $F(u)$ be a n-degree polynomial continuous distribution function in $[0,1]$, with $F(0)=0$, $F(1)=1$, that is $F(u)=\sum_{i=1}^{i=n} a_i u^i$. My question is: is that kind of distributions ...

**1**

vote

**0**answers

590 views

### random walk with reflecting barriers [closed]

Consider a random walk on the line 1,...,d. You start at point 1. At each step you flip a coin: heads means go left, tails means go right. If you're at 1 and get a heads, just stay where you are (same ...

**1**

vote

**0**answers

110 views

### Distribution of the Gram Matrices

Let $\mathbf{X}$ be an $m\times m$ random matrix full rank matrix, having the density function $f_{\mathbf{X}}(X)$. Also, let $\mathbf{W}$ be a deterministic $k\times m$ matrix of rank $k$ and ...

**1**

vote

**1**answer

187 views

### Gibbs sampler with linear constraints

My problem concerns the estimation of truncated multivariate normal distributions under constraints.
Let $X_1$ and $X_2$ two random variables following normal distributions ...

**1**

vote

**0**answers

241 views

### Inflated independent samples for Monte Carlo estimation

In my particular problem, running an MCMC is too expensive, so I'm looking for a simple MC estimator, which would partially inherit the correlated samples of MCMC, yet would not require computing ...

**3**

votes

**1**answer

268 views

### Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$.
Is it true that:
If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...

**0**

votes

**1**answer

129 views

### Expected number of samples above certain value of a normally distributed variable with a given sample mean

Suppose $n$ values, $X_1,...,X_n,$ are generated by a random number generator with normal distribution $N(0,1).$ Suppose that the (sample) mean of $X_1,...,X_n$ is $\mu.$ What is known about the order ...

**0**

votes

**1**answer

526 views

### Compound Poisson process and central limit theorem [closed]

If I have a compound Poisson process
$$Y(t) = \sum_{i=1}{N(t)}D_{i}$$
where $ \{\,N(t) : t \geq 0\,\}$ is a Poisson process with rate $\lambda$, and $ \{\,D_i : i \geq 1\,\}$ are i.i.d random ...

**2**

votes

**1**answer

147 views

### Distribution of the Gram matrix

Let $\mathbf{X}$ be an $m\times k$ random matrix ($m>k$) of rank $k$, having the density function $f_\mathbf{X}(X)$. What is the distribution of $\mathbf{Y}=\mathbf{XX}^T$? Basically my question is ...

**1**

vote

**0**answers

30 views

### Minimal rectangular confidence regions

For a given multivariate pdf $f$ (mainly the gaussian one) I'm looking to compute a minimal rectangular confidence region for a given level $\alpha$. For example, I would like to solve problems of the ...

**2**

votes

**1**answer

239 views

### Probability distribution of uAv…

Consider the complex domain ℂ. If U and V are 2 unitary random matrices and A is a deterministic matrix.
What is the distribution of $u^HAv$ ( or $||u^HAv||^2$)
where : u is a column vector of U. v ...

**0**

votes

**2**answers

199 views

### Third order central moment of a positive linear combination of log-normal random variables

What is the sign (+tive/-tive) of the third order central moment of a positive linear combination of log-normal random variables?
It seems to be a common notion that the skewness of random variables ...

**2**

votes

**0**answers

41 views

### Where to read about this kind of “measure of irredundancy” of a set from a family of sets?

Studying a very practical problem from psychometrics, I encountered the following construction.
Let $(X,\mu)$ be a measure space; if preferred, you can presume $\mu$ is a probability measure. In any ...

**6**

votes

**3**answers

214 views

### Constructing a Bernoulli random variable for ratio of Bernoulli weights

$X$ and $Y$ are Bernoulli random variables with weights $0 < \alpha < 1$ and $0 < \beta < 1$. Is it possible to construct a sampler for the Bernoulli random variable with weight ...

**2**

votes

**2**answers

121 views

### Sampling from maximally skewed stable distribution

I am reading a paper which refers to a maximally skewed stable distribution $F(x;1,-1,\pi/2,0)$ . Is there an efficient way to sample from this distribution?
If $X$ has distribution ...

**2**

votes

**0**answers

171 views

### Hilbert Schmidt Operators and the Conditional Expectation Operator

Consider the function $\text{E}_W: L_2(\mathbb{R},P_X) \mapsto L_2(\mathbb{R},P_W)$ where $P_X$ and $P_W$ are two different probability measures. They are related in such a way that if $f_X$, $f_W$ ...

**5**

votes

**0**answers

204 views

### Inverse moment of the number of inversions of a permutation

Let $\pi$ be a permutation of $\{1,2,...,n\}$. A pair of elements ($\pi_i$,$\pi_j$) is called an inversion if $i$ $>$ $j$ and $\pi_i$ $<$ $\pi_j$. The total number of inversions in $\pi$ is ...

**3**

votes

**1**answer

137 views

### Estimating total variation distance from a given distribution

Given a known distribution supported on a finite set of $n$ elements with probabilities $p_1, \dots, p_n$ and an access to an unknown distribution $q$ is it known what is the number of samples from ...

**3**

votes

**0**answers

33 views

### Regression with correlation structure

I have a theoretical question about regression models.
Let's say I measured multiple responses from $n$ subjects and these responses are correlated with each other. For example, let's say I measured ...

**-1**

votes

**1**answer

100 views

### Express $cov(X^2,Z)$ in terms of means, variances, and covariance of $X$ and $Z$? [closed]

Suppose $X$ and $Z$ are random variables. Can the covariance of $X^2$ with $Z$ be expressed in terms of the means, population variances, and covariance of $X$ and $Z$ alone?
My attempts at solving ...

**2**

votes

**0**answers

47 views

### How to get the Expectation of the normalization of some log-normal-distributions?

Problem Definition:
Suppose that a random variable of multivariate Gaussian distribution $X \sim N(\Sigma,\mu)$, $\Sigma$ is the covariance matrix, and $\mu$ is the mean. For each $x_i$ from $X$, $x_i ...

**1**

vote

**1**answer

86 views

### Averaging function of sum of variables using central limit theorem

I'm trying to evaluate an integral of the following form
$$\int \prod_i \left[ dx_i \,P(x_i) \right] \; f \Big( \frac{1}{N} \! \sum_{i=1}^N x_i \Big)$$
and I know that the distribution of $x$ is ...