0
votes
0answers
13 views

Dirichlet distribution: Normalization of alpha values [migrated]

I'm a programmer and currently trying to apply the Latent Dirichlet Allocation algorithm by Blei et al. on a text mining problem. I am using a library called gensim for this, which takes, among ...
3
votes
0answers
189 views

Strong Law of Large Numbers for arrays of random variables

Suppose $X_1$, $X_2$ are two independent real-valued random variables. Let $F$ be a continuous (unbounded) function from $\mathbb{R^2}$ to $\mathbb{R}$. Assume that the necessary measurability and ...
-4
votes
0answers
43 views

Statistics, probability [closed]

A statistician-gone-mad has concocted the following multi-part experiment. For the first part of the experiment, a fair, seven sided die is rolled and the upper-most facing number is noted. If the ...
1
vote
0answers
42 views

Is there an efficient algorithm for sampling from the negative hypergeometric distribution? [closed]

I'm writing a small statistics library currently. One of the algorithms I'm implementing has two variants: one that samples the hypergeometric distribution and one that samples the negative ...
2
votes
1answer
59 views

Proof for power-law tail of Poisson-Dirichlet distribution (Pitman-Yor process & Zipf's law)

I'm trying to understand the motivation of using Pitman-Yor (PY) processes in language modeling, in particular Teh's hierarchical LM based on PY processes. A motivation frequently stated in research ...
1
vote
0answers
28 views

Bounds on Product of CDF or Beta function

I have functions of the form \begin{align} I_i = \int_0^\infty F_0(x)^aF_1(x)^b(1-F_0(x))^c(1-F_1(x))^ddF_i(x)~~~~i = 0,1 \end{align} $F_0(x)$ and $F_1(x)$ are CDFs corresponding to the random ...
6
votes
1answer
136 views

Closure of random rotations

Are matrix Fisher random variables closed under multiplication? For those unfamiliar with the jargon, let me unpack the terms above and repose my question. This is a question about probability ...
1
vote
1answer
50 views

How to extend Dirichlet distribution to Dirichlet process

For a Dirichlet process, there are two parameter $\alpha$ and $H$, and the Dirichlet process $X$ is defined as $$(X(B_1),\cdots,X(B_n))\sim Dir(\alpha H(B_1),\cdots,\alpha H(B_n))$$ ...
0
votes
0answers
31 views

Distribution of Wishart Sample Eigenvalues for Multiple Roots

I am interested in finding an asymptotic approximation to the latent roots $l_1>\dots>l_p$ of a white noise Wishart matrix $nS\sim W_p(n,I)$ as $n\rightarrow\infty$ (where $p$ is fixed). In ...
2
votes
1answer
55 views

Unbiased sample from a product

Let $X = (x_1,\ldots,x_n)$ be an i.i.d sample from distribution $F%$ and let $y = \prod_{i=1}^n x_i$ Can we derive a randomized, unbiased. estimator $\hat{y}$ of $y$ that on average considers only a ...
5
votes
2answers
280 views

Random Vornoi Diagrams (particular measures)

This is my second question about Random Voronoi diagrams, in my first question was given some excellent advice but i was not clear in explaining what i was looking for. I'm interested to know ...
8
votes
2answers
609 views

Random Voronoi Diagrams

I'm interested in what research has already been done with regards to the statistics of random voronoi diagrams. I have had a look on google scholar and results are a little inconclusive. I'm ...
2
votes
1answer
60 views

Distance between two distribution of image

I am looking for a common distance method to compare two distribution (ex: histogram of image). Please suggest to me some common method to do it. I found some method ex: Bhattacharyya distance , K-L ...
2
votes
2answers
235 views

Distribution of a random walk on a directed line

Is there a closed formula for the distribution of $x_t$ in the following random process, describing a random walk on a directed line? $x_0 = n$ $x_t$ is a uniformly random integer between 1 and ...
3
votes
1answer
112 views

Two matrix Fisher distributions on SO(3)?

After the uniform distribution (normalized Haar measure), the matrix Fisher distribution seems to be the most popular probability distribution on the Lie group SO(3). The density is proportional to ...
0
votes
0answers
59 views

Maximizing the “uniformity” of a probability measure, with constraints, via path length minimization

Background I want to find a probability measure for a continuous random variable, subject to moment constraints, that is maximally "uniform", as defined below: Definition: Maximally Uniform ...
5
votes
1answer
160 views

How to check if a symmetric random variables is the difference of two iid symmetric random variables

I have the continuous symmetric random variable $X$ in $\mathbb{R}$. If I know its distribution function $F(x)$ what are the conditions on $F(x)$ so that $X=Y_1 - Y_2$ where $Y_i$ are also iid ...
2
votes
2answers
220 views

Gaussian expectation of an exponentiated outer product

Given a normal random column vector $\mathbf{x} \sim N(\mu, \Sigma)$, I need the expectation, $$ E\left[ \exp(\mathbf{xx}^\top)\right]$$ where $\exp(\cdot)$ is element-wise exponential function (not ...
5
votes
1answer
391 views

Is there a mistake in Vapnik's “Basic Lemma”?

I have a concern about the "Basic Lemma" which Valdimir Vapnik states and proves in his 1998 book Statistical Learning Theory (ch. 14.3, pp. 574–76): It seems like a certain coefficient should have ...
3
votes
1answer
163 views

An efficient method to find the MLE of the combination of two point processes

I have a point process defined in two parts as follows. Consider first the main process which we call $A$ which is homogeneous Poisson process with conditional intensity $$\lambda(t) = \mu$$ For ...
0
votes
1answer
69 views

higher-level independence of three or more correlated RVs

I'm hoping for some help in nailing down a vague idea about independence. It starts with finding the expectation of a product of three RVs (or more, but I'll stick to three for now). These are not ...
0
votes
1answer
203 views

two correlated processes

I apologize if this question is not placed in the right place. But I am having a hard time to figure it out. It would be greatly appreciated if some one could help me out. Assume that there are two ...
1
vote
0answers
111 views

random walk with reflecting barriers [closed]

Consider a random walk on the line 1,...,d. You start at point 1. At each step you flip a coin: heads means go left, tails means go right. If you're at 1 and get a heads, just stay where you are (same ...
1
vote
0answers
58 views

Distribution of the Gram Matrices

Let $\mathbf{X}$ be an $m\times m$ random matrix full rank matrix, having the density function $f_{\mathbf{X}}(X)$. Also, let $\mathbf{W}$ be a deterministic $k\times m$ matrix of rank $k$ and ...
1
vote
1answer
106 views

Gibbs sampler with linear constraints

My problem concerns the estimation of truncated multivariate normal distributions under constraints. Let $X_1$ and $X_2$ two random variables following normal distributions ...
1
vote
0answers
227 views

Inflated independent samples for Monte Carlo estimation

In my particular problem, running an MCMC is too expensive, so I'm looking for a simple MC estimator, which would partially inherit the correlated samples of MCMC, yet would not require computing ...
2
votes
1answer
164 views

Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$. Is it true that: If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...
0
votes
1answer
99 views

Expected number of samples above certain value of a normally distributed variable with a given sample mean

Suppose $n$ values, $X_1,...,X_n,$ are generated by a random number generator with normal distribution $N(0,1).$ Suppose that the (sample) mean of $X_1,...,X_n$ is $\mu.$ What is known about the order ...
2
votes
1answer
96 views

Distribution of the Gram matrix

Let $\mathbf{X}$ be an $m\times k$ random matrix ($m>k$) of rank $k$, having the density function $f_\mathbf{X}(X)$. What is the distribution of $\mathbf{Y}=\mathbf{XX}^T$? Basically my question is ...
2
votes
1answer
209 views

Probability distribution of uAv…

Consider the complex domain ℂ. If U and V are 2 unitary random matrices and A is a deterministic matrix. What is the distribution of $u^HAv$ ( or $||u^HAv||^2$) where : u is a column vector of U. v ...
5
votes
3answers
181 views

Constructing a Bernoulli random variable for ratio of Bernoulli weights

$X$ and $Y$ are Bernoulli random variables with weights $0 < \alpha < 1$ and $0 < \beta < 1$. Is it possible to construct a sampler for the Bernoulli random variable with weight ...
2
votes
2answers
89 views

Sampling from maximally skewed stable distribution

I am reading a paper which refers to a maximally skewed stable distribution $F(x;1,-1,\pi/2,0)$ . Is there an efficient way to sample from this distribution? If $X$ has distribution ...
1
vote
0answers
129 views

Doubts about Bayes' Theorem [closed]

I meet one problem on the probability and statistic theory. "Assume given a measure space $(X,S)$ with three probability measure $\mu_1,\mu_2,\lambda$ on the space. And there exsit functions ...
5
votes
0answers
137 views

Inverse moment of the number of inversions of a permutation

Let $\pi$ be a permutation of $\{1,2,...,n\}$. A pair of elements ($\pi_i$,$\pi_j$) is called an inversion if $i$ $>$ $j$ and $\pi_i$ $<$ $\pi_j$. The total number of inversions in $\pi$ is ...
3
votes
1answer
106 views

Estimating total variation distance from a given distribution

Given a known distribution supported on a finite set of $n$ elements with probabilities $p_1, \dots, p_n$ and an access to an unknown distribution $q$ is it known what is the number of samples from ...
0
votes
0answers
50 views

Linear Bounds on estimation error

Consider a markov chain on discrete state space $\mathbb{S} = \left\{1,2,..,S \right\}$, with transition probability matrix defined as $A = [a_{ij}]_{S \times S}$ where $a_{ij} = ...
5
votes
1answer
265 views

Central limit theorem for independent random variables, with a Gumbel limit

Consider independent random variables $Y_i$, $i>0$, such that $\mathbb{E}(Y_i)\approx \frac{1}{i}$ and $\text{Var}(Y_i)\approx \frac{1}{i^2}$, where $\approx$ means asymptotically equivalent up to ...
1
vote
0answers
41 views

Efficient evaluation of multidimensional kernel density estimate

Edit I have copied this discussion to the stats community site here, since I feel it is more relevant. Please feel free to close this in due course. I've seen a reasonable amount of literature about ...
2
votes
2answers
123 views

Bounds for the fat tail after trimming the mean?

I am interested in the quantity $$f(X,t) = \int_t^\infty\negthinspace x\ p(x)\ dx,$$ where $p$ is a probability distribution for a positive variable $X$. 1) Does this quantity $f(X,t)$ have a name? ...
1
vote
0answers
53 views

Whether r.v. with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)]$ is overdispersion?

When discrete r.v. $X$ is not Poisson distributed and ${\rm{Var}}X,EX < \infty $, I want to know whether r.v. $X$ with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)],({q_i} \in ...
4
votes
0answers
139 views

Optimization problem involving Multivariate Normal

I use $\phi(t)$ to describe the standard normal distribution density and $\Phi(t)$ as the normal distribution CDF and would like to prove that for all $n\geq3$, the function: ...
-1
votes
1answer
55 views

Finiteness of “novel variance” from a kernel on a compact space [closed]

Let $c(i,i')$ be a kernel function on a reasonable index space $I$. Choose a dense sequence of points $\{i_1, i_2, \cdots \} \subseteq I$, and define the one-point kernel functions $k_n := c(\cdot, ...
1
vote
2answers
173 views

Empirical estimator for total variation distance between two product distributions

Let $X = (X_1, X_2, \ldots , X_n)$ be an $n$-dimensional random variable, where each $X_i$ is a random variable on finite discrete set $S$. In addition, $X_i$ are independent of each other (but not ...
5
votes
1answer
183 views

Measures which exhibit the “uncorrelated implies independent” property

Let $X$ be a topological linear space, and let $X^*$ be its dual space. Suppose that $X$ is complete and Hausdorff, and $X^*$ separates points. Let $Y$ be another such space, and let $f : X \to Y$ be ...
1
vote
1answer
116 views

forward algorithm Hidden Markov Model

I am studying the the forward-backward algorithm used in Hidden Markov Models. I understand that that you are trying to propagate through a sequence (and the available states) to find the most ...
0
votes
1answer
73 views

Estimating the variance of error in empirical approximation to a distribution

Let $X_1,X_2,\ldots,X_n$ be i.i.d. random variables in $\mathbb{R}$ with common cumulative distribution function (CDF) $F(x)$. The empirical approximation to $F(x)$ is defined as follows: ...
1
vote
1answer
74 views

What is known about the distribution of the errors in empirical approximation of a CDF?

Let $X_1,X_2,\ldots,X_n$ be i.i.d. random variables in $\mathbb{R}$ with common cumulative distribution function (CDF) $F(x)$. The empirical approximation to $F(x)$ is defined as follows: ...
13
votes
4answers
556 views

Are gaussians with different moments far in total variation distance?

If two Gaussians disagree on one moment, it seems like this should imply that they have a large variation distance--equivalently, if two Gaussians are close in variation distance it's hard for their ...
0
votes
2answers
93 views

Determine joint distribution from projections

Let $X=(X_1,\dots,X_d)$ be a random vector, and a.s. $X \in [0,1]^d$. Suppose that for every $a \in \mathbb{R}^d$, we know the probability distribution of the random variable $Y_a = <a,X>$. My ...
2
votes
0answers
106 views

MLRP of random variables and order statistics

Suppose we have $N$ independent random variables $X_1, \cdots, X_N$ drawn from $f_1 > \cdots > f_N$ where $f_i > f_j$ indicates that $f_i$ and $f_j$ satisfy the monotone likelihood ratio ...