All Questions
Tagged with pr.probability st.statistics
317 questions with no upvoted or accepted answers
1
vote
0
answers
334
views
Strong data-processing inequality ? Upper bound on a certain modified total-variation metric
Let $\mathcal X=(\mathcal X,d)$ be a Polish space equipped with the Borel sigma-algebra. Let $p\ge 1$ and $P_1,P_2$ be probability distributions on $\mathcal X$ such that $\max_{k=1,2}\int d(x,x_0)^...
- 6,853
1
vote
0
answers
60
views
A determinantal mixture of probability densities
I came up with this operation after playing with determinantal point processes:
Given two probability densities $f,g$ defined on some measurable space with reference measure $\mu$, set
$$
f\star g(x)...
- 2,135
1
vote
0
answers
73
views
Reduce the asymptotic variance for a class of Metropolis-Hasting estimates
I'm running the Metropolis-Hastings algorithm with state space $E$, target distribution $\mu=p\lambda$ and proposal kernel $Q$ to estimate $\mu(hf)$ for a fixed function $f:E\to[0,\infty)^3$ and a ...
- 167
1
vote
0
answers
56
views
Minimizing the rate of geometric ergodicity of a Metropolis-Hastings kernel depending on a parameter
Let $\tilde\kappa$ denote the transition kernel of the Markov chain generated by the Metropolis-Hastings algorithm with proposal kernel $\tilde Q$ and target distribution $\tilde\mu$.
I want to ...
- 167
1
vote
0
answers
130
views
Probabilistic lower bound on largest singular value of matrices
I have a distribution $\mathcal{D}$ that spits out vectors in $\{-1, 1\}^N$. Suppose I have a sample of $H$ of these vectors which I arrange into a matrix $M$ of the form $H \times N$.
Consider the ...
- 1,129
1
vote
0
answers
81
views
Empirical estimation of $\inf_{\gamma \in \Pi(\mu,\nu)}\gamma(\Omega)$, given i.i.d samples from $\mu$ and $\nu$
Let $\mathcal X$ be a Polish space and $\Omega \subseteq \mathcal X^2$ be open. Let $\mu$ and $\nu$ be probability measures, and consider the quantity $c_\Omega(\mu,\nu)$ defined by
$$
c_\Omega(\mu,\...
- 6,853
1
vote
0
answers
69
views
Concentration or distribution of the scaled $l_p$ norm of a correlation matrix
Background:
Among Hermitan random matrices, correlation matrix has a lot of applications in statistics. People have studied the "empirical spectral distribution (ESD)" of a correlation matrix, the ...
- 984
1
vote
0
answers
448
views
Gaussian Integrals over Spheres
I'm after a reference for an integral. In particular, I am looking a way to approximate or calculate the following:
$$ \int \limits_{\| \theta \|_2 = 1} e^{(-(\theta - \mu)^T \Sigma (\theta - \mu))} ...
- 11
1
vote
0
answers
123
views
Sanov-type finite-sample bound on $KL(P\|\hat{P}_n)$
Let $P$ be a distribution on an alphabet of size $k$ and let $\hat{P}_n$ be an empirical version of $P$ via $n$ i.i.d samples $a_1,\ldots,a_n \sim P$, i.e $\hat{P}_n := (1/n)\sum_{i=1}^n\delta_{a_i}$.
...
- 6,853
1
vote
0
answers
56
views
About a class of expectations
Consider being given a $n-$dimensional random vector with a distribution ${\cal D}$, vectors $a \in \mathbb{R}^k$, $\{ b_i \in \mathbb{R}^n \}_{i=1}^k$ and non-linear Lipschitz functions, $f_1,f_2 : \...
- 2,246
1
vote
0
answers
151
views
Clarification about the ϵ -net argument
I have been reading the paper Do GANs learn the distribution? Some theory and empirics.
In Corollary D.1, they reference the paper Generalization and Equilibrium in Generative Adversarial Nets which ...
- 19
1
vote
0
answers
84
views
Central limit theorem is expected, but variance is apparently sublinear? So?
In Perplexing Problems in Probability, the following statement about first passage percolation (FPP) on $\mathbb{Z}^{d}$ is made. See e.g. this paper of Benjamini, Kalai and Schramm, where they quote ...
- 640
1
vote
0
answers
129
views
Inverse Wishart
Assume that $X\sim \operatorname{IW}_p(n,\Sigma)$ has an inverse Wishart distribution, which probability density function is
$$f(X\mid n,\Sigma)=C(n,\Sigma)|X|^{-\frac{n+p+1}{2}} \exp\Big(-\frac{1}{2}...
- 119
1
vote
0
answers
34
views
Probability of increase in $\frac{\lambda}{n}$ of correlation matrix (principal score) after random sample the original matrix
Suppose $X$ is the original matrix of $n$ columns, and $P$ is the $n \times n$ correlation matrix of $X$. $P$ is symmetric positive semi-definite.
Denote the largest eigenvalue of $P$ is $\lambda$, ...
- 272
1
vote
0
answers
61
views
For 1-NN (Next Neighbor), what is the expectation of the largest probability of being the nearest neighbor?
Suppose we sample $n$ points $X_1,X_2,...,X_n$ independently from a distribution $P_X$ on $[0,1]^d$. For a new point $X$ independently from $P_X$, we find its nearest neighbor in $X_1,X_2,...,X_n$. ...
- 11
1
vote
0
answers
66
views
Matrix variate t-distribution and product of Beta distributions
This is a reference request for the following result. Let $X$ be a random matrix following the matrix variate $t$-distribution $T_{p,m}(\nu, M, U, V)$ (as defined in Wikipedia). Then
$$
\frac{\det(U)}{...
- 2,560
1
vote
0
answers
55
views
Central Limit Like theorem for the distribution of F-statistics on all possible partitions?
I'd be happy for simply a reference or even search terms as I feel like this has to be known*.
Suppose we have a known probability distribution $X$ and a fixed integer $n$. I am interested in the ...
- 51
1
vote
0
answers
376
views
Anti-concentration bounds for folded normal and inverse of gaussian variables
Are there any easy to use bounds on sums of the following kind :
$$
\sum_{i = 1}^{i = N} |a_i| \geq P \\
a_i \sim \mathcal{N}(0, 1) \\
$$
and also for sums of the form :
$$
\sum_{i = 1}^{i = M} \...
- 111
1
vote
0
answers
282
views
Strict monotonicity of conditional variances
Let $K \geq 2$ be a positive integer and $C$ be any $K \times K$ non-singular matrix (if necessary, can assume that all $K$ rows of $C$ are needed to span the coordinate row vector $e_1'$). For ...
- 765
1
vote
0
answers
201
views
Rank of cross-covariance matrix
Let $\boldsymbol{X}=(X_1,\dots,X_p)^T$ and $\boldsymbol{Y}=(Y_1,\dots,Y_q)^T$ be two random vectors. Denote $r_x=\text{rank}(\text{Cov}(\boldsymbol{X})),r_y=\text{rank}(\text{Cov}(\boldsymbol{Y})), r_{...
- 193
1
vote
0
answers
809
views
Generalized Chi squared distribution
What is the distribution of $Y Y^\top$ if $Y \sim N(\mu,\Sigma)$ is a generic multivariate gaussian vector?
- 719
1
vote
0
answers
80
views
Estimation with an unbalanced loss function
I'm interested in estimating the mean $\mu$ of a distribution given i.i.d samples. The empirical mean is a totally acceptable estimator (and can even be shown to be asymptotically/close to optimal ...
- 591
1
vote
0
answers
88
views
Why is the classical secretary problem about ranks?
This relates here: https://math.stackexchange.com/questions/1820997/why-is-the-classical-secretary-problem-about-ranks
You want to stop optimal in a sequence of items presented sequentially, that is ...
- 25
1
vote
0
answers
64
views
Posterior consistency of non linear model
This is possibly a reference request. Let $G$ : $\mathbb{R}^p \to \mathbb{R}^q$ be a continuous injective/bijective function. Let $\mu$(we may also assume this to be a non degenerate Gaussian) be ...
- 157
1
vote
0
answers
87
views
Convergence of an rcll process along a random subsequence
I have a process $X_s$, for $s \ge 0$, taking values in a Polish space $T$ with an rcll version where I have shown, for every nonrandom increasing sequence $s_n$, that $X_{s_n} \to c$ in probability, ...
- 321
1
vote
0
answers
69
views
Norm-averaging reference request
(Apology in advance for the broadness of this question) I recently came across a relatively simple application where I needed to "balance" the "spreaded-out-ness" of a function with the "peaked-ness" ...
- 123
1
vote
0
answers
64
views
Simulate a graph from a certain distribution
I am wondering if anyone can indicate whether the following is a solved problem. I don't care about time of the algorithm currently.
Consider a general probability distribution F on simple graphs ...
- 11
1
vote
0
answers
438
views
Chain rule for maximal correlation
Let a pair of random variables $(X,Y)$ be defined over finite alphabet $\mathcal{X}\times \mathcal{Y}$ with joint distribution $P_{XY}$. The maximal correlation $\rho(X;Y)$ between $X$ and $Y$ is ...
- 1,109
1
vote
0
answers
533
views
Finding an error estimation for the De Moivre–Laplace theorem with Stirling's formula
Context for my question: For one part of my thesis I try to find an upper bound for the error in the normal approximation of the binomial distribution following the standard proof of the De Moivre–...
- 497
1
vote
0
answers
42
views
Adding weights to the Brier score
Fix $n > 0$, and consider the space $\cal P$ of probability functions defined over the Boolean closure of a fixed $\cal S = \{ s_1, \ldots, s_n \}$. The Brier score of $P \in \cal P$ at $s_i \in \...
- 111
1
vote
0
answers
44
views
Validating a probability density distribution forecast model for a Markov process
Let's say we have a Markov process $X_t$, and we come up with a forecast model that takes some information from outside world and says: "value $X_{t+1}$ has probability density distribution $P_t(x)$". ...
- 93
1
vote
0
answers
85
views
Maximum likelihood estimation with several distributions
My question concerns using Maximum likelihood to estimate unknown parameters used by several (poisson) distributions.
The parameters are the pairs $(a_1,b_1),\dots,(a_N,b_N)$, and for each pair $(i,j),...
- 11
1
vote
0
answers
101
views
How to fit a stochastic matrix to given data.?
Given a data sequence of noisy observations of a 3-state Markov chain $X$ -- $y_1$,$y_2$,...$y_n$, with two transition matrices $A_1$ and $A_2$ corresponding to different regions (**) in the (unit) ...
1
vote
0
answers
104
views
Lower bound on difference between polynomials at moderate distance
Fix $r > 0$ and $k, n \in \mathbb{N}$. Also consider a function $f: \mathbb{R}^{d} \rightarrow \mathbb{R}$. Let $x_{1},\ldots, x_{n+1}$ be points chosen uniformly from $[-r,r]^{d}$. For $1 \leq i \...
1
vote
0
answers
701
views
limit distribution of multinomial distribution with increasing categories
If $\bf{X} \sim \text{multi}(n,p)$ with $k$ categories, we know
$$ \sqrt{n}\left( \frac{\bf{X}}{n} - \bf{p} \right) \rightarrow^D N(0,\Sigma),$$
where $\bf{X}=(X_1,\ldots,X_k)^T$ and $p=(p_1,\ldots,...
1
vote
0
answers
70
views
Bounds on product of CDF or Beta function
I have functions of the form
\begin{align}
I_i = \int_0^\infty F_0(x)^aF_1(x)^b(1-F_0(x))^c(1-F_1(x))^ddF_i(x),~~~~i = 0,1.
\end{align}
$F_0(x)$ and $F_1(x)$ are CDFs corresponding to the random ...
- 11
1
vote
0
answers
260
views
Distribution of the Gram Matrices
Let $\mathbf{X}$ be an $m\times m$ random matrix full rank matrix, having the density function $f_{\mathbf{X}}(X)$. Also, let $\mathbf{W}$ be a deterministic $k\times m$ matrix of rank $k$ and $k<m$...
- 141
1
vote
0
answers
251
views
Inflated independent samples for Monte Carlo estimation
In my particular problem, running an MCMC is too expensive, so I'm looking for a simple MC estimator, which would partially inherit the correlated samples of MCMC, yet would not require computing ...
- 101
1
vote
0
answers
104
views
Efficient evaluation of multidimensional kernel density estimate
Edit I have copied this discussion to the stats community site here, since I feel it is more relevant. Please feel free to close this in due course.
I've seen a reasonable amount of literature about ...
- 161
1
vote
0
answers
69
views
Whether r.v. with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)]$ is overdispersion?
When discrete r.v. $X$ is not Poisson distributed and ${\rm{Var}}X,EX < \infty $, I want to know whether r.v. $X$ with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)],({q_i} \in {\rm{...
- 113
1
vote
0
answers
101
views
What is the range of a positive random variable after whitening?
Let ${\bf x}\in\mathbb R^N$ be a positive multivariate random variable, i.e.
$$x_i\in [0,\infty).$$
What is the range after whitening, i.e. the range of ${\bf y} = \sqrt{C}^{-1}{\bf x}$ with the ...
- 51
1
vote
0
answers
132
views
Eigen value distribution of autocorrelated Wishart matrix
Suppose the matrix W is constructed as $W=XX^T$ where $X_i(t) = \phi_i X_i(t-1) + a_i(t)$, and $a_i(t)$ ~ $N(0,1)$. I am interested in knowing the eigen value distribution of W. My google search on ...
- 11
1
vote
0
answers
227
views
Uniform Law Of Iterated Logarithm for VC classes
Kenneth Alexander proved a uniform Law Of Iterated logarithm for Vapnik-Chervonenkis classes in the article Probability Inequalities for Empirical Processes and a Law of the Iterated Logarithm (Ann. ...
- 31
1
vote
0
answers
98
views
Small ball probabilities for functions of correlated normals
Let $f : \mathbb{R}^k \rightarrow \mathbb{R}$ and let $X$ be distributed k-dimensional normal with mean $0$ (with "arbitrary" covariance matrix). I am looking for references with bounds of the form: ...
- 111
1
vote
0
answers
100
views
Distribute Monte Carlo samples among dimensions
Simplified problem: Given a $d$-times nested convolution of an input function $g(x):\mathbb{R}\mapsto \mathbb{R}$ with the same band-limited smooth function $f(x):\mathbb{R}\mapsto \mathbb{R}$. I am ...
- 101
1
vote
0
answers
463
views
How far away is the maximum of $n$ i.i.d. chi-squared random variables from the rest of the sequence as $n$ gets large?
Suppose that I have a sequence of $n$ i.i.d. chi-squared random variables with $k$ degrees of freedom $X_1, X_2, \ldots, X_n$, and denote $X_{\max}=\max(X_1, X_2, \ldots, X_n)$. Let $k$ be increasing ...
- 907
1
vote
0
answers
186
views
Shrinkage (or Stein's phenomenon) in low dimensions, discrete contexts
I am trying to understand shrinkage, or the Stein phenomenon. As someone without a statistics background, the focus in most introductory presentations on normal distributions and squared error loss ...
- 203
1
vote
0
answers
61
views
Distribution for probability of an incorrect inference based on a comparison of only two samples?
I'm trying to demonstrate the problems of how taking a sample and assuming it reflects the population accurately can be problematic.
Imagine say an urn with some large number of balls, black and ...
- 11
1
vote
0
answers
442
views
Joint distribution from multiple marginals
Consider an experiment consisting of a repeated trial with two random Bernoulli (=binary) variables, A and B. Each trial consists of multiple outcomes for both A and B. Each trial has the same number ...
- 113
1
vote
0
answers
245
views
Random walk conditioned on sum and last step
Can anyone help with the following (slightly weird) random walk question? I have a random walk starting at $X_0 = 1 = S_0$ where the steps $X_i$ are independent uniform random variates in $[-1,1]$. ...
- 747