All Questions
Tagged with pr.probability st.statistics
317 questions with no upvoted or accepted answers
4
votes
0
answers
980
views
Inverse Fourier Transform involving a Bessel Function, Exponential, and Power
I'm interested in this integral as a function of $r$ for various spectral densities $S(s)$:
$\frac{2 \pi}{r^{p/2}-1} \int_{0}^{\infty} S(s) J_{p/2-1}(2 \pi r s) s^{p/2} ds $, where $J_{p/2-1}$ is a ...
- 41
4
votes
0
answers
1k
views
Concentration of sum of independent random variables
Let $X_1, ..., X_n$ be i.i.d. sub-Gaussian random variables with mean $0$ and variance $1$. That is, we have $\Pr[|X_i| > t] \leq \exp(1-t^2/K^2)$ for all $t>0$ and a parameter $K$.
Then we can ...
- 1,324
4
votes
0
answers
153
views
A simplified MCMC / MH algorithm. Are there known convergence results?
Hi, I hope this isn't too basic. We were working on a simulation using a Monte Carlo Within Metropolis algorithm and noticed that the whole thing could be expressed in the form below and simplified ...
- 241
4
votes
0
answers
970
views
Expected operator norm of inverse Wishart matrix
Let $ W\sim W_p(n,I)$ be a white $p\times p$ Wishart matrix, and assume $n>p+1$, which ensures that $W$ is invertible almost surely. Let $\|W^{-1}\|_{\text{op}}$ be the operator norm (maximum ...
- 41
4
votes
0
answers
867
views
For what sub-$\sigma$-algebra are these two measures equivalent?
In two statistics papers (linked inline below) I have come across two definitions of certain probability measures. I conjecture that for particular choices of the construction that they are ...
- 2,791
4
votes
0
answers
497
views
A Local CLT with large variance
For n an even integer, $0 \leq i \leq$ ${n} \choose{j}$, $1 \leq j \leq n$ let $X_{i,j}$ be a
random variable taking values $\frac{n}{2}-j,0,j - \frac{n}{2}$ with equal probability. Let $S_{n}$ be ...
- 263
4
votes
1
answer
839
views
A balls into bins problem with combinatorial constraints
We are given $m$ balls and $n$ bins, with $m \ge n$. Each bin can contain at most $c$ balls (we assume that $c$ is an even integer). In a sequential fashion, at each time step, one ball is placed into ...
- 1,677
3
votes
0
answers
92
views
Tighter Freedman's inequality for a special martingale difference sequence
Let $X_{1}, \ldots, X_{T} \in \{0, 1\}$ be a sequence of Boolean random variables with
$$
\mathbb{E}[X_{t} | X_{1}, \dots, X_{t - 1}] = p_{t}.
$$
Consider the sequence $Y_{t} := X_{t} - p_{t}$ (which ...
- 41
3
votes
0
answers
131
views
Matrix-Gaussian distributions
The point of this question is to ask for references on matrix-variate Gaussian distributions. But I will explain what I mean by a matrix-variate Gaussian with an example (the notion I have in mind is ...
- 193
3
votes
0
answers
353
views
Moments of normalized multivariate Gaussians (and Wick's/Isserlis theorems)
Suppose $x = \begin{bmatrix}x_1 \\ x_2\end{bmatrix}$ is distributed according to the real two-dimensional Gaussian with mean-$0$ and covariance matrix $\Sigma$. I am interested in a closed form for ...
- 193
3
votes
0
answers
80
views
Seeking strong bounds on KL-divergence and martingales for a hypothesis-testing inequality
Let's say we have a finite set $\mathcal{O}$ of observations, and let $\mathcal{C}(\Delta\mathcal{O})$ denote the space of closed convex sets of probability distributions.
We have two hypotheses which ...
- 353
3
votes
0
answers
107
views
Supremum process of a Cauchy RV
I've asked the same question on stats.stackexchange a week ago to no avail, so here we go again:
Suppose $X_i$ are $\mathrm{Cauchy}(0,~\gamma)$ IID RV's. Does an expression exist for the CDF of the ...
- 41
3
votes
0
answers
93
views
Asymptotic approximation of Fisher information matrix for small Gaussian perturbation
Let
$$
X=Y/a+b+\epsilon Z,
$$
where $Y\sim\operatorname{Poisson}(\lambda)$ and $Z\sim\mathcal N(0,1)$ are independent. Also define $\theta=(\lambda,a,b,\epsilon)$. The Fisher information matrix
$$
...
3
votes
0
answers
92
views
What dynamical properties should we expect from systems satisfying statistical ones?
Some results on probability theory can be generalized to more abstract ones in ergodic theory, for example:
the strong law of large numbers can be seen as a particular case of Birkhoff's ergodic ...
3
votes
0
answers
93
views
Explaning why the spectrum of a setting simple structure random matrix is always spiked ($d-1$ eigenvalues close to zero, and $1$ away from zero)
For concreteness, let $m=500$, $d=600$, $N=1000$. Let $W$ be and $d \times m$ matrix with unit-norm rows and let $u$ be a uni-norm vector of length $m$. Given a binary vector $b$ of length $m$, length ...
- 6,853
3
votes
0
answers
98
views
Probability measure on $\mathbb{R}^n$ with given marginals and given correlation matrix
In all what follows, let $\mathcal{P}(\mathbb{R}^n)$ denote the set of probability measures on $(\mathbb{R}^n, \mathcal{B}(\mathbb{R}^n))$ and $\mathcal{C}_n$ the set of $n \times n$ correlation ...
- 279
3
votes
1
answer
379
views
Concentration inequality for norm of solution to nonlinear least-squares problem
Define the piecewise-linear function $\psi(t):=\max(t,0)$ for all $t \in \mathbb R$.
Let $d,n,k \to \infty$ at the same rate (i.e $n \asymp k \asymp d$).
Let $y_1,\ldots,y_n \in \{-1,1\}$ uniformly ...
- 6,853
3
votes
0
answers
229
views
Expectation of angle between two vectors in the image of a gaussian random matrix
Let $m$ and $n$ be large positive integers (going to infinity), and let $W$ be a random matrix of size $n \times m$ with iid entries from $N(0,1/m)$. Let $x,y \in \mathbb R^m$ be deterministic vectors,...
- 6,853
3
votes
0
answers
58
views
Projection onto column space perturbed by Gaussian noise
Suppose we have a matrix $X\in\mathbb{R}^{m\times n}$ (with $n \le m$) with iid standard Gaussian entries, and suppose we have noise matrix $W\in\mathbb{R}^{m\times n}$ with iid Gaussian entries, but ...
- 141
3
votes
0
answers
198
views
Minimizing an f-divergence and Jeffrey's Rule
My question is about f-divergences and Richard Jeffrey's (1965) rule for updating probabilities in the light of partial information.
The set-up:
Let $p: \mathcal{F} \rightarrow [0,1]$ be a ...
- 101
3
votes
1
answer
607
views
Show that $\sup_{\|g\|\leq \delta_n}\left| \frac{1}{\sqrt{n}}\sum_{i=1}^n g(Z_i)\right|\rightarrow_{\text{a.s.}}0.$ when $\delta_n\rightarrow 0$?
UPDATE: The result below can be understood as an almost sure stochastic equicontinuity condition. I don't know of any result establishing primitives of almost sure stochastic equicontinuity. If you ...
- 59
3
votes
0
answers
307
views
Upper-bound for eigenvalues of $E [UU^T]$, where $U$ is uniformly distributed on the unit $n$-sphere
Let $X$ be a $\sigma$-subGaussian random vector on $\mathbb R^n$ (for large $n \ge 3$), meaning that the random variable $X^Tv$ is $\sigma$-subGaussian for every unit vector $v \in \mathbb R^n$. ...
- 6,853
3
votes
0
answers
150
views
Central Limit Theorem for simultaneous sums
Take a sample $X_1 \ldots X_n$ of $n$ independent observations $X_j \in \mathbb{R}$ with zero mean and finite variances $\sigma_j^2$. For $i = 1, 2, \ldots$, define the sums $$S^n_i = \frac{\pm X_1 \...
user114668
3
votes
0
answers
95
views
Empirically random, quickly multiplicable matrices
I have encountered a need for fast computation of a transformation $Ax$ where $A\in \mathbb{C}^{K\times N},\ K\sim 10^7,\ N\sim 10^3$ is designed, and $x\in \mathbb{C}^N$ has iid $\mathcal{CN}(0,1)$ ...
3
votes
0
answers
178
views
Partitioning the coupons collected in the classical coupon collector's problem
Suppose that there is an urn containing $n$ different coupons, from which $m$ coupons are being collected, equally likely, with replacement.
Let $C(m)$ be the whole set of the $m$ collected coupons. ...
- 1,677
3
votes
0
answers
504
views
Continuity of the conditional expectation
Consider the conditional expectation of $x$ given $y$,
$$
\mathbb{E}(x | y)
$$
where $x \in X$ and $y \in Y$ where $X, Y$ are Hilbert spaces (possibly infinite dimensional).
Question :
I am looking ...
- 252
3
votes
0
answers
151
views
Largest eigenvalue divided by $n$
Let $X$ be an $n\times n$ symmetric random matrix whose diagonal is fixed as $1$, and every element in the upper triangle (excluding the diagonal) is drawn from Bernoulli($p$). The elements in the ...
- 272
3
votes
0
answers
436
views
Rank of Hadamard product with random matrices
I do research in statistics and am not sure whether the following is considered research level or not in mathematics. If it isn't, I'm happy because that means the answer is probably known and I can ...
- 131
3
votes
0
answers
98
views
Asymptotic results on statistical graph models
This post is partly inspired by this post.
Reference request: results on the asymptotic distribution of singular values related to a random orthogonal matrix
While it is well-known that two basic ...
- 8,071
3
votes
0
answers
841
views
Is uniform distribution on unit sphere subgaussian?
Is uniform distribution on unit sphere subgaussian?
To be specific, let $X = (X_1,\dots,X_d) \sim \mbox{Unif}(\mathcal{S}^{d-1})$. What is the Orlicz-$\psi_2$ norm of $X$?
- 719
3
votes
0
answers
75
views
Covariance of censored/clipped Gaussians
I am interested in the covariance of two clipped (or censored) Gaussian variables.
More precisely, let $g_1 \sim N(0,\sigma_1^2)$ and $g_2 \sim N(0,\sigma_2^2)$ be two (dependent) Gaussians with $\...
- 53
3
votes
0
answers
158
views
How are these two multi-armed bandit problems similar?
I am reading the multi-armed bandit survey by Bubeck and Bianchi. This question is for the lower bound section (2.3) of the survey.
Let us define Kullback-Leibler divergence $kl(p, q) = p \log \frac{p}...
- 145
3
votes
0
answers
82
views
Uniform mean-square-error estimates
Consider a standard statistical estimation problem with iid real observations $\{X_i\}_{i=1}^N$. For a collection of real functions $\mathcal{F}$, I want to get an estimate of the uniform rate of ...
- 111
3
votes
0
answers
699
views
How does Jensen Shannon divergence and KL divergence correlate?
I am wondering if there is way to derive the correlation between Jensen Shannon divergence and KL divergence for two distributions: P and Q, in order to show that if JSD(P,Q) decreases, KLD(P,Q) ...
- 31
3
votes
0
answers
286
views
Inequality with CDF of order statistics
here is a problem I have been struggling with for a while now. This is for a paper I am working on. Any help would be appreciated! Here we go:
Each bidder's valuation $\theta _{i},$ $i=1,...,N$, is ...
- 31
3
votes
0
answers
494
views
Maximization of a total variation distance subject to another total variation distance in Markov chain
Suppose two dependent random variables $X$ and $V$ from finite alphabets $\mathcal{V}$ and $\mathcal{X}$ with known joint and marginal distributions are given. Let $P_{XV}$ and $P_X$ and $P_V$ are the ...
- 1,109
3
votes
0
answers
108
views
"Soft" Voronoi cells or statistical criterias
It is probably some basic statistics question, but...
Informally 1: How to choose "criteria", such that it will guarantee that error decision probability is less than "epsilon", and maximize ...
- 24.9k
3
votes
0
answers
213
views
Find a minimum entropy code for a simple gibbs random field.
Just to make precise what I am talking about, I will include the definition of a minimum entropy code. I will then define the precise markov random field I am asking about.
In the rest of this ...
- 131
3
votes
0
answers
125
views
Is a parametric family which is universally consistent for multiple quantiles impossible?
Suppose I am dead-set on using Bayesian inference on independent and identically distributed data, but I'm lazy and insist on using a parametric likelihood function come what may. I'd be reassured to ...
- 2,791
3
votes
0
answers
143
views
finding rank-3 tensors compatible with a rank-2 tensor projection
I am interested in the following problem: Consider a rank-3 symmetric tensor $\boldsymbol{\sigma}$ with $\sigma_{ijk}$ where $\sigma_{ijk}$ can be 0 or 1, and the symmetry is with respect to any ...
- 41
3
votes
0
answers
206
views
representing vine copulas
Vine copulas is a way to represent multidimensional distributions (n-densitys)
as a product of the n 1-marginal densities and a product of (n choose 2) bivariate copulas, where som of them are ...
- 2,600
3
votes
0
answers
171
views
Iterated Kumaraswamy distributions
The Kumaraswamy distribution has cdf $F(x;a,b) = 1-(1-x^a)^b$.
Does anyone know any formulas or properties relating to iterations of this on itself, meaning
$$ F_i(x;a,b) = 1-(1-F_{i-1}^a)^b$$
If ...
- 233
2
votes
0
answers
77
views
Inequalities concerning cummulative distributions of binomials
For random variable $Z$, let $F_Z$ denote its cdf, i.e., $F_Z(t)=\mathbb{P}(Z\leq t)$. Let $X$ be a binomial distribution with parameters $(n,p)$ and $Y$ a binomial distribution with parameters $(m,p)$...
- 121
2
votes
0
answers
56
views
Sum of independent Wisharts
Suppose random vectors $y_1,y_2,\ldots,y_m$ are independent and the distribution of each $y_i$ is a $d$-dimensional complex Gaussian with mean $0$ and covariance $\Gamma_i$, that is $y_i \sim \mathcal{...
- 193
2
votes
0
answers
50
views
Weighted squared norm of multivariate truncated normal vector
Let $X \sim \mathcal{N}(0, \Sigma)$ be a multivariate normal vector with zero mean and inverse covariance matrix
$$
\Sigma^{-1} = \begin{pmatrix}
n & 1 & 1 & \cdots & 1 &...
2
votes
0
answers
84
views
Concentration result for self-normalized empirical process
In Theorem 1.1 of this paper by Bercu, Gassiat and Rio, a concentration result is derived for the 'self-normalized' empirical process. Specifically, suppose that $(X,X_n)_{n \ge 1}$ is a sequence of i....
- 206
2
votes
1
answer
245
views
Sum of arrival times of Chinese Restaurant Process (CRP)
Suppose that a random sample $X_1, X_2, \ldots$ is drawn from a continuous spectrum of colors, or species, following a Chinese Restaurant Process distribution with parameter $|\alpha|$ (or ...
- 141
2
votes
0
answers
92
views
Construct a Bregman divergence from Wasserstein distance
I was wondering whether one has studied the Bregman divergence arising from a squared Wasserstein distance.
More precisely, let $\Omega\subset \mathbb{R}^d$ be a compact set and $c\in \Omega\times \...
- 503
2
votes
0
answers
115
views
Equivalence of score function expressions in SDE-based generative modeling
I am studying the paper "Score-Based Generative Modeling through Stochastic Differential Equations" (arXiv:2011.13456) by Yang et al. The authors use the following loss function (Equation 7 ...
- 43
2
votes
0
answers
68
views
What is an efficient non-adaptive group testing scheme if the number of defectives, $d$, grows proportionally to the number of items, $n$?
Suppose that for some $p \in \left(0, 1\right)$ and some $n \in \mathbb{N}$, we have $n$ independent Bernoulli random variables, $X_{1}, X_{2}, \dots, X_{n}$, each with mean $p$. We shall call $X_{1}, ...
