All Questions
Tagged with pr.probability st.statistics
1,135 questions
2
votes
0
answers
109
views
Tightness of Hilbert-space-valued arrays
Let $\mathcal{H}$ be a separable Hilbert space. Assume we have some triangular array $W_{n,j}, j=1, \ldots ,n $ of $\mathcal{H}$-valued random elements with $\mathbb{E} \Vert W_{n,j} \Vert_{\mathcal{H}...
- 83
9
votes
2
answers
879
views
Is there a combinatorial/topological treatment of statistical independence?
Is there any reference which studies sets of random variables as independence systems, a type of combinatorial object (see below)?
Motivation:
In particular, since independence systems are abstract ...
- 24.2k
0
votes
1
answer
140
views
Tail bounds for the absolute difference of a coupled pair of sub-Gaussian random variables
Let $P$ and $Q$ are sub-Gaussian distributions on $\mathbb R$, and $(X,X')$ be a coupling of $P$ and $Q$, i.e $(X,X') \sim \pi$ for some distribution on $\mathbb R^2$ with marginals $P$ and $Q$.
...
- 128k
1
vote
1
answer
140
views
Conditional density for random effects prediction in GLMM
I am currently working on generalized linear mixed models (GLMM) and need some help concerning the prediction of the random effects. More specifically, I don't understand the given representation of ...
- 63.9k
1
vote
0
answers
45
views
What is the number of iterations needed for the message passing algorithm to converge when applied to an acyclic factor graph?
I understand that the message passing algorithm (Belief Propagation algorithm), when applied to a factor graph consists in an exchange in messages between the factor nodes and the variable nodes, ...
- 5,429
2
votes
1
answer
99
views
Convergence of estimator given by a fixed point
Let $X$ be a non-negative random variable with cdf $F$ and define
$$G(s) = E[\max(0,u(X)-sX)],$$ where $u$ is some real function.
Let $s_0$ be the unique fixed point of $G$.
Now let $X_1,\dots,X_t$ ...
- 128k
26
votes
3
answers
11k
views
L1 distance between gaussian measures
L1 distance between gaussian measures: Definition
Let $P_1$ and $P_0$ be two gaussian measures on $\mathbb{R}^p$ with respective "mean,Variance" $m_1,C_1$ and $m_0,C_0$ (I assume matrices have full ...
- 6,853
0
votes
1
answer
70
views
Deriving asymptotic variance of generalized estimating equation estimator (GEE)
As well known to us, K.Y. Liang and S. Zeger proposed GEE for longitudinal data analysis in their famous paper[1]. At the appendix of the paper, authors show the proof of Theorem 2. I tried to ...
- 41
7
votes
2
answers
646
views
Moments of a positive random variable
Suppose one is handed a list of $K$ numbers, with a claim that these numbers are the first $K$ moments of a positive random variable $X$ (meaning there is 0 probability that $X<0$).
What is the ...
- 6,406
1
vote
0
answers
334
views
Strong data-processing inequality ? Upper bound on a certain modified total-variation metric
Let $\mathcal X=(\mathcal X,d)$ be a Polish space equipped with the Borel sigma-algebra. Let $p\ge 1$ and $P_1,P_2$ be probability distributions on $\mathcal X$ such that $\max_{k=1,2}\int d(x,x_0)^...
- 6,853
1
vote
0
answers
60
views
A determinantal mixture of probability densities
I came up with this operation after playing with determinantal point processes:
Given two probability densities $f,g$ defined on some measurable space with reference measure $\mu$, set
$$
f\star g(x)...
- 2,135
0
votes
0
answers
221
views
Distance between two sample quantiles
Let $X_1,\dots X_n$ be i.i.d. samples from an unknown distribution. We know the distribution has uniformly bounded probability density function $f(x)$. Let $1>\tau_1>\tau_2>0$ be two quantile ...
- 323
3
votes
1
answer
355
views
Upper bounding the start of a distribution's CDF, given bounds on first moments
Take nonnegative random variables $X$ whose first $K$ moments have bounds:
$\mu^k\leq E[X^k]\leq c\mu^k$ for each $k=1,\dots,K$.
In this case what is an upper bound for $P(X\leq O(\mu))$?
I am ...
CommunityBot
- 1
2
votes
0
answers
2k
views
Approximate Multivariate Gaussian Integration by Parts
When $Z$ is a $\mathcal{N}(0,1)$ random variable, $f$ smooth from $\mathbb{R} \to \mathbb{R}$ we have the Gaussian integration by parts formula
$$
\mathbb{E}(Zf(Z)) = \mathbb{E} f'(Z).
$$
One analog ...
- 21
2
votes
0
answers
173
views
Weak convergence of $\mathcal{L}^2$ valued random variables
Consider two continuous functions $f,g: \mathbb{R}^{2} \rightarrow \mathbb{R}$ with $f(x,\cdot), g(x,\cdot) \in \mathcal{L}^2(\mathbb{R},\mathcal{B},\lambda)$ for all $x \in \mathbb{R}$ and a sequence ...
- 83
2
votes
1
answer
112
views
P-value in likelihood ratio test definition
According to Williams, D.: Weighing the Odds the p-value of observed data in the likelihood ratio setting is defined as
$$\mathrm{p_{val}}(y^{obs}) := \mathrm{sup}_{\theta \in B_0} \mathbb{P}\big(\...
- 63
3
votes
3
answers
483
views
$H(p) \le H(q) + KL(p, q)$?
Let $H(p) = \sum_i p_i\log\frac{1}{p_i}$ be the entropy of $p$
and $KL(p, q) = \sum_i p_i\log\frac{p_i}{q_i}$ be the KL divergence between $p$ and $q$. Does it hold that $H(p) \le H(q) + KL(p, q)$?
...
- 143
2
votes
1
answer
1k
views
Order statistics on the spacings between order statistics for the uniform distribution
For any natural $n$, let $U_1,\dots,U_n$ be independent identically distributed
random variables each uniformly distributed on the interval $[0,1]$. As usual, let $U_{n:1}\le\cdots\le U_{n:n}$ ...
CommunityBot
- 1
4
votes
1
answer
312
views
Given three distributions p, q and h. If KL(p||q) is large enough and KL(q||h) is small enough, does there exist a number N such that KL(p||h)>N?)
Given three distributions $p, q$ and $h$, assume we know that the Kullback-Leibler divergence obeys
$KL(p\Vert q)$ is large enough, say $KL(p\Vert q) > M$ where $M$ is large enough, and
$KL(q\Vert ...
- 128k
2
votes
1
answer
300
views
Sufficient conditions to be a covariance
Given a function, $c(x,y):\mathbb{R}\times \mathbb{R}\to \mathbb{R}$, what are sufficient conditions for this to be the covariance of some (centered) Gaussian random field $X:\mathbb{R}\to \mathbb{R}$,...
- 2,772
1
vote
0
answers
73
views
Reduce the asymptotic variance for a class of Metropolis-Hasting estimates
I'm running the Metropolis-Hastings algorithm with state space $E$, target distribution $\mu=p\lambda$ and proposal kernel $Q$ to estimate $\mu(hf)$ for a fixed function $f:E\to[0,\infty)^3$ and a ...
- 167
0
votes
0
answers
58
views
Bounds on $\inf_{x,x' \in \mathbb B_X}TV(P+x,Q+x')$, where $P$ and $Q$ are distributions with density on the space $X=(\mathbb R^n,\ell_p)$
Let $n \ge 1$ be an integer, $p \in [1,\infty]$, and $P$ and $Q$ be two (probability) measures on the metric space space $X=(\mathbb R^n,\ell_p)$ which have densities w.r.t the Lebesgue measure on $X$,...
- 6,853
3
votes
2
answers
168
views
A definite integral related to sample variances of bivariate Gaussians
This integral is needed to obtain the joint
distribution of the sample variances of a random sample from a bivariate
Gaussian distribution. For details on the joint distribution of the sample
means, ...
- 24.8k
0
votes
1
answer
822
views
The distribution of the sum of inner products of two independent complex normal vectors
If I have $\mathbf x_n=[x_0, x_1,... ,x_K]^T$ and $\mathbf y_n=[y_0, y_2, ..., y_K]^T$, where $x,y\sim\mathcal C\mathcal N(\mathbf 0,\sigma^2\mathbf I)$.
What is the distribution of the following ...
- 128k
4
votes
1
answer
124
views
The behavior of a uniform order statistic near zero
Let $X_{(k)}$ be the $k$th order statistic out of $n$ uniform $[0,1]$ random variables. Let $q$ be the location of the $p$ quantile of $X_{(k)}$, i.e. $\Pr[X_{(k)}\leq q] = p$. For small $p$, Is it ...
- 128k
1
vote
1
answer
170
views
Stationary distribution of Markov Chain with departure
I have a Markov Chain of $N$ states. Such states represent the energy levels in a molecule.
The states' connectivity is as follows:
States $j\in\{0,\ldots,N\}$ transition to $k\in\{\max(j-M,0),...,\...
- 151
1
vote
0
answers
56
views
Minimizing the rate of geometric ergodicity of a Metropolis-Hastings kernel depending on a parameter
Let $\tilde\kappa$ denote the transition kernel of the Markov chain generated by the Metropolis-Hastings algorithm with proposal kernel $\tilde Q$ and target distribution $\tilde\mu$.
I want to ...
- 167
3
votes
1
answer
554
views
Probability that random walk stays in quadrant
Let $S_n = \sum_{i=1}^n X_i$ where $X_i \in \mathbb R^d$ are iid. random vectors with $E[X_i]=0$.
We want to lower-bound the probability that
$$
\begin{align}
\forall_{n=1}^m S_n \le k
\end{align}
$$...
- 14.2k
0
votes
1
answer
344
views
How to prove that $X_1X_1', X_2X_2'$ are iid random matrices if we know that $X_1,X_2$ are iid random vectors? [closed]
Let $X_1, X_2$ be two iid random row vectors in $\mathbb{R}^p$, each of whose components are real valued. I'd like to prove that the $\mathbb{R}^{p\times p}$ random matrices $X_1X_1', X_2X_2'$ are ...
CommunityBot
- 1
1
vote
1
answer
143
views
Lower bound for log-Ratios
Can we find a universal constant $c>0$ such that for all $p,q\in\Delta:=\lbrace x\in (0,1)^{n}\ \colon\ x_{1}+\dots+x_{n}=1\rbrace$ it is true that
\begin{equation}
|p_{i}-q_{i}|\le c\left|\ln\frac{...
- 14.2k
3
votes
4
answers
375
views
Distinguishing between urn probability models
I have question about the urn model. Suppose I have an urn:
...
- 595
5
votes
1
answer
429
views
Trying to understand Fisher's proof
$\newcommand{\al}{\alpha}$
For $i=1,\dots,n$, let
\begin{equation}
R_i:=\frac{X_i}{X_1+\dots+X_n},
\end{equation}
where the $X_i$'s are iid standard exponential random variables. Let
$$R_*:=\max_{1\...
- 4,713
-1
votes
2
answers
1k
views
Does the variance of a strictly monotonically increasing function of a random variable have anything to do with the variance of the random variable? [closed]
Assume that there is a continuous random variable x, and its variance is var(x). Furthermore, there is a strictly monotonically increasing function f. Can anybody prove that the larger the var(x), the ...
- 14.2k
8
votes
2
answers
330
views
q-Means and the mode of a distribution
Let $f:\mathbb{R} \rightarrow [0,\infty)$ be a continuous probability density function on $\mathbb{R}$ such that
\begin{equation}
\int_{\mathbb{R}} |x| f(x)\, dx < \infty,
\end{equation}
and ...
- 63.9k
0
votes
1
answer
211
views
Relationship between a certain binary optimal transport and total-variation of modified distributions
Let $\mathcal X$ be a Polish space, and let $(N_x)_{x \in \mathcal X}$ be a system of closed neighborhoods in $\mathcal X$. Define $\Omega := \{(x,x') \in \mathcal X^2 \mid N_x \cap N_{x'} = \emptyset\...
- 6,853
1
vote
0
answers
131
views
Probabilistic lower bound on largest singular value of matrices
I have a distribution $\mathcal{D}$ that spits out vectors in $\{-1, 1\}^N$. Suppose I have a sample of $H$ of these vectors which I arrange into a matrix $M$ of the form $H \times N$.
Consider the ...
- 1,129
2
votes
1
answer
193
views
Simple question regarding negatively associated random variables
I'm trying to learn about negative association of random variables. A definition can be found here: http://www.cs.cmu.edu/~dwajc/notes/Negative%20Association.pdf.
Now, consider the following ...
- 14.2k
1
vote
0
answers
81
views
Empirical estimation of $\inf_{\gamma \in \Pi(\mu,\nu)}\gamma(\Omega)$, given i.i.d samples from $\mu$ and $\nu$
Let $\mathcal X$ be a Polish space and $\Omega \subseteq \mathcal X^2$ be open. Let $\mu$ and $\nu$ be probability measures, and consider the quantity $c_\Omega(\mu,\nu)$ defined by
$$
c_\Omega(\mu,\...
- 660
4
votes
1
answer
344
views
Degenerate Gaussian Integral
I have an integral over a subspace of $\mathbb{R}^n \times \mathbb{R}^n$ with an integrand of the form
$$\exp\left(-\frac{1}{2}\left[||u^2|| + \langle u, v \rangle + ||v||^2\right]\right)$$
The ...
- 128k
2
votes
1
answer
636
views
Sufficient condition for function of conditional probability density to be increasing
Let $Y$ and $W$ be two jointly distributed random variables; $Y$ takes values on $(y_1,y_2)$ and $W$ takes values on $(w_1,w_2)$. The conditional probability density of $W$ given $Y$ is given by $f_{W|...
- 128k
-1
votes
1
answer
312
views
expectation of upper quantile proportion
(edited considerably following comments)
We have a collection $\boldsymbol{S}$ of $n$ discrete random variables $X_1$, $X_2$, $\dots$, $X_n$ $\overset{\small \text{i.i.d.}}{\small \sim}$ $\mathcal{D}$...
- 23.2k
0
votes
1
answer
1k
views
Convergence in distribution of products
Suppose that a sequence of random variables $Y_n$ convergence in $L^2$ to $Y$, i.e.
$$
E|Y_n-Y|^2\to0\quad \text{as}\quad n\to\infty.
$$
Moreover, there exist constants $c_0$ and $c_1$ such that
$$
0 &...
0
votes
1
answer
165
views
About another potential characterization of normal numbers
Normal numbers, in a nutshell, are real numbers that have a "uniform" distribution of digits in standard numeration systems (binary, decimal, and so on.) You can find a formal definition and ...
- 24.8k
4
votes
1
answer
812
views
On the largest and smallest spacings for the uniform distribution
Let $Z_1,\dots,Z_n$ be iid random variables (r.v.'s) each uniformly distributed on $[0,1]$. Let $Z_{n:1}\le\cdots\le Z_{n:n}$ be the corresponding order statistics. For $i=1,\dots,n-1$, let $G_i:=Z_{n:...
- 128k
1
vote
1
answer
155
views
Reference request concerning order statistics from the uniform distribution
Let $U_1,\dots,U_n$ be iid random variables uniformly distributed on the interval $[0,1]$, with the corresponding order statistics $U_{(1)}\le\dots\le U_{(n)}$. Let $G_i:=U_{(i+1)}-U_{(i)}$ for $i=0,\...
- 10.4k
2
votes
1
answer
247
views
Overview of interpretations of classical probability
The Stanford Encyclopedia of Philosophy has a nice overview of numerous different interpretations of probability (classical as opposed to quantum) with an extensive bibliography.
What books would ...
- 39.9k
1
vote
0
answers
69
views
Concentration or distribution of the scaled $l_p$ norm of a correlation matrix
Background:
Among Hermitan random matrices, correlation matrix has a lot of applications in statistics. People have studied the "empirical spectral distribution (ESD)" of a correlation matrix, the ...
- 984
5
votes
2
answers
565
views
Concentration of U-statistics for exchangable distributions (and the unbounded case)
Consider the following so-called $U$-statistic of order 2: $$U = \frac1{\binom{m}{2}} \sum_{i < j} h(w_i,w_j)$$ where $w_1,\dots,w_m$ are IID from some distribution and $h$ is symmetric. If $|h(w_1,...
- 2,821
3
votes
2
answers
2k
views
Empirical estimator for total variation distance between two product distributions
Let $X = (X_1, X_2, \ldots , X_n)$ be an $n$-dimensional random variable, where each $X_i$ is a random variable on finite discrete set $S$. In addition, $X_i$ are independent of each other (but not ...
- 6,541
1
vote
2
answers
234
views
Find $\inf_{P_{X_1,X_2}}P_{X_1,X_2}(\|X_1-X_2\| > 2\alpha)$ , where $\alpha > 0$ and inf is over couplings
Let $\mathcal X$ be a seperable Banach space with norm $\|\cdot\|$, and let $X_1$ and $X_2$ be random vectors on $\mathcal X$ with finite means.
Question. Given $\alpha > 0$, what is value of, ...
- 6,853