Questions tagged [probability-distributions]
In probability and statistics, a probability distribution assigns a probability to each measurable subset of the possible outcomes of a random experiment, survey, or procedure of statistical inference.
1,931
questions
0
votes
0
answers
55
views
Finding a collection of random variables satisfying (exactly or numerically) a given set of moment identities
Let $X_p$ for $p\in \mathbb{Z}$ be a collection random variables that satisfy for all $k>0$, $p\in \mathbb{Z}$:
$$\sum_{p_1+\dots+p_k=p} \mathbb{E}[X_{p_1} \dots X_{p_k}]=\begin{cases}
0 &...
- 133
-1
votes
0
answers
25
views
What is the direct role of exchangeability in ensuring coverage in conformal prediction?
I was wondering how exchangeability directly relates to the proof of the coverage guarantee in conformal prediction. In most papers I have seen, usually they say that by exchangeability the order of ...
- 11
0
votes
0
answers
14
views
Position dependent service time in queue
Is there any literature for queuing analysis (waiting time, capacity etc.) of a queue with service time that depends on the position of the customer in the queue?
I have encountered a problem where a ...
- 11
0
votes
0
answers
25
views
Integral of Cauchy distribution? [migrated]
I'm studying for my midterm and got stuck in a basic probability question. The question is as given below.
Consider Neyman-Pearson criteria for two Cauchy distributions in one dimension
$$p(x|\omega_i)...
0
votes
0
answers
37
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 23
1
vote
1
answer
60
views
Queues wait for other queues- A communication problem
I am working on a problem which involves a single server that requires multiple inputs to do a computation. Each of these inputs arrive as a Poisson process with rate $\lambda$. Hence, a situation ...
- 11
-2
votes
0
answers
45
views
Impact of Reducing Randomness on Total Variation Distance Between Distributions
I'm exploring the effects of reducing randomness in one variable on the total variation (TV) distance between two distributions derived from functions of binary strings. Specifically, I have two ...
0
votes
0
answers
38
views
Understanding CDF comparisons between normalized sums of hypergeometric and binomial distributions
I am analyzing a population composed of $N$ bits, containing $K$ ones ($1$s) and $N-K$ zeros ($0$s). When sampling $n$ bits without replacement, the scenario aligns with a hypergeometric distribution. ...
- 105
-1
votes
0
answers
55
views
Stroboscopic sampling of a random process
Consider a random process that is an alternation of two phases, labeled "0" and "1".
The duration of phase events are governed by the exponential distributions, $Exp_{\lambda_0}(\...
- 1
0
votes
0
answers
41
views
Are there probability densities $\rho, f_n$ such that $\lim_n \frac{[\rho * f_n]_\alpha}{\|\rho * f_n\|_\infty} = \infty$?
We fix $\alpha \in (0, 1)$. Let $[f]_\alpha$ be the best $\alpha$-Hölder constant of $f: \mathbb R^d \to \mathbb R^k \otimes \mathbb R^m$, i.e., $[f]_\alpha := \sup_{x \neq y} \frac{|f(x) - f(y)|}{|x-...
- 851
1
vote
1
answer
44
views
Lower bound the best $\alpha$-Hölder constant of a convolution
Let $\mathcal D_1$ be the set of bounded probability density functions on $\mathbb R^d$. This means $f \in \mathcal D_1$ if and only if $f$ is non-negative measurable such that $\int_{\mathbb R^d} f (...
- 851
1
vote
2
answers
80
views
Is the difference between $\alpha$-Hölder constants of $f*\rho$ and $g*\rho$ controlled by $\|f-g\|_\infty$?
Let $\mathcal D_1$ be the set of bounded probability density functions on $\mathbb R^d$. This means $f \in \mathcal D_1$ if and only if $f$ is non-negative measurable such that $\int_{\mathbb R^d} f (...
- 851
-2
votes
0
answers
56
views
How to solve simple equation with random variables?
Let $X$, $A$, $B$ be random variables with values over $\mathbb{N}$
All variables may have a different distribution
$A$ and $X$ are independent
$B$ verifies $B = X + A$
Knowing the distributions of $...
- 97
0
votes
0
answers
82
views
Comparison between the expected values of the inverse of the CDF of binomial-distributed random variables
Let us denote with $F(x;j,\mu)$ the cdf of a Binomial distributed random variable with $j$ trial with success probability $\mu$ considered in $x$, and let $f(x;j,\mu)$ be the pmf. Defining $0\leq \...
0
votes
1
answer
81
views
Reverse Pinsker's inequality for smooth density classes
Suppose we are given a class of probability density functions $\mathcal{F}$ so that for every $f \in \mathcal{F}$ we have $\alpha \leq f \leq \beta$ for some positive $\alpha, \beta \in \mathbb{R}_+$ ...
2
votes
1
answer
162
views
Reference request: Best book to cite on a property of the family of Cauchy distributions
Kai Lai Chung once began a section of a textbook on probability by writing
"Everybody knows" that $$ e^x = \sum_{n\,=\,0}^\infty \frac{x^n}{n!}. $$
(with those quotation marks). Other ...
- 11.9k
-1
votes
0
answers
70
views
Random variables in conservative differential equations
I have a system of differential equations in which a variable converts to several other ones. I'd like to add randomness to the parameters, but I am not sure the best approach.
A minimal example (the ...
0
votes
1
answer
46
views
Everywhere existence of marginals
Let $f\in L^1(\mathbb{R}^2)$ be a (joint) probability density function which satisfies $f(x,y)>0$ for all $(x,y)\in \mathbb{R^2}$.
What is a necessary and sufficient condition under which the ...
- 3,554
0
votes
0
answers
28
views
Moment generating function for product states
In the sequel $B=M_\ell(\mathbb{C})$.
For $M\in\mathbb{N}$ fixed and $N\geq M$ I consider the symmetrizer $\pi_{M,N}(x_M)\in B^{\otimes N}$, which is the symmetrized tensor product of $a_1$,...,$a_M$ ...
- 63
1
vote
1
answer
167
views
Chebyshev's inequality for Poisson distribution
Reading an old Richard Karp paper, in which he mentions this argument "Application of Chebyshev's inequality yields the result that, if $X$ is Poisson distributed with mean $\lambda$, then $E(X\...
- 67
0
votes
0
answers
18
views
reference request: product measures defined by a subsequence of measures
Suppose $\{\mu_n\}_{n\in\mathbb{N}}$ is a sequence of pairwise equivalent probability measures, each of which is defined on $\mathbb{R}$. Let $\bigotimes_n\mu_n$ be the product measure defined on $\...
- 235
2
votes
1
answer
63
views
From convergence of sequences to uniform convergence in probability
For $n=1, 2,\ldots$ consider a sequence of sets of ascending integers $I_n=\{\underline{i}_n,\underline{i}_n+1, \ldots, \overline{i}_n\}$, with $\underline{i}_n \to \infty$ and $\underline{i}_n=o(\...
- 157
2
votes
0
answers
39
views
If a probability measure is a mixture of products of its marginals, does it have finite moments?
Let $\mu$ be a Borel probability measure on $\mathbb{R}^n$. For a linear subspace $E\subset \mathbb{R}^n$, let $\mu_E$ denote the marginal of $\mu$ on $E$. The usual orthogonal complement of $E$ is ...
- 716
0
votes
0
answers
69
views
Inequality related with log-concave distributions
Fix any $n$-dimensional unit vector $\mathbf v$.
Let $\mathbf x$ be a random vector following the $n$-dimensional standard normal distribution. It has been shown (Analysis of Perceptron-Based Active ...
- 149
1
vote
1
answer
110
views
A property of the distribution related to stochastic ordering
Let $X$ be a random variable with a symmetric support $S\subset[-M,M]$ for some $M>0$. (i.e., if x is a point of increase of CDF $F_X(\cdot)$, so is $-x$.)
Has the infimum value of $c$ such that
\...
- 19
0
votes
0
answers
62
views
Asymptotic stochastic ordering for weighted sum of i.i.d. random variables
Are you aware of any literature focusing on the conditions such that for two i.i.d. sequences of discrete r.v.'s $\{X_n\}$ and $\{Y_n\}$,
\begin{equation}
a_1X_1+a_2X_2+\ldots+a_nX_n\geq_1 a_1Y_1+...
- 19
0
votes
0
answers
63
views
Maximizing the trace of the resolvent of a Wishart matrix over positive unit trace matrices?
Let $G$ be a standard $d \times d$ Wishart random matrix and consider the problem of maximizing the function
$$
f(M) = \mathbb{E}\Big[\mathrm{tr}((G + M^{-1})^{-1})\Big],
$$
over the class of real ...
- 342
0
votes
1
answer
34
views
Gumbel-Softmax like function
I am trying to train my DNN models and face some mathematical problems.
Let me explain my goal. Consider an input tensor like [1,2,3,4,5]. I aim to obtain a one-hot encoded vector of the argmax of ...
1
vote
0
answers
67
views
Gibbs Priors form a Martingale
I am working on adapting variational inference to the recently developed Martingale posterior distributions. The first case, which reduces the VI framework to Gibbs priors, is proving hard to show as ...
- 29
0
votes
1
answer
101
views
Limit distribution of the self-normalized sum of Cauchy random variables
This is something that has come up in my research. I originally posted this question on CrossValidated but realized it might be better suited for this site. I have deleted the question there (in case ...
- 103
1
vote
1
answer
193
views
Upper-bound of the tail of a weighted sum of iid random variables
I have a question related to this one. $X_i$ are n iid random variables with CDF $1_{[0,+\infty[}(x) \Phi(x)$, i.e. it is a mixture between a folded Gaussian and a delta in $0$, both with weight $1/2$....
- 65
0
votes
0
answers
72
views
Random walks on groups
I recently started reading Wolfgang Woess' book titled "Random Walks on Infinite Groups". In the section where he introduces Markov chains and random walks on a set $X$, he has defined a ...
- 9
1
vote
1
answer
120
views
Stochastic order on weighted sum of iid random variables
$X_i$ are n iid random variables with CDF $1_{[0,+\infty[}(x) \Phi(x)$, i.e. it is a mixture between a half Gaussian and a delta in $0$, both with weight $1/2$.
I would like to show that, $\forall a \...
- 65
2
votes
1
answer
86
views
Deriving the distribution of standardized variables with empirical mean and standard deviation
I'm working with a set of independent and identically distributed random variables $\{ x_i \}_{i=1}^N$, where each $x_i$ follows a Gaussian distribution $P_X(x) = \mathcal{N}(x; \mu, \sigma^2)$. This ...
- 185
9
votes
1
answer
350
views
Characterize algebras of the "topological simplices" operad
The operad of topological simplices, which I'll denote $\Delta$, has as $n$-ary operations the set
$$
\Delta_n:=\left\{P\colon\{1,\ldots,n\}\to[0,1]\;\middle|\;1=\sum_{i=1}^n P(i)\right\}
$$
of ...
- 8,559
0
votes
0
answers
45
views
Existence of derivative of distribution of exponential family?
Suppose $(X, \mathcal{F})$ is a measurable space and $\left\{F_\theta, \theta \in \Theta\right\}$ is a distribution family on $(X, \mathcal{F})$. When $\left\{F_\theta, \theta \in \Theta\right\}$ is ...
1
vote
2
answers
215
views
Relationship between fixed points and inversions in permutations
Inversions in a permutation $Y$ are defined as pairs where $Y_a < Y_b$ but $a > b$, while fixed points in $Y$ are defined as elements where $Y_a = a$ (i.e., 1-cycles). Let $S_\alpha$ be the set ...
- 173
0
votes
0
answers
27
views
Probability density function estimation for rare events
My goal is to numerically estimate the probability density function (pdf) $P(f)$ for the function $f(x_1,x_2,\cdots,x_n)$. Here the random variables $x_1,x_2,\cdots,x_n$ are drawn from the independent ...
- 431
0
votes
0
answers
47
views
Computing the Laplace transform of an expression
I would like to find the Laplace transform of the following expression with respect to the Laplace parameter s
$ \int_{z=u}^{\infty} e^{-az/c} g^{'}(\dfrac{z-u}{c}) \int_{x=0}^{\infty} \varphi(z-x)dF(...
- 1
7
votes
1
answer
527
views
A variation on the Borel–Cantelli lemma theme
Let $X,X_0,X_1,\dots$ be nonnegative independent identically distributed (i.i.d.) random variables. Let
\begin{equation*}
E:=\bigcap_{n\ge0}B_n,
\end{equation*}
where
\begin{equation*}
B_n:=\...
- 118k
2
votes
1
answer
114
views
Convexity of a function
Let: $F_{j+1,y}(s)$ be the cumulative distribution function of a binomial distribution with mean $y$, $j+1$ independent trials considered for $s$ successes. Is it possible to show in any way that:
$\...
1
vote
0
answers
78
views
How can one build a min-2-wise independent small sample space from min-3-wise permutations?
I have been studying a polynomial-size set of permutations from one of my lectures. The below image, taken from the lecture notes PDF, illustrates how to construct min-3-wise permutations.
My ...
- 15
1
vote
1
answer
59
views
Upper bound $I_R := \int_{B_R^c} |x| (P_t \ell_\nu) (x) \, \mathrm d x$ in terms of $R, \nu, t$?
Let $(p_t)_{t >0}$ be the Gaussian heat kernel on $\mathbb R^d$ and $(P_t)_{t >0}$ its induced semi-group, i.e.,
$$
\begin{align}
p_t (x) &:= (4\pi t)^{-\frac{d}{2}} e^{-\frac{|x|^2}{4t}},
\...
- 851
4
votes
0
answers
127
views
Algebraic area of Brownian half-plane excursion
Is anything known about the distribution of the algebraic area, à la Lévy's stochastic area, of a Brownian excursion in the half-plane? To be precise, letting $x>0$, we consider the path $(X_t,Y_t)...
- 3,555
1
vote
1
answer
57
views
How does Chernoff-Hoeffding bound with limited independence reduce to the usual generic CH bound with complete independence
As the title might suggest, I am referring to this paper https://www.cs.umd.edu/~srin/PDF/ch-bounds.pdf , titled : Chernoff-Hoeffding Bounds for Application with Limited Independence.
The theorem in ...
- 121
0
votes
1
answer
71
views
Optimization: Determine the categorical pmf that maximizes the objective function
Let $T$ denote a $J$-component categorical random variable with pmf
$$
\mathsf P(T=t_j)=w_j,\quad j=1,2,\dots,J,
$$
where $t_j\in[0,t_\max]$, $t_\max>0$.
I came across a problem that seeks to ...
1
vote
1
answer
90
views
fourth-order multivariate Gaussian integral
I am struggling with an integral of form
$$ \int_{\mathbb R^n} y\otimes y~ \langle Ay,y\rangle \, \mathrm d N(0,\Sigma)(y). $$
I assume that it will involve the trace of some product of $R$ and $\...
- 375
2
votes
1
answer
95
views
expectation of the product of Gaussian kernels and their input
I was wondering if anybody knows how to solve: $$\mathbb{E}{\mathbf{z} \sim \mathcal{N}(\mathbf{0}, \mathbf{I})}\left[ (\mathbf{x}{i} - \mathbf{z})(\mathbf{x}{j} - \mathbf{z})^\top \exp\left( - (\...
- 195
13
votes
1
answer
961
views
A disc contains many random points. Each point is connected to its nearest neighbor. What is the expectation of average cluster size?
A disc contains $n$ independent uniformly distributed points. Each point is connected by a line segment to its nearest neighbor, forming clusters of connected points.
For example, here are $20$ random ...
- 2,663
-1
votes
3
answers
186
views
Proving the uniform distribution maximizes the expected value of the product of a random draw of $m$ elements from discrete distribution
Say I have a discrete probability distribution $p_i$, so $0 \le p_i \le 1$ and $\sum_i{p_i}=1$. We sample $m > 1$ draws $D$ from this distribution proportional to $p_i$ with replacement, and ...
- 109