All Questions
Tagged with pr.probability probability-distributions
1,384 questions
1
vote
0
answers
85
views
BM hitting times with exponential killing process
Assume a BM in 3d domain (infinite) with a small absorbing subdomain (cube, sphere, ect), centered at point $p_s=(x_s,y_s,z_s)$ . BM starts at point $p_0=(x_0,y_0,z_0)$ and when it riches the ...
- 11
6
votes
1
answer
129
views
Choosing a sample based on where the density function is highest
Is there a name for the following process?
Say I have an absolutely continuous probability density function $f$ with compact support, and I take $k$ independent samples $x_1,\dots,x_k$ from $f$. ...
- 2,558
3
votes
0
answers
157
views
Growth of inner products between two random vectors on the sparse hypercube
We define the $s$-sparse hypercube in $\mathbb{R}^d$ as
\begin{align}
\mathbb{H}_s = \bigl \{ {\bf{v}} \in \{ -1, 0 , 1\}^d \colon \| {\bf{v}} \|_0 = s \bigr\},
\end{align}
where $ \| {\bf v} \|_0 $ ...
- 1,127
2
votes
0
answers
87
views
A question about probabilistic graphical models
Say one is given a probabilistic graphical model and a cut of the underlying graph. Do we know any statements about when and how can one or many of the marginals (of the sources) or the conditionals (...
- 2,246
0
votes
1
answer
558
views
Counterexample: weak convergence doesn't imply $L^1-$convergence [closed]
I'm not sure my question is of research level, but I cannot find the answer in the existing reference. Let $\mu_n$ be a sequence of probability measures on $\mathbb R$ satisfying
$$\int_{\mathbb R}xd\...
- 128k
2
votes
1
answer
306
views
About Renyi entropy
If one is given a joint probability distribution over a finite set of discrete random variables then I guess there a notion of $\alpha-$Renyi entropy defined for it as $S_\alpha (X_1,..,X_n) = \frac{...
- 10.4k
1
vote
1
answer
324
views
Averaged geometric series with floor function
Given a value $p\in[0,1]$ (a probability of occurrence), I would like to bound the following expression:
$$ s\frac{1-(1-p)^{k+1}}{p(k+1)} + (1-s)\frac{1-(1-p)^{k}}{pk},\ \ \ \text{where $k=\lfloor 1/...
- 128k
7
votes
1
answer
719
views
Tightness and Functional Analysis
Let $(\Omega , \mathbb{P})$ be a probability space and $X$ be a real-valued random variable. Then we immediately have the push-forward measure $\mu$ on $\mathbb{R}$ and one can think of $\mu$ as an ...
- 217
1
vote
0
answers
184
views
variance of log of ratio of chi-square variables
Let X be a chi-square variable with two degrees of freedom.
Let A and B be to arbitrary constants, with $A>B>0$.
I need the variance of
$Y=\log(1+AX)-\log(1+BX).$
The mean is, maybe not simple,...
- 61
3
votes
0
answers
134
views
Algorithm to calculate moments of uniform distribution on convex polyhedra
There is system of linear inequalities
$$
Ax \leq K,
$$
$$
x\geq a, x\leq b.
$$
$A$ is $(n\times m)$-matrix, where $n\approx 100$ and $m\approx 10000$, $rank(A)=n$.
Suppose that on set of solutions ...
0
votes
0
answers
51
views
derivation of a gap related to extreme value theory
I have an expression to evaluate as follow:
$\mathbb{E}\left[\sum_{k=1}^K s_k f(x_k)\Big|s_k=s_k^{\ast} \right]$
where $\{s_k^\ast\}$ can be treated as a ${policy}$ which is defined as follows:
\...
5
votes
3
answers
4k
views
Integral over error function and normal distribution
Help me understand why
$\int_{-\infty}^{\infty}\frac{1}{2}[1+\operatorname{erf}(\frac{\theta-x}{\sqrt{2q^2}})]\frac{1}{\sqrt{2\pi\sigma^2}}{\exp(-\frac{(x-\mu)^2}{2\sigma^2})}dx \approx \frac{1}{2}[...
CommunityBot
- 1
3
votes
1
answer
187
views
Moment matching on the standard simplex
Let $\vec{\mu}_1, \vec{\mu}_2,\ldots, \vec{\mu}_k \in \Delta^{d-1}$ be $k\ (k\geq 2)$ distinct vectors on the standard simplex, where
$$\Delta^{d-1} = \{\vec{\mu}\in R^{d}:\| \vec{\mu}\|_1 = 1,\mu_j \...
- 1,127
3
votes
1
answer
827
views
Solving recursion / finding generating function of a probability mass function
I am assessing the probability distribution on a running time of some algorithm that we've developed. I am looking for a family of probability mass functions $f_n$ with the following recurrence:
$$
f_{...
CommunityBot
- 1
3
votes
1
answer
271
views
Learn a distribution from distributions on samples
There's many good ways to learn a distribution $p_X$ of an r.v. $X$ over $k$ symbols given many i.i.d. samples $X_1,\ldots, X_n$. The simplest is to use the sample relative frequencies $\hat{f}_X$ as ...
- 219
2
votes
2
answers
182
views
Difference between maxima of random variables
Given four independent, identically distributed Gaussian random variables with zero mean and unit variance $x_1$, $x_2$, $y_1$, $y_2$, consider
\begin{equation}
u \equiv \max(x_1+C\, y_1, x_2+C \, ...
CommunityBot
- 1
9
votes
1
answer
556
views
Berry-Esseen bound for martingale sequence with varying and dependent variances
Let $(X_{1},\ldots,X_{k},\ldots)$ be a martingale difference sequence, i.e.
$$
E[X_{k}|\mathcal{F}_{k-1}] = 0
$$
where $\mathcal{F}_{k-1}$ is the $\sigma$-algebra filtration at $k-1$.
Let $\sigma_{...
- 6,711
1
vote
0
answers
102
views
Stochastic Ordering of Negative Binomial-like Distributions
Please forgive me if this is not precise enough to post here. Simply ask me to remove it if it is not suitable. I am new here.
I am bounding the running time of an algorithm as a random variable $X$ ...
- 11
6
votes
0
answers
277
views
universality for large deviations?
This is a question about universality in probability theory, with combinatorics in mind.
Consider a sequence of polynomials $P_n$ in one variable, with positive coefficients. Combinatorics is a large ...
- 3,587
1
vote
1
answer
378
views
Discrete random walk with uniformly distributed transition p, set initially
I've been working on a discrete version of the "unreliable friend" distribution. It would seem that what I've come up with is equivalent to the following random walk:
Choose $p$ from $U(0,1)$
Start ...
CommunityBot
- 1
2
votes
1
answer
576
views
Inequality for square of the subgaussian distributions
Hi all,
For my research I am trying to bound some exponential moments of subgaussian r.v.'s. And I am stuck with proving one of such inequalities. More specifically:
Let $a$ be unit vector in $\...
CommunityBot
- 1
3
votes
0
answers
276
views
Processes with the same finite dimensional distributions as the solutions to SDEs
Consider a sequence of stochastic processes $\{\tilde{x}^n\}$, $\tilde{x}^n = \tilde{x}^n_t(\omega)$, and Brownian motions $\{\tilde{w}^n\}$. Suppose that for each $\tilde{x}^n$ solves the stochastic ...
- 131
4
votes
0
answers
182
views
Approximate determinantal point process
Consider a random process defined on $2^{\mathcal{X}}$, i.e. all subsets of a set $\mathcal{X}$.
It's well known that this process is determinantal if one can find a positive semidefinite matrix $K$, ...
CommunityBot
- 1
8
votes
2
answers
2k
views
Moment matching: construction of a mixture of Gaussian distribution with lower moments identical to Gaussian
This is a question related to the statistical model behind independent component analysis (ICA).
We assume that $Z \sim N(0,1)$. Our goal is to construct a random variable $X$ that follows a ...
CommunityBot
- 1
7
votes
2
answers
605
views
Gaussian and the convex hull of moment curves
Let $c_1,\dots, c_d$ be the first $d$ moments of the standard normal distribution. Does the point $(c_1,\dots, c_d)$ lie in the convex hull of the set $\{(t,t^2,\dots,t^d)\colon t\in[-b,b]\}$, for a ...
CommunityBot
- 1
1
vote
1
answer
446
views
Question about characteristic function with independence assumption
Let $X$ be a random vector taking values in $\mathbb R^2$ with probability density $p(x) = p_1(x_1)p_2(x_2)$, i.e. the components of $X$ are independent.
Let $V$ be an open set in $\mathbb S^1$, the $...
CommunityBot
- 1
1
vote
1
answer
148
views
Distribution of maximum unique number of several random numbers
Suppose discrete random variables $\{X_1, X_2, ..., X_n\}$ are i.i.d. described by the probability function:
$f(x) \equiv \text{Pr}(X_i = x)$,
and $X_i \in \{1,2,3, ..., m\}$.
Let $Y$ be the ...
- 54.2k
11
votes
1
answer
283
views
Probability distribution derived from gamma function - does it have a name?
Consider the complex gamma function, denoted by $\Gamma(\sigma+it)$.
Now, let's fix $\sigma$ and let t vary. Then consider the following expression:
$$|\Gamma(\sigma+it)|^2$$
For any choice of $\...
CommunityBot
- 1
1
vote
1
answer
166
views
Question abouth Skorokhod representation of random variables (II)
This is a continuation of
Question abouth Skorokhod representation of random variables
Let $\mu$ and $\nu$ be two probability measures on $\mathbb R$ such that
$$\int_{\mathbb R}|x|^pd\mu(x),~ \...
CommunityBot
- 1
4
votes
1
answer
220
views
Question about the weak convergence of probability
Let $\mu$ be a probability measure on $\mathbb R$ and set
$$c(K):=\int_{\mathbb R}(x-K)^+d\mu(x).$$
Assume that one has a sequence of probability measures $(\mu_n)_{n\ge 1}$ s.t.
$$\int_{\mathbb R}\...
CommunityBot
- 1
5
votes
1
answer
356
views
Question abouth Prokhorov metric
Let $X$ and $Y$ be two random variables with first order moments, i.e. $E[|X|]$, $E[|Y|]<+\infty$. Assume further that
$$E\left[|X-Y|\right]<\varepsilon.$$
Set $Law(X)=\mu$ and $Law(Y)=\nu$, ...
- 109k
2
votes
2
answers
1k
views
divisibility of uniform distribution [closed]
Let $X$ and $Y$ be independent and identically distributed random variables.
Can $X+Y$ be a uniform distribution?
(Please prove.)
In other words, is a uniform distribution divisible?
The meaning of "...
- 28k
3
votes
1
answer
304
views
Question abouth Skorokhod representation of random variables
It is known that for any two probability measures $\mu$ and $\nu$ on $\mathbb R$ that are close in the Prokhorov metric $\rho$, i.e.
$$\rho(\mu,\nu)<\varepsilon,$$
then there exist two random ...
- 128k
4
votes
1
answer
229
views
How are the real-space RG transformations defined?
I'm reading Shang-keng Ma's book Modern theory of critical phenomena, and I'm a bit confused as to how the real-space RG transformations are defined. Ma basically says that these transformations are ...
CommunityBot
- 1
3
votes
2
answers
589
views
Measure concentration for law of large numbers
The classical law of large numbers states that
$$\frac1k\sum_{i=1}^k X_i \rightarrow \mathbb{E} X_1$$
for i.i.d. $X_1, X_2, \ldots$ with finite $L^1$ norm.
I was wondering whether is it possible to ...
2
votes
0
answers
619
views
Laplace transform of a integral function of CIR/CEV process
The Cox–Ingersoll–Ross model (or CIR model) describes the evolution of interest rates. Constant elasticity of variance model (CEV) is a stochastic volatility model, which attempts to capture ...
- 323
1
vote
1
answer
290
views
Topologies for which the ensemble of probability measures is complete
I have been struggling quite a bit with reconciling my intuitive understanding of probability distributions with the weird properties that almost all topologies on probability distributions possess.
...
CommunityBot
- 1
5
votes
1
answer
297
views
Random walk with continuously distributed steps on [-1,1]
A simple random walk $S_n = X_1 +\cdots +X_n$, where $P(X_i = 1) = p \not = 0.5$ and $P(X_i=-1)= q \triangleq 1-p$, admits the following probability
$$P(S_n \textrm{ reaches } a \textrm{ before} -b) =...
- 108
2
votes
1
answer
444
views
Literature question on the convergence rate of the empirical distribution
Assume that given $n$ i.i.d samples $(X_1, X_2, ..., X_n)$ drawn from $p_X$, an unknown probability mass function defined over a finite alphabet $\mathcal{X}$, one wants to estimate $p_X(x)$ for each $...
- 6,541
1
vote
0
answers
82
views
Marginal of mean from product of student-t and gamma
Let's say we have a distribution with PDF described by the product of Gamma and Student-t distributions. This is equivalent to a generative model, in which precision is first drawn from Gamma, and the ...
- 139
7
votes
2
answers
409
views
Estimating entropy conditional to an event
Take for example the measure $\mu(n)=n^2$ on $\{1, \ldots, N\}$ and a random variable $X$ distributed according to the probability obtained by normalizing $\mu$.
Does there exists a constant $K>0$...
- 2,560
2
votes
1
answer
886
views
Asymptotic behavior of a ratio of sums of iid random variables
Let $X_i$ and $Y_i$ be distributed identically to $X$ and $Y$, respectively. Assume both $X$ and $Y$ take strictly positive values.
Consider the random variable $R_n \doteq \frac{\sum_{i=1}^n X_i}{\...
- 1,687
-1
votes
1
answer
213
views
Regarding a new divergence function of two probability distributions
Let $X$ and $Y$ be two continuous random variables with common support and with PDF $f(x)$ and $g(y)$. For any $0 \leq \alpha \leq 1$, and any constant $\beta$ within the support of $X$ and $Y$ such ...
- 128k
2
votes
0
answers
208
views
On the Bhattacharyya distance
Let $X$ and $Y$ be two continuous random variables with support $\mathbb{R}^{+}$ and with PDF $f(x)$ and $g(y)$. If the Bhattacharyya distance of $f$ and $g$ is less than $\epsilon$, then is there any ...
CommunityBot
- 1
1
vote
0
answers
80
views
A variance-preserving Boolean function [closed]
Let a random variable $X$ be given with $P_X$ supported over $\mathcal{X}$. What are the necessary conditions for the existence of a boolean function $f:\mathcal{X}\to \{0,1\}$ such that $\mathsf{var}(...
- 1,109
2
votes
1
answer
99
views
Conditioned binomial dominates unconditioned with different parameter
Let $X \sim \text{Bin}(n,p)$ and $Y \sim \text{Bin}(n-1,p)$ with $n >1, p \geq 1/2$ and $X,Y$ are independent. I'd like to show
$$(X\mid X \geq 1) \succeq_{sd} 1 + Y.$$
Here $(X \mid \cdot)$ is the ...
- 1,897
2
votes
1
answer
461
views
Is it safe to work on a Cadlag modification of a Feller process?
Let $f$ be a continuous bounded function.
$X$ is a Feller process, and $\hat X$ is its Cadlag modification. By the definition of the modification, one can write
$$\mathbb E[f(X_t)] = \mathbb E[f(\hat ...
- 29.8k
3
votes
1
answer
380
views
Uniform convergence of 2-norm of a multinomial vector
Let $(X_1,X_2,\ldots,X_k)$ be distributed according to a multinomial distribution with parameters $(n;p_1,p_2,\ldots, p_k),$ i.e.
$$P(X_1=n_1,\ldots,X_k=n_k) = {n\choose n_1,n_2,\ldots,n_k} p_1^{n_1}...
- 128k
1
vote
1
answer
606
views
moment sequence which does not define a random variable vs convergence in distribution
I am encountering the following problem concerning existence of a limiting random variable (in distribution): assume a sequence of positive random variables $\{X_n\}_{n\geq 0}$ from which we know ...
- 34.7k
1
vote
1
answer
139
views
Exponentially Bounded Sequence of Moments defining Distribution?
I have an exponentially bounded sequence $m_n = \lambda^n + c_n$ (i.e. the $c_n$ are quadratic in $n$) and would like to know if this sequence of moments defines a distribution. I considered applying ...
- 118k