In probability and statistics, a probability distribution assigns a probability to each measurable subset of the possible outcomes of a random experiment, survey, or procedure of statistical inference.

learn more… | top users | synonyms

1
vote
1answer
231 views

Supremum of a martingale

Let $(X_n)$ be a martingale. What can be said about the distribution of its maximum over a window of fixed length: $$M_n = \max_{n-10 \leq k \leq n} X_k$$ or about the "range" over a window: $$R_n = ...
4
votes
1answer
198 views

Functional limit theorem under random change of time

This post seems long, but its almost everything proofed except the last step. The unknown part is marked especially. Given a Levy-Process $U_{t}$ with with $E(U_t)=0$ (then $U_t$ is a martingale). ...
0
votes
0answers
29 views

Expression for Joint-PDF of Langevin equation?

How to derive exact or approximate analytical expression for time-dependent joint-PDF (velocity-coordinate PDF) for Langevin equations of Brownian motion? Langevin equations is: $\dot{x}=v$ ...
1
vote
1answer
36 views

Maximizing joint entropy?

I'm stuck trying to find the maximum entropy probability distribution taking into account a joint distribution. Basically, I want to find the maximum entropy expression for $p(x,y)$ when the marginal ...
2
votes
1answer
542 views

Calculate channel capacity of general channel under constraint

Given a conditional distribution $P_{Y|X}$ I'd like to find the prior distribution $P_X$ that maximizes the mutual information $I(X;Y)$ with $P_Y(y)=\int P_{Y|X}(y|x)P_X(x)\text{dx}$ (this corresponds ...
1
vote
1answer
44 views

Conditioned sum of n Poissons versus unconditioned Poissons

Let $\theta >1$ and take independent random variables $Z_k \sim \text{Poisson}(\theta/k)$ for $1 \leq k \leq n$ and let $Z_k^*$ have marginals like the $Z_k$ conditioned on $\sum_1^n k Z_k = n$: ...
-2
votes
0answers
24 views

Cumulative distribution function and sum of random variables [on hold]

For two continuous (iid) random variables $X$ and $Y$, we have (ref): $$ \mathbb{P}(X+Y \le a) =\int_{-\infty}^\infty \int_{-\infty}^{c-x} \big ( f(x,y) dy \big ) dx$$ with $f$ being the joint density ...
2
votes
1answer
131 views

Ask for a special function related to the error function

I am wondering whether anyone knows the following integration has a named special function or a reference $$ F_{a,b}(z) :=\frac{2}{\sqrt{\pi}} \int_0^z \text{erf}(a+b y)\: e^{-y^2} \text{d}y $$ for ...
1
vote
1answer
85 views

Convexity of truncated expectation

Let $k, n$ be two positive integers with $k \leq n$, and let $P = \{ (x_1, \dots, x_n) \in [0, 1]^n : \sum_i x_i = k \}$. Given $x = (x_1, x_2, \dots, x_n) \in P$, let $X_i$ be the random variable ...
1
vote
1answer
46 views

A generalization of negative binomial distribution

Assume we have a set of n balls. For each step, we uniformly pick one ball and label it if it is not labeled. Or otherwise move on to next step. I am wondering what is the distribution of number of ...
1
vote
0answers
21 views

Expectation of two identical log-normal distributions [migrated]

I would like to compute the conditional expectation (on an interval from $c$ to $\infty$) of the minimum of two log normal distributions. Denote $X_1$, $X_2 \sim LN(0, \sigma)$, the associated ...
5
votes
3answers
13k views

Distance metric between two sample distributions (histograms)

Context: I want to compare the sample probability distributions (PDFs) of two datasets (generated from a dynamical system). These datasets depend on a set of parameters, and I want a concise way to ...
2
votes
1answer
69 views

Bound on the total variation distance for multiple samples $d_{tv}(P^n,Q^n)$

Given two discrete distributions $P$ and $Q$, with computable total variation distance $d_{TV}(P,Q)=||P - Q||_1$, is there a precise bound for $d_{TV}(P^n,Q^n)=||P^n - Q^n||_1$, as need to estimate ...
3
votes
1answer
363 views

Bounds on $\int \log(1+x) g(x) \mathrm{d}x$?

Let $X$ and $Y$ be two continuous real random variables with common support $(0,x_{\max}]$ and with PDF $f_X(x)$ and $f_Y(y)$. Assume that $\Pr [Y\geq\beta \mid X<\beta] \leq k$ and that $\Pr ...
1
vote
1answer
182 views

connection between the statistical properties of a scalar field and its columns

Consider a scalar field $s:[0,1]^3 \to \mathbb{R}$ and its "column" field \begin{equation} c: [0,1]^2 \to \mathbb{R}: (x,y) \mapsto \int_0^1 s(x,y,z) \,\mathrm{d}z. \end{equation}. What can be said ...
0
votes
0answers
20 views

Product of lognormal random variables

Let $X_1$ and $X_2$ be two normal random variables. Write $X_1\sim N(\mu_1, \sigma^2_1)$ and $X_2\sim N(\mu_2, \sigma^2_2)$, to fix ideas. Consider the corresponding log-normal random variables: ...
1
vote
0answers
38 views

Characterize Linear Transformation of Dirichlet Distribution

Let $X=(X_1,....,X_K)\sim{}\text{Dir}(\alpha_1,...,\alpha_K)$ be a Dirichlet distribution with parameters $\alpha_1,...,\alpha_K$. Let $A$ be a non-singular linear map and ...
0
votes
0answers
36 views

Proving Fixed Point Algorithms

In Thomas Minka's paper on Estimating the Dirichlet Distribution (link here http://research.microsoft.com/en-us/um/people/minka/papers/dirichlet/minka-dirichlet.pdf), the author presents a fixed ...
0
votes
0answers
15 views

Distribution of deviations from order statistics [migrated]

Consider a continuous r.v. $x$ with CDF $F(\cdot)$. Let $\{x_i,\,i=1,\ldots,n\}$ be a sample of $n$ IID draws, and let $\{x_{(i)},\,i=1,\ldots,n\}$ denote the order statistics; i.e., $x_{(1)}$ is the ...
2
votes
0answers
35 views

Existence of probability distribution satisfying upper/lower bounds on events

Suppose we have a finite sample space $S$ and some events $A_1, \dots, A_k \subseteq S$. We would like to put a probability distribution on $S$ so that no element has probability greater than a ...
25
votes
1answer
2k views

When should we expect Tracy-Widom?

The Tracy-Widom law describes, among other things, the fluctuations of maximal eigenvalues of many random large matrix models. Because of its universal character, it obtained his position on the ...
1
vote
0answers
60 views

The role of absolute continuity in stochastic ordering defined over sets of probability distributions

This question is about a claim given in this paper (page 261, the remark), but without any proof. It simply says that if two sets of probability distributions, $\mathscr{P}_0$ and $\mathscr{P}_1$ ...
1
vote
0answers
29 views

On the numerical range of non-self adjoint Gaussian matrix

For a complex $n \times n$ matrix $A$, its numerical range is the set $$W(A) = \left\{\mathbf{x}^*A\mathbf{x} \mid \mathbf{x}\in\mathbb{C}^n,\ \|x\|_2=1\right\} .$$ We can further define the ...
7
votes
2answers
303 views

Maximal entropy distribution with given conditionals

It is well known that of all the joint distributions $p(x,y)$ with fixed marginals $p(x),p(y)$, the one with the highest entropy is: $$ p(x,y)=p(x)p(y). $$ Suppose instead that we have conditionals. ...
2
votes
0answers
161 views

Expected value and variance of a stochastic process

I would like to ask if there is a way to find the expected value and the variance of the following process $$ dv_t=(a-be^{\alpha v_t})dt+\sigma dW_t, \quad v_t=v_0 $$ where $a\in (-\infty,+\infty), ...
4
votes
1answer
70 views

On the eigenvalues' distribution of random unitary

Fix an integer $d$, let $\mathbb{U}_d$ be the $d\times d$ unitary group. For any $U\in \mathbb{U}_d$, define $\Omega(U)$ be the length of the smallest arc containing all the eigenvalues of $U$ on the ...
5
votes
1answer
134 views

Upper Bound for the Difference of Even Probability and Odd Probability in Hypergeometric Distribution

Let $X$ be a random variable following the hypergeometric distribution with parameters $N,K,n$, where \begin{equation} Pr(X=k) = \frac{\binom{K}{k}\binom{N-K}{n-k}}{\binom{N}{n}}. \end{equation} To ...
1
vote
0answers
59 views

Multimodal property of polynomial logistic distribution

Let $P(x)$ be a polynomial (of an odd degree $n$) strictly increasing on $(-\infty, +\infty).$ Then $F(x)=\displaystyle \frac{1}{1+\exp\{-P(x)\}}$ is a distribution function of a polynomial logistic ...
2
votes
1answer
66 views

Median of a uniform multinomial variable

Let $k\in\mathbb N^+$ be a positive integer. Consider a set of i.i.d. random variables $X_1,X_2,\ldots, X_n$, each of which is distributed uniformly over $\{1,2,\ldots,2k+1\}$. For $i\in ...
1
vote
0answers
28 views

Expected number of perfect matchings in bounded degree bipartite graphs

Consider collection $\mathcal C_{n,n,\Delta}$ of every $2n$ vertex balanced bipartite graph of average degree $\Delta$. What is the expected number of perfect matching a graph in $\mathcal ...
3
votes
1answer
95 views

Reference request for a result regarding density of induced probability measure under a submersion

Let $\pi: M \to N$ be a smooth submersion from a bounded open subset of $\mathbb{R}^m$ onto $ N \subset \mathbb{R}^n$, $m \geq n$. Further, let $M$ be given a probability measure $\mu$. Then the map ...
5
votes
1answer
213 views

Estimate of incomplete binomial integral

Let $0\le k \le n$. Prove that $$ n\binom{n}{k}\int_{0}^{\frac{k}{n+1}}t^k(1-t)^{n-k}\,dt \le 1/2. $$ As far as I know 1) it is proved for $\frac{k}{n+1}\le 1/2$ and 2) not proved for $1/2 ...
3
votes
0answers
32 views

Joint distribution on order statistics and sample history

If samples $X_1, X_2, ... X_t$ are picked independently and identically from the discrete uniform distribution $[1,2, ..., P]$, what is the joint distribution of the last $k$ order statistics and last ...
5
votes
2answers
143 views

Expected number of changes in the sign of a rolling sum of independent normal variables

Imagine we define $Y(t+n)= X(t+1)+.....+X(t+n)$ where $X(i)$ is an independent normal (i.e. everyday we remove the starting observation and we add a new one). We have $n$ consecutive observations of ...
1
vote
0answers
49 views

BM hitting times with exponential killing process

Assume a BM in 3d domain (infinite) with a small absorbing subdomain (cube, sphere, ect), centered at point $p_s=(x_s,y_s,z_s)$ . BM starts at point $p_0=(x_0,y_0,z_0)$ and when it riches the ...
2
votes
1answer
95 views

Variance of the normal CDF [closed]

Several threads (e.g. Integration of the product of pdf & cdf of normal distribution ) have shown that $E[\Phi(x)]=\Phi(\mu/\sqrt{\sigma^2+1})$ when $x\sim N(\mu,\sigma^2)$. I'd like to compute ...
1
vote
1answer
56 views

Fundamental difference between Poisson Point Process and Binomial Point Process

What is the fundamental difference between Poisson Point Process and Binomial Point Process? I am evaluating a solution in a Binomial Point Process setup. If I want to evaluate that in a Poisson ...
7
votes
1answer
104 views

Choosing a sample based on where the density function is highest

Is there a name for the following process? Say I have an absolutely continuous probability density function $f$ with compact support, and I take $k$ independent samples $x_1,\dots,x_k$ from $f$. ...
2
votes
0answers
87 views

Growth of inner products between two random vectors on the sparse hypercube

We define the $s$-sparse hypercube in $\mathbb{R}^d$ as \begin{align} \mathbb{H}_s = \bigl \{ {\bf{v}} \in \{ -1, 0 , 1\}^d \colon \| {\bf{v}} \|_0 = s \bigr\}, \end{align} where $ \| {\bf v} \|_0 $ ...
2
votes
0answers
41 views

A question about probabilistic graphical models

Say one is given a probabilistic graphical model and a cut of the underlying graph. Do we know any statements about when and how can one or many of the marginals (of the sources) or the conditionals ...
0
votes
1answer
122 views

Counterexample: weak convergence doesn't imply $L^1-$convergence [closed]

I'm not sure my question is of research level, but I cannot find the answer in the existing reference. Let $\mu_n$ be a sequence of probability measures on $\mathbb R$ satisfying $$\int_{\mathbb ...
2
votes
1answer
119 views

About Renyi entropy

If one is given a joint probability distribution over a finite set of discrete random variables then I guess there a notion of $\alpha-$Renyi entropy defined for it as $S_\alpha (X_1,..,X_n) = ...
1
vote
1answer
149 views

Averaged geometric series with floor function

Given a value $p\in[0,1]$ (a probability of occurrence), I would like to bound the following expression: $$ s\frac{1-(1-p)^{k+1}}{p(k+1)} + (1-s)\frac{1-(1-p)^{k}}{pk},\ \ \ \text{where $k=\lfloor ...
1
vote
1answer
120 views

Neat definition of Harris Ergodicity

I can't find any reference where the definition of Harris Ergodicity for Continuous time Markov processes is defined. a) What would be exactly the definition? b) What reference could be helpful? ...
0
votes
0answers
175 views

A contractive mapping which I don't understand

Given a matrix $Y$ and a vector $c$ define the following iteration $\hat{c} = f(c)$, where each element of $\hat{c}$ is given by $$\hat{c}_{\ell} = \frac{\sum_k ...
-1
votes
1answer
115 views

Is Gaussian the unique 2-stable distribution? [closed]

It is well known that Gaussian distribution is a 2-stable distribution. (For more information about p-stable distribution, please refer to Stable Distribution.) But is Gaussian the unique 2-stable ...
1
vote
0answers
52 views

variance of log of ratio of chi-square variables

Let X be a chi-square variable with two degrees of freedom. Let A and B be to arbitrary constants, with $A>B>0$. I need the variance of $Y=\log(1+AX)-\log(1+BX).$ The mean is, maybe not ...
3
votes
0answers
62 views

Algorithm to calculate moments of uniform distribution on convex polyhedra

There is system of linear inequalities $$ Ax \leq K, $$ $$ x\geq a, x\leq b. $$ $A$ is $(n\times m)$-matrix, where $n\approx 100$ and $m\approx 10000$, $rank(A)=n$. Suppose that on set of solutions ...
0
votes
0answers
31 views

Distribution of stopped Brownian motion in $\mathbb R^2$

Let $B=(B^1_t,B^2_t)_{t\ge 0}$ be a standard Brownian motion in $\mathbb R^2$. Let $U=(U^1,U^2)$ be an independent random variable taking values in a circle $C_1\subset\mathbb R^2$ with uniform ...
0
votes
0answers
28 views

derivation of a gap related to extreme value theory

I have an expression to evaluate as follow: $\mathbb{E}\left[\sum_{k=1}^K s_k f(x_k)\Big|s_k=s_k^{\ast} \right]$ where $\{s_k^\ast\}$ can be treated as a ${policy}$ which is defined as follows: ...