Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 68835

In probability and statistics, a probability distribution assigns a probability to each measurable subset of the possible outcomes of a random experiment, survey, or procedure of statistical inference.

1 vote
0 answers
566 views

Bounding the total variation distance of two specific random variables?

Let $X$ and $Y$ be two independent discrete random variables, and $Z$ be a function of $X$ and $Y$, i.e., $Z=f(X,Y)$. Suppose that $\Gamma$ is a set such that $$\mathrm{Pr}[(X,Y)\in\Gamma]\geq 1-\epsi …
Math_Y's user avatar
  • 287
2 votes
2 answers
824 views

Eigenvalue distribution of a random matrix

Is there any closed form distribution formula for the distribution of the eigenvalues of $\mathbf{X}^\mathrm{H}\mathbf{X}$ where the entries of $\mathbf{X}$ are independent Gaussian random variables w …
Math_Y's user avatar
  • 287
1 vote
0 answers
232 views

Maximum mutual information of a matrix representation

Let $\mathbf{Z}$ be a $m\times n$ matrix with zero-mean unit-variance i.i.d complex Gaussian entries. What is the maximum value of mutual information $I(\mathbf{X}_1,\mathbf{X}_2;\mathbf{Y})$ such tha …
Math_Y's user avatar
  • 287
2 votes
1 answer
228 views

Mutual Information after Applying Random Unitary Matrix

Let $\mathbf{U}$ be a random unitary matrix and $\mathbf{z}$ be a random i.i.d complex Gaussian vector (unitary invariant). Assume that the following relation is satisfied: \begin{align} \mathbf{y}=\m …
Math_Y's user avatar
  • 287
1 vote
1 answer
193 views

Random matrix properties

Let $\mathbf{H}_{N,K}$ be a random matrix whose entries are i.i.d complex Gaussian random variables with variance $1$. Then, we know from the law of large number that if $N,K\rightarrow\infty$, we hav …
Math_Y's user avatar
  • 287
0 votes
0 answers
269 views

Is there any relation between moments of random matrix and its eigenvalue distribution?

Let $\mathbf{X}$ be a random matrix with independent Gaussian random variable entries with different variances $v_{ij}$. Also define $\mathbf{A}=\mathbf{X}^\mathrm{H}\mathbf{X}$. Is there any relation …
Math_Y's user avatar
  • 287
0 votes
1 answer
1k views

Expectation of inverse of random matrices

Assume that $\mathbf{X}$ is a random positive-definite matrix. Then, is there any upper or lower bound on the expectation of the following expression $$\mathbb{E}[\mathbf{X}^{-1}]-\alpha\mathbb{E}[\ma …
Math_Y's user avatar
  • 287
2 votes
0 answers
239 views

An inequality of KL Divergence for two different distributions passing through a same channel

Let $X$ be a random variable which takes values in $\mathcal{X}$. Assume that we pass $X$ through two independent conditional pdf $p_{X_1|X}$ and $p_{X_2|X}$ and choose $X_1$ with probability $\lambda …
Math_Y's user avatar
  • 287
6 votes
2 answers
2k views

Is there a universal bound for this ratio of expectations?

Let $X$ and $Y$ be two zero-mean independent and identically distributed random variables. Is there a bound for the following ratio, $$\frac{\mathbb{E}[|X+Y|]}{\mathbb{E}[|X|+|Y|]}=\frac{\mathbb{E}[ …
Math_Y's user avatar
  • 287
0 votes
0 answers
141 views

Effect of partitioning the realizations of random variables on the total variation distance?

Let $X$ and $Y$ be two random variables with joint pmf $p(x,y)=p(x)\cdot p(y|x)$ and $X$ has uniform distribution. Also assume that the following relation is satisfied: \begin{align} \lVert p(y|x)-p(y …
Math_Y's user avatar
  • 287
1 vote
1 answer
75 views

Does bounding mutual information restrict the defined meter?

Suppose $I(X;Y)$ denotes mutual information and on the other hand there is a relationship as follows. \begin{align} |p(y)-p(y|x)|<\delta p(y),\qquad\forall x,y. \end{align} Then we can say about mutua …
Math_Y's user avatar
  • 287
1 vote
1 answer
115 views

The effect of a small change of the probability distribution on the output of the function

Suppose $X$, $Y$, $X'$ and $Y'$ are random variables whose probability density follows the following relations. \begin{align} \|p_X-p_{X'}\|_{\mathrm{TV}}&\leq\epsilon_1,\\ \|p_Y-p_{Y'}\|_{\mathrm{TV} …
Math_Y's user avatar
  • 287
4 votes
2 answers
294 views

Effect of small change in probability distribution on error probability

Let $X$ be a random variable and $Y=f(X)$ where $f$ is a deterministic function. Moreover, assume that there exists a deterministic function $g(.)$ such that the following probability is small. \begin …
Math_Y's user avatar
  • 287
2 votes
1 answer
225 views

Hoeffding's Lemma for bounded complex random variables?

If we have a real random variable $X$ such that $a\leq X\leq b$ almost surely, we can establish the following inequality: \begin{align} \mathbb{E}\left[\exp\Big(t(X-\mathbb{E}[X])\Big)\right]\leq\exp\ …
Math_Y's user avatar
  • 287
0 votes
2 answers
210 views

Limited sum for whole sum approximation

Let $d_n, n\in\{1,2,\cdots,N\}$ be $N$ realizations drawn independent and identically from uniform distribution on $(0,L)$ where $L=\gamma\sqrt{N}$ with constant $\gamma$. Suppose that we need to appr …
Math_Y's user avatar
  • 287

15 30 50 per page