All Questions
26 questions
1
vote
0
answers
91
views
How to optimize parametric information-theoretic bounds?
I am faced with an information-theoretic upper bound, such as
\begin{align}
\sqrt{\alpha'}2^{I_\alpha(X;Y)},
\end{align}
where $I_\alpha(X;Y)$ is the Rényi mutual information with parameter $\alpha>...
- 287
1
vote
1
answer
99
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 33
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
- 287
14
votes
1
answer
417
views
Lipschitz property of the determinant
$\newcommand{\A}{\mathcal A}\newcommand{\Tr}{\operatorname{tr}}$For $c$ and $C$ such that $0<c<C<\infty$, let $\A_{d;c,C}$ denote the set of all symmetric positive-definite real $d\times d$ ...
- 128k
4
votes
1
answer
250
views
Does a subset with small cardinality represent the whole set?
Assume that we have heavy-tailed distribution $F(x)$ such that
\begin{align}
F(x)=\mathbb{P}[X\geq x]=x^{-0.5}.
\end{align}
Then, we produce $N$ independent samples $X_1,X_2,\ldots,X_N$ from this ...
- 287
2
votes
1
answer
1k
views
Components of a Gram matrix and its eigenvalues
The Gram Matrix is defined as $$\sum_{i=1}^n X_iX_i^T,$$ where $X_i$ is drawn from the unit sphere based according to some continuous distribution (Relation between eigenvalues and the gram matrix for ...
- 215
2
votes
1
answer
239
views
Hoeffding's Lemma for bounded complex random variables?
If we have a real random variable $X$ such that $a\leq X\leq b$ almost surely, we can establish the following inequality:
\begin{align}
\mathbb{E}\left[\exp\Big(t(X-\mathbb{E}[X])\Big)\right]\leq\exp\...
- 287
1
vote
1
answer
115
views
The effect of a small change of the probability distribution on the output of the function
Suppose $X$, $Y$, $X'$ and $Y'$ are random variables whose probability density follows the following relations.
\begin{align}
\|p_X-p_{X'}\|_{\mathrm{TV}}&\leq\epsilon_1,\\
\|p_Y-p_{Y'}\|_{\mathrm{...
- 287
0
votes
1
answer
103
views
Is it reasonable to consider the subgaussian property of the logarithm of the Gaussian pdf?
Let $Y$ denote a Gaussian random variable characterized by a mean $\mu$ and a variance $\sigma^2$. Consider $N$ independent and identically distributed (i.i.d.) copies of $Y$, denoted as $Y_1, Y_2, \...
- 287
-1
votes
1
answer
77
views
Variance of the logarithm of the mixed Rademacher and complex Gaussian distribution
Consider the scenario where $X$ is a Rademacher random variable taking values $\{−1,+1\}$ with equal probability, and $Z$ is a complex Gaussian random variable with a mean of $0$ and a variance of $\...
- 287
1
vote
1
answer
82
views
Does the following expectation-based inequality hold?
Let $\mathcal{F}$ be the space of all functions that uniformly and independently map the alphabet $\mathcal{X}$ to the set $\{1,2,\ldots,A\}$. Let $p(x|y)$ be an arbitrary conditional probability ...
- 287
5
votes
1
answer
3k
views
Eigenvalues and eigenvectors of Gaussian random matrices
Let us assume we have a square matrix $A$ whose entries are sampled from a standard Gaussian distribution of mean $0$. Do we have any information about the distribution of its eigenvalues?
...
- 899
1
vote
1
answer
158
views
Generating iid random vectors such that the distribution of their dot product is $\mathit{Uniform}[a, b]$
Take two independent and identically distributed random vectors $X_i$, $X_j$.
I want to find a multivariate distribution for these vectors such that the dot product $X_i^\top X_j \sim U[a, b]$.
This ...
- 119
1
vote
0
answers
176
views
Maximum mutual information of random unitary transformation
Let $\mathbf{U}$ and $\mathbf{V}$ be random unitary matrices independent of random input vector $\mathbf{x}$. Moreover, $\mathbf{z}$ be random iid complex Gaussian vector with zero mean and identity ...
- 287
2
votes
1
answer
905
views
Diagonalizability of Gaussian random matrices
Let $X$ be an $n\times n$ matrix whose elements are i.i.d. sampled from a normal distribution of zero mean and unit variance. Is $X$ diagonalizable over $\mathbb{C}$ with probability 1? Is there a ...
- 123
1
vote
1
answer
131
views
Large scale analysis of matrix multiplications
Let $\mathbf{A}_{m\times n}$ and $\mathbf{B}_{m\times n}$ be two random i.i.d matrices with zero mean and unit variance. Then, are the following large-scale analysis true (m,n go to infinity with ...
- 287
0
votes
0
answers
92
views
Linear independence of Wishart matrices
Let $W\sim W_n(I,d)$ be a real Wishart matrix of an identity covariance matrix and $d$ degrees of freedom, i.e., $W=XX^T$ for $X$ being an $n\times d$ matrix whose entries are i.i.d sampled from a ...
- 123
0
votes
0
answers
132
views
Upper bound on the condition number of the product of a random sparse matrix and a semi-orthogonal matrix
Let $G \in \mathbb{R}^{n \times m}$ (m > n, m = O(n)) whose all entries are i.i.d. distributed as $\mathcal{N}(0, 1) * \text{Ber}(p)$. Let $V \in \mathbb{R}^{m \times n}$ be a fixed semi-orthogonal ...
- 109
1
vote
1
answer
186
views
Expected norm of linear maps
I want to compute the expected norm of a vector-matrix multiplication. I have a vector $x \in \mathbb{R}^n$ with norm one and a matrix $M \in \mathbb{R}^{n \times n}$, whose entries are iid taken from ...
- 899
1
vote
1
answer
480
views
Ratio of perfectly correlated gaussian distributions
Let $M$ be a positive definite matrix and let $w \in S^{d-1}$ be a unit vector uniformly distributed over the sphere. I want to understand the distribution of the quadratic form $\frac{w^T M^3 w}{w^T ...
- 71
3
votes
0
answers
116
views
Trace of Symmetric matrices in fixed rank
I am solving some problem related to symmetric matrices over a finite field $\mathbb{F}_q$ and I am stuck at the following problem:
For every $a\in\mathbb{F}_q $, let $S_a(t,m)$ be the set of all $m\...
- 179
0
votes
0
answers
93
views
Changing Couplings of Discrete Random Variables
Let $X,Y$ be two discrete random variables. Two joint mass distributions (couplings) with marginals $X$ and $Y$ and with entries $p_{i,j}=\mathbb{P}_1(X=i,Y=j)$ and $p_{i,j}'=\mathbb{P}_2({X=i,Y=j})$ ...
- 329
3
votes
1
answer
187
views
Moment matching on the standard simplex
Let $\vec{\mu}_1, \vec{\mu}_2,\ldots, \vec{\mu}_k \in \Delta^{d-1}$ be $k\ (k\geq 2)$ distinct vectors on the standard simplex, where
$$\Delta^{d-1} = \{\vec{\mu}\in R^{d}:\| \vec{\mu}\|_1 = 1,\mu_j \...
- 1,127
3
votes
1
answer
326
views
Two matrix Fisher distributions on SO(3)?
After the uniform distribution (normalized Haar measure), the matrix Fisher distribution seems to be the most popular probability distribution on the Lie group SO(3). The density is proportional to ...
- 41
2
votes
0
answers
292
views
Seeking the normalizing constant (or any references) for a distribution over a subset of positive definite martrices
I'm interested in a probability distribution over the set of positive definite matrices with unit diagonal elements. That is, and $X$ such that:
$X \in S^{n+}, \forall_{i}X_{ii} = 1$ where $S^{n+}$ ...
- 379
0
votes
0
answers
31
views
What is the Fisher information matrix of the von Mises-Fisher distribution?
Assuming the von Mises-Fisher distribution as
$$f_{p}(\mathbf{x}; \boldsymbol{\mu}, \kappa) = C_{p}(\kappa) \exp \left( {\kappa \boldsymbol{\mu}^\mathsf{T} \mathbf{x} } \right),$$
where $\kappa \ge 0$,...
- 287