All Questions
9 questions with no upvoted or accepted answers
4
votes
0
answers
988
views
Probability distribution function for singular value sum of Gaussian random matrix
Let $\mathbf{X}$ be an $N \times N$ random matrix with IID Gaussian entries. They can be standard normal, but $N$ is not large: that is $N$ $<$ 6, typically. Call its singular value decomposition (...
3
votes
0
answers
58
views
Projection onto column space perturbed by Gaussian noise
Suppose we have a matrix $X\in\mathbb{R}^{m\times n}$ (with $n \le m$) with iid standard Gaussian entries, and suppose we have noise matrix $W\in\mathbb{R}^{m\times n}$ with iid Gaussian entries, but ...
- 141
2
votes
0
answers
265
views
Expectation of a multivariate Gaussian over a plane
For a vector $X$ which follows a multinomial Gaussian distribution $N(\vec{0},\Sigma)$, a given vector $b$, and a known scalar value $c$, I would like to calculate the expectation :
$E[X|X^Tb = c]$
...
- 21
1
vote
0
answers
130
views
Probabilistic lower bound on largest singular value of matrices
I have a distribution $\mathcal{D}$ that spits out vectors in $\{-1, 1\}^N$. Suppose I have a sample of $H$ of these vectors which I arrange into a matrix $M$ of the form $H \times N$.
Consider the ...
- 1,129
1
vote
0
answers
282
views
Strict monotonicity of conditional variances
Let $K \geq 2$ be a positive integer and $C$ be any $K \times K$ non-singular matrix (if necessary, can assume that all $K$ rows of $C$ are needed to span the coordinate row vector $e_1'$). For ...
- 765
1
vote
0
answers
104
views
Lower bound on difference between polynomials at moderate distance
Fix $r > 0$ and $k, n \in \mathbb{N}$. Also consider a function $f: \mathbb{R}^{d} \rightarrow \mathbb{R}$. Let $x_{1},\ldots, x_{n+1}$ be points chosen uniformly from $[-r,r]^{d}$. For $1 \leq i \...
1
vote
0
answers
466
views
Bounding point-wise maximum of the absolute difference of two convex functions
Let $\Delta: R \times R \rightarrow R_{+}$ be a positive and convex function (convex in, say, both the arguments) called the loss function.
Let $x \in R^d$. Moreover, let $H_1,...,H_r$ be sets of ...
- 11
0
votes
0
answers
330
views
Lower-bound smallest eigenvalue of covariance matrix of $y = f(Ax)$, for $x$ uniform on unit-sphere
Let $A=(a_1,\ldots,a_)$ be a fixed $k \times d$ matrix (with $d$ large), and $x$ be a random vector uniformly distributed on the unit-sphere in $\mathbb R^d$. Let $f:\mathbb R \to \mathbb R$ be a ...
- 6,853
0
votes
0
answers
322
views
Comparison of Parameter estimation using maximum likelihood and Maximum entropy
I am not sure if the question is appropriate but I want to try my luck. One can estimate a parameter using maximum likelihood and we know it is optimal. On the other hand there are methods which uses ...
- 495