**12**

votes

**0**answers

371 views

### What kind of random matrices have rapidly decaying singular values?

I've been told that in machine learning it's common to compute the singular value decomposition of matrices in order to throw out all information in the matrix except that corresponding to, say, the ...

**12**

votes

**0**answers

306 views

### How fast can extreme eigenvalues of the average of random matrices converge to their expectation?

Suppose that $X_1,X_2,\ldots,X_m$ are independent $d\times d$ random matrices and let $\overline{X} := \frac{1}{m}\sum_{i=1}^m X_i$. One of the questions studied under the theory of random matrices is ...

**10**

votes

**0**answers

831 views

### Table with the most seated customers in Chinese restaurant process

Suppose we have some initial configuration of people seated at some tables. We start taking new customers and seat them following Chinese restaurant process. Is there some known work on finding the ...

**10**

votes

**0**answers

347 views

### Question from an economist: solving a model of traders' behavior with expectations about the future values of the variable they are currently optimizing

Motivation
I am an economist writing a paper for an academic finance journal. My paper is about the behavior of currency traders, who choose the price at which they will sell currency today, based on ...

**9**

votes

**0**answers

235 views

### Testing contrasts in statistics: Is this provably a hard problem, or not?

Scheffé's method for identifying statistically significant contrasts is widely known. A contrast among the means $\mu_i$, $i=1,\ldots,r$ of $r$ populations is a linear combination $\sum_{i=1}^r c_i ...

**8**

votes

**0**answers

244 views

### First Table of Random Numbers

What was the first table of random numbers of any sort?
The best I can do is Tippett and Pearson's Random Sampling Numbers of 1927.
Can anybody identify an earlier table?
Thanks for any ...

**8**

votes

**0**answers

341 views

### Bounding the probability that a random variable is maximal

Suppose we have $N$ independent random variables $X_1$, $\ldots$, $X_N$ with finite means $\mu_1 \leq \ldots \leq \mu_N$ and variances $\sigma_1^2$, $\ldots$, $\sigma_N^2$. I am looking for ...

**6**

votes

**0**answers

116 views

### Convergence of Maximum Likelihood Estimator

I apologize for the basic question. If $\{p_\theta(x): \theta\in K\subseteq\mathbb{R}\}$ is a smooth family of distributions, then the MLE $\hat{\theta}_n,$ under suitable regularity conditions ...

**6**

votes

**0**answers

909 views

### Taylor approximation of a function of a random variable

Suppose we have a random variable $X$ and a smooth function $g$. We want to calculate the expectation value $\mathbb{E}(g(X))$. To be able to write down at least an approximate solution, we perform a ...

**6**

votes

**0**answers

2k views

### Using Fisher Information to bound KL divergence

Is it possible to use Fisher Information at p to get a useful upper bound on KL(q,p)?
KL(q,p) is known as Kullback-Liebler divergence and is defined for discrete distributions over k outcomes as ...

**5**

votes

**0**answers

81 views

### Maximal Correlation versus Correlation Coefficient When one RV is Gaussian

Let a pair of random variables $(X,Y)$ be continuous random variables (i.e., they both have density with respect to Lebesgue measure) with joint distribution $P_{XY}$. The maximal correlation ...

**5**

votes

**0**answers

160 views

### Is there a name for this quantity between two distributions?

Let $f$ be a probability density on a compact domain $D$, and say that $x_1,\dots,x_n$ are samples from $f$. If we wanted to compute the Wasserstein distance between $f$ and the empirical ...

**5**

votes

**0**answers

110 views

### What's the variance in the Six Degrees model?

Recall the six degrees of Kevin Bacon game. You can even play the game at The Oracle of Bacon, and their search works via Breadth First Search.
I interpret the punchline as saying that if I start ...

**5**

votes

**0**answers

105 views

### In what sense is the Bayesian posterior mean a “convex combination”?

I asked this on math.stackexchange with no response, I'm hoping someone here might have something.
Suppose I want to estimate $x \in \mathbb{R}^n$ from two signals with zero mean, normally ...

**5**

votes

**0**answers

193 views

### Inverse moment of the number of inversions of a permutation

Let $\pi$ be a permutation of $\{1,2,...,n\}$. A pair of elements ($\pi_i$,$\pi_j$) is called an inversion if $i$ $>$ $j$ and $\pi_i$ $<$ $\pi_j$. The total number of inversions in $\pi$ is ...

**5**

votes

**0**answers

125 views

### Pettis Integrability and Laws of Large Numbers

Let $(\Omega, \mathcal F, \mathbb P)$ be a probability space, and let $V$ be a topological vector space with a dual space that separates points. Let $v_n : \Omega \to V$ be a sequence of Pettis ...

**5**

votes

**0**answers

174 views

### Given that a conditional measure is Gaussian, how bad can the original measure be?

Let $X$ and $Y$ be Banach spaces, and let $\varphi : X \to Y$ be a continuous linear map. Suppose that $\mathbb P$ is a probability measure on $X$ which satisfies the continuous disintegration ...

**5**

votes

**0**answers

128 views

### Positive estimator

Suppose that one knows how to generate (independent) random samples $X_1, X_2, \ldots$ distributed as the random varable $X$ with $\mathbb{E}[X]=\mu \in \mathbb{R}$. It is then easy to construct an ...

**5**

votes

**0**answers

112 views

### Maximum of the norm of k-averages of n iid random d-dimensional vectors

Suppose $X_1, ... X_n$ are i.i.d. random vectors in $d$-dimensional space (i.e., $R^d$) with continuous centrally symmetric density function $f(\cdot)$ (i.e., symmetric with respect to the origin). ...

**5**

votes

**0**answers

337 views

### Another generalized coupon collector's problem

Suppose there are $L$ types of coupons, the probabilities that they appear are $a_1,a_2,\ldots,a_L$ respectively, $\sum_i^La_i=1$. Each of them is associated with a constrain number ...

**5**

votes

**0**answers

839 views

### Multidimensional Berry-Esseen for probability density functions

This is a follow up to this recent question: Berry Esseen type result for probability density functions
There exists a multidimensional version of the usual Berry-Esseen theorem (for cumulative ...

**5**

votes

**0**answers

317 views

### Missing mass estimate

Let $S$ be a finite set with probability distribution $P$. Define the random variable $m_i$ to be the "missing mass" after seeing $i$ iid samples from $S$ under $P$. That is, $m_i$ is the total mass ...

**4**

votes

**0**answers

120 views

### power laws emerging from the sandpile model

Is there a rigorous proof that the abelian sandpile model generates a power law distribution of avalanche lengths?

**4**

votes

**0**answers

322 views

### An integral with respect to the Haar measure on a unitary group

Let $A,D\in \mathbb{C}^{n \times n}$ be diagonal matrices. I need to calculate
$$\int_{U(n)}\det{(A-HDH^\dagger)}\,\mathrm{d}H$$
where $dH$ is the unit invariant Haar measure on the group of unitary ...

**4**

votes

**0**answers

156 views

### Optimization problem involving Multivariate Normal

I use $\phi(t)$ to describe the standard normal distribution density and $\Phi(t)$ as the normal distribution CDF and would like to prove that for all
$n\geq3$, the function:
...

**4**

votes

**0**answers

327 views

### Probability distribution function for singular value sum of Gaussian random matrix

Let $\mathbf{X}$ be an $N \times N$ random matrix with IID Gaussian entries. They can be standard normal, but $N$ is not large: that is $N$ $<$ 6, typically. Call its singular value decomposition ...

**4**

votes

**0**answers

170 views

### Pair of two-variable polynomial equations of high order

I have the following pair of equations to be solved for two variables $\rho$ and $D$ resulting from a certain Maximum Likelihood Estimation for a time series $X_n > 0$, $n=0, \ldots, N+1$ with $N ...

**4**

votes

**0**answers

448 views

### Inverse Fourier Transform involving a Bessel Function, Exponential, and Power

I'm interested in this integral as a function of $r$ for various spectral densities $S(s)$:
$\frac{2 \pi}{r^{p/2}-1} \int_{0}^{\infty} S(s) J_{p/2-1}(2 \pi r s) s^{p/2} ds $, where $J_{p/2-1}$ is a ...

**4**

votes

**0**answers

180 views

### envelope function for a linear combination of gaussian distributions

Given a distribution $F$ defined as a linear combination of Gaussian distributions:
$F = \sum_{i=1}^n C_i*N(\mu_i,\sigma_i)$ with $\sum_{i=1}^n C_i = 1$
I want to find a Gaussian function $Q = ...

**4**

votes

**0**answers

72 views

### Importance sampling of finite path of stochastic difference equation

Before passing to question, let me briefly recap what's importance sampling of random variables is about. Suppose $\xi$ is a real-valued random variable with density $f$, and let $g:\Bbb R\to \Bbb R$ ...

**4**

votes

**0**answers

183 views

### Has anyone used reflection in bootstrapping methods for one parameter hypothesis tests?

Here's my idea for a bootstrapping method for testing hypotheses about one parameter. Please tell me if you have seen this somewhere before. If not, I'd appreciate pointers for direction of further ...

**4**

votes

**0**answers

722 views

### Compressed Sensing with an Unusual Basis

I'm wondering if compressed sensing can be applied to a problem I have in the way I describe, and also whether it should be applied to this problem (or whether it's simply the wrong tool).
I have a ...

**4**

votes

**0**answers

360 views

### A Local CLT with large variance

For n an even integer, $0 \leq i \leq$ ${n} \choose{j}$, $1 \leq j \leq n$ let $X_{i,j}$ be a
random variable taking values $\frac{n}{2}-j,0,j - \frac{n}{2}$ with equal probability. Let $S_{n}$ be ...

**3**

votes

**0**answers

29 views

### Bound on principal angle of uniform random subspaces of different dimensions?

This paper derives the distribution of the largest principal angle between two subspaces sampled (independently) uniformly from the Grassmanian manifold of $p$-dimensional subspaces in $\mathbb{R}^d$, ...

**3**

votes

**0**answers

97 views

### Kullback Leibler “variance”: does that divergence have a name?

If you consider two probability distributions $p$ and $q$, one way to measure the distance between the two is the Kullback-Leibler divergence:
$$KL(p,q)=\int p \log (p/q) = E_p(\log p/q)$$
and this ...

**3**

votes

**0**answers

134 views

### Sum of the entries of the inverse covariance matrix

Let $T \in\left(0,1\right)$, $n\in\mathbb{N}$ and $e_n = [1,\ldots,1]\in\mathbb{R}^n$. Consider the covariance matrix $\mathfrak{A}_n = ...

**3**

votes

**0**answers

162 views

### Donsker's Theorem for triangular arrays

I should mention that I already posed this question on Math Stack Exchange, but didn't receive much feedback.
Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given ...

**3**

votes

**0**answers

32 views

### Regression with correlation structure

I have a theoretical question about regression models.
Let's say I measured multiple responses from $n$ subjects and these responses are correlated with each other. For example, let's say I measured ...

**3**

votes

**0**answers

266 views

### Maximization of a total variation distance subject to another total variation distance in Markov chain

Suppose two dependent random variables $X$ and $V$ from finite alphabets $\mathcal{V}$ and $\mathcal{X}$ with known joint and marginal distributions are given. Let $P_{XV}$ and $P_X$ and $P_V$ are the ...

**3**

votes

**0**answers

191 views

### Quantile convergence

Let $X^1,\dots,X^n$ be a sample of (not necessarily iid) random variables and denote
$$F^n(x)=\frac{1}{n}\sum_{i=1}^n \mathbf 1_{X^i\leq x}$$
the empirical distribution function. Suppose that we know ...

**3**

votes

**0**answers

112 views

### A simplified MCMC / MH algorithm. Are there known convergence results?

Hi, I hope this isn't too basic. We were working on a simulation using a Monte Carlo Within Metropolis algorithm and noticed that the whole thing could be expressed in the form below and simplified ...

**3**

votes

**0**answers

150 views

### Find a minimum entropy code for a simple gibbs random field.

Just to make precise what I am talking about, I will include the definition of a minimum entropy code. I will then define the precise markov random field I am asking about.
In the rest of this ...

**3**

votes

**0**answers

318 views

### Bochner's theorem, in stages

Bochner's theorem (for the real line version) asserts an infinite tower of inequalities, as a positivity condition. Taking each one, what do they mean, in an elementary fashion (at least at the ...

**3**

votes

**0**answers

108 views

### Is a parametric family which is universally consistent for multiple quantiles impossible?

Suppose I am dead-set on using Bayesian inference on independent and identically distributed data, but I'm lazy and insist on using a parametric likelihood function come what may. I'd be reassured to ...

**3**

votes

**0**answers

475 views

### On error probability bounds in Bayesian hypothesis testing

In the Bayesian version of (binary) hypothesis testing one has to decide which of two hypotheses $A$ and $B$ holds true. The two hypotheses are given prior probability $p(A)$ and $p(B)$, summing up to ...

**3**

votes

**0**answers

186 views

### representing vine copulas

Vine copulas is a way to represent multidimensional distributions (n-densitys)
as a product of the n 1-marginal densities and a product of (n choose 2) bivariate copulas, where som of them are ...

**3**

votes

**0**answers

162 views

### Iterated Kumaraswamy distributions

The Kumaraswamy distribution has cdf $F(x;a,b) = 1-(1-x^a)^b$.
Does anyone know any formulas or properties relating to iterations of this on itself, meaning
$$ F_i(x;a,b) = 1-(1-F_{i-1}^a)^b$$
If ...

**3**

votes

**0**answers

501 views

### A combinatorial bound involving Stirling numbers of the second type

My previous question was solved in a very elegant way, hopefully this (seemingly more complicated) case is also easy for experts.
I need the inequality
...

**3**

votes

**0**answers

137 views

### The plane cut by grids

Suppose that one has an infinite two-dimensional regular grid of spacing one. When laid on the plane it cuts it into unit squares. Now take a second (identical) grid and place it with random shift ...

**3**

votes

**0**answers

598 views

### Has the Lie group preserving a probability distribution been used in Bayesian statistics?

For a (possibly signed) nondegenerate probability measure $\pi$ on $\{1,\dots,n\}$ define
$$\langle \pi \rangle := \{R \in \operatorname{STO}(n): \pi R = \pi \}.$$
Here $\operatorname{STO}(n)$ denotes ...