**4**

votes

**2**answers

230 views

### Expectation of Mahalanobis norm

Let $(g_i)_{i=1,...,d}$ sampled i.i.d. from a standard Gaussian, and $(\lambda_i)_{i=1,...,d}$ non-random s.t. $\max_i(\lambda_i)=1$ and $\lambda_i>0, \forall i$.
I am looking for the expectation ...

**-4**

votes

**0**answers

49 views

### Pascals triangle [on hold]

I was out sick for a fair bit and I come back and we are doing this! Can someone explain what I'm supposed to do or show me a video??
"Use Pascal's triangle and the regularity of decreasing powers of ...

**0**

votes

**0**answers

13 views

### The mutual information rate spectrum [migrated]

Definition:
$\mathbf{X}$ denotes the random vector $({X_1},{X_2},...,{X_n})$. The mutual information between $X$ and $Y$, $I(X;Y)$, is determined by the joint law of $p(X,Y)$, Given two random ...

**1**

vote

**0**answers

44 views

### Bounding correlation between blocks of Gaussian stationary process

Let $X_n$ be a stationary Gaussian process with covariance function $\gamma(n)=\mathrm{Cov}[X(n),X(0)]$. Let $\mathbf{X}_p^q=(X_p,\ldots,X_q)$, $s_n^2=\mathrm{Var}(X_1+\ldots+X_n)$, and ...

**8**

votes

**1**answer

489 views

### Table with the most seated customers in Chinese restaurant process

Suppose we have some initial configuration of people seated at some tables. We start taking new customers and seat them following Chinese restaurant process. Is there some known work on finding the ...

**0**

votes

**2**answers

48 views

### Is it possible to find an asymptotic distribution for the LRT without the ML estimators being consistent?

I'm reading a comment(last page) to a paper, and the author states that sometimes, even though the estimators (found by ML or maximum quasilikelihood) may not be consistent, the test may be ...

**0**

votes

**2**answers

4k views

### Why 1.5IQR whiskers in boxplot? [closed]

Hi math people.
I'm in the process of analyzing some data that I collected through an experiment. The data are (somewhat) normally distributed and I represent the different data-sets using boxplot, ...

**3**

votes

**0**answers

58 views

### A Generalized Version of Maximal Correlation and Hypercontractivity of Conditional Expectation Operator

Given a pair of random variables $(X,Y)$ over a product space $\mathcal{X}\times \mathcal{Y}$, the maximal correlation coefficient is defined as
...

**2**

votes

**1**answer

60 views

### Does Schatten-p (quasi-)norm satisfy the norm inequality for 0<p<1?

I'm reading the paper by ANGELIKA ROHDE AND ALEXANDRE B. TSYBAKOV, ESTIMATION OF HIGH-DIMENSIONAL LOW-RANK MATRICES.
And in the paper, they provide an inequation of the Schatten-p (quasi-)norm, ...

**0**

votes

**0**answers

11 views

### A mix between the Horvitz-Thompson and ordinary estimator

I have two samples: unbiased $X$ with $N_1$ elements and biased $Y$ with $N_2$ elements from some distribution (let it be F = ChiDistribution(1) if needed, $N_1=N_2=50$).
Elements of $Y$ are picked ...

**2**

votes

**0**answers

68 views

### Implication of MGF inequality

Let X and Y be two random variables. Denote by $F_X(x)$ and $F_Y(y)$ their CDFs and by $M_X(t)$ and $M_Y(t)$ their MGFs.
It is known that X and Y have the same CDF iff they have the same MGF.
My ...

**2**

votes

**2**answers

103 views

### Do all positive distributions on $N$ variables factor pairwise?

The Hammersley-Clifford theorem says that any positive probability distribution satisfies one of the Markov properties with respect to an undirected graph G if and only if its density can be ...

**2**

votes

**1**answer

116 views

### Maximization of specific Likelihood function

N coins have probability $p_n = e^{-t_n/s}$ of heads, $t_n$ being specific for each coin. Coins 1 to m came up heads and m+1 to N came up tails. Now I'm trying to estimate $s$ using the Maximum ...

**0**

votes

**0**answers

38 views

### Rate-Distortion theory: What is the distribution of distortion on an optimal encoder?

If we wish to encode a gaussian source, $X\sim\mathcal{N}(0,\sigma^2)$ at rate $R$, then decode it to create an estimate $\hat{X}$, rate-distortion theory tells us that the lowest mean-squared-error ...

**3**

votes

**1**answer

248 views

### Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$.
Is it true that:
If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...

**0**

votes

**0**answers

68 views

### Upper bound involving random orthogonal projection

Let $R$ be an $n\times N$ random matrix with i.i.d. standard Gaussian entries, $n<N$, and let $M:=(RR^T)^{-1/2}R$. Let $u,v\in \mathbb{R}^N$ non-random and s.t. $u^Tv=0$ and $\|u\|>\|v\|$.
I ...

**0**

votes

**1**answer

292 views

### Size of KL-divergence neighbourhoods

I am new here. I was reading another
post
here and this got me wondering what can be said about the size of the following kl divergence neighborhoods.
Consider these two kl-divergence neighbourhood ...

**1**

vote

**0**answers

73 views

### Converse for Levy's continuity theorem

Levy's continuity theorem states that, for a sequence of random variables $\{X_n\}$ with characteristic functions $\{\varphi_n(t)\}$ and a random variable $X$ with a characteristic function ...

**3**

votes

**2**answers

140 views

### Statistical properties of principal components and their convergence rates.

Hello everyone, I'm interested in doing statistical tests on properties of principal components, but none of the literature I've found so far seems quite right for my purposes. Many articles present ...

**1**

vote

**1**answer

182 views

### Computing probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s

This question came up in my research: What is the probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s?
So far I only figured out that I can do Monte ...

**1**

vote

**0**answers

52 views

### Subclass of semimartingales for which all characteristics can be estimated?

I'm going to ask the question for Ito semimartingales rather than semimartingales in general, but more general answers would be great.
An Ito semimartingale is a martingale for which the ...

**2**

votes

**1**answer

50 views

### Reducing eigenvalues of symmetric PSD matrix towards 0: effect on ratios of original matrix elements?

Let $\boldsymbol{S}$ be $k \times k$ positive semi-definite real symmetric matrix with eigen decomposition $\boldsymbol{S} = \boldsymbol{X} \boldsymbol{\Lambda} \boldsymbol{X}'$ ...

**24**

votes

**11**answers

8k views

### why is it so cool to square numbers? (in terms of finding the standard deviation)

When we want to find the standard deviation of $\{1,2,2,3,5\}$ we do
$$\sigma = \sqrt{ {1 \over 5-1} \left( (1-2.6)^2 + (2-2.6)^2 + (2-2.6)^2 + (3-2.6)^2 + (5 - 2.6)^2 \right) } \approx 1.52$$.
Why ...

**0**

votes

**2**answers

210 views

### Generalized expression for balls and bins problem

$n$ number of balls are thrown randomly to $m$ number of bins, standing in a row. The balls are labeled as $1,2,3,....n$ and bins are also labeled as $1,2,3,...,m$. The probability of $i_{th}$ ball ...

**8**

votes

**0**answers

1k views

### Blinding a paper : the acknowledgements section [closed]

I am about to submit a paper (my first!) to a journal in statistics. There is a requirement to submit a "blinded" version. Should I remove the acknowledgements section too for this? If I do, what are ...

**2**

votes

**0**answers

32 views

### Derivation of gradient of SSE in Geodesic Regression

On page 79 (or page 5) of this this paper the gradient of the SSE of the Geodesic model is described explicitly. My question is how are these equitations derived in detail; where can I find the ...

**4**

votes

**0**answers

91 views

### power laws emerging from the sandpile model

Is there a rigorous proof that the abelian sandpile model generates a power law distribution of avalanche lengths?

**5**

votes

**1**answer

225 views

### Reference on (discrete) log-concave probability distributions

A discrete distribution $p$ over $\mathbb{N}$ is said to be log-concave if it satisfies the following conditions:
The support of $p$ is a contiguous interval, i.e. $\exists a \leq b$ s.t. $p_i > ...

**4**

votes

**1**answer

219 views

### Square root of normal distribution

Let $X$ and $Y$ be independent random variates with the same probability distribution, $P(x)$. Assuming that the product $Z=XY$ is a random variate with normal distribution, say $$f_Z(x) = ...

**0**

votes

**0**answers

90 views

### How to decide a value of learning rate for Stochastic Gradient Descent?

I'd like to know how to decide a value of learning rate for Stochastic Gradient Descent (SGD), such as $\eta$ on the following parameter update iteration equation,
$w_{i+1} = w_i + -\eta \nabla ...

**1**

vote

**0**answers

37 views

### Maximum likelihood estimation with several distributions

My question concerns using Maximum likelihood to estimate unknown parameters used by several (poisson) distributions.
The parameters are the pairs $(a_1,b_1),\dots,(a_N,b_N)$, and for each pair ...

**3**

votes

**2**answers

185 views

### PDF of the product of normal and Cauchy distributions

I am having trouble in finding out the resulting PDF of the product of normal and Cauchy distributions. It turns out that we have a general formula for calculating the PDF of product of two random ...

**0**

votes

**0**answers

38 views

### Upper bound for chi-square divergence in terms of KL divergence

In my research I need an upper bound for chi-square divergence in terms KL divergence which works for general alphabets. To make this precise, note that for two probability measures $P$ and $Q$ ...

**1**

vote

**0**answers

63 views

### How to fit a stochastic matrix to given data.?

Given a data sequence of noisy observations of a 3-state Markov chain $X$ -- $y_1$,$y_2$,...$y_n$, with two transition matrices $A_1$ and $A_2$ corresponding to different regions (**) in the (unit) ...

**0**

votes

**2**answers

161 views

### Third order central moment of a positive linear combination of log-normal random variables

What is the sign (+tive/-tive) of the third order central moment of a positive linear combination of log-normal random variables?
It seems to be a common notion that the skewness of random variables ...

**0**

votes

**0**answers

43 views

### Taking power of the integrand in a Riemann-Stieltjie Integral

This is a problem I am trying to solve as part of a calculation for Value-at-Risk.
Given that
$P(X<x)=F(x)=\int_{\theta}F(x|\theta)dG(\theta)=1-\alpha$,
where $F$ and $G$ are CDF's, is there a ...

**2**

votes

**0**answers

181 views

### Inequality with CDF of order statistics

here is a problem I have been struggling with for a while now. This is for a paper I am working on. Any help would be appreciated! Here we go:
Each bidder's valuation $\theta _{i},$ $i=1,...,N$, is ...

**5**

votes

**2**answers

345 views

### Applications of cohomology to probability and statistics

Are there interesting/useful applications of cohomology (and homological algebra in general) to probability and statistics, or information theory?
By "interesting/useful", I mean "not merely ...

**2**

votes

**2**answers

100 views

### What is the sum capacity of a scalar gaussian broadcast channel?

"On the Achievable Throughput of a Multiantenna Gaussian Broadcast Channel" by Giuseppe Carie and Shlomo Shamai talks, in part, about the following type of link (paraphrasing):
A transmitter with ...

**0**

votes

**0**answers

38 views

### Is a conditional copula invariant under strictly increasing transformations?

currently I am working on conditional copulas and I have a theoretical question. In "An Introduction to Copulas", Nelsen (2006) there is a theorem (2.4.3) which says:
Let $X$ and $Y$ be continuous ...

**4**

votes

**5**answers

2k views

### book recommendation on data analysis and statistics

I am looking for a book on data analysis and statistics.
My objective is to better analyse and understand data over time (like trends or events) and extract useful information from raw statistics. I ...

**1**

vote

**0**answers

32 views

### Is it possible to distinguish between to edge orientation while learning a network structure?

I'm considering the case of learning bayesian network structure using a dataset $\mathcal{D}$ with scoring methods :
$$\mathcal{G}^*=\max_{\mathcal{G}}\text{Score}(\mathcal{G}, \mathcal{D})$$
I'm ...

**1**

vote

**0**answers

27 views

### assumptions on local rademacher complexities

A lot of the work on Local Rademacher complexities of Koltchinskii, and Bartlett for fast rates of convergence is based on Bousquet's version of Talagrand's inequality [1] (Theorem 2.11). However the ...

**2**

votes

**3**answers

519 views

### When do binomial distributions occur?

A binomial distribution is the distribution of the number of successes of n independent, identical Bernoulli trials. What happens when the trials are dependent and the Bernoulli trials are not ...

**0**

votes

**1**answer

402 views

### central limit theorem for binomial random variable

I'm confused about applying central limit theorem to Bernoulli random variables. Let
$X_i=\frac{n}{\sqrt{n-1}}(Z_i - \frac{1}{n})$ where $Z_i$ is iid Bernoulli($\frac{1}{n}$). Then $E[X_i]=0$ and ...

**5**

votes

**0**answers

102 views

### What's the variance in the Six Degrees model?

Recall the six degrees of Kevin Bacon game. You can even play the game at The Oracle of Bacon, and their search works via Breadth First Search.
I interpret the punchline as saying that if I start ...

**1**

vote

**2**answers

970 views

### Derivative of a differentiable stationary Gaussian process

Thanks for your help in advance. I'm interested in understanding the properties of derivatives of a differentiable stationary Gaussian process. Specifically, is the derivative also a Gaussian ...

**4**

votes

**0**answers

237 views

### An integral with respect to the Haar measure on a unitary group

Let $A,D\in \mathbb{C}^{n \times n}$ be diagonal matrices. I need to calculate
$$\int_{U(n)}\det{(A-HDH^\dagger)}\,\mathrm{d}H$$
where $dH$ is the unit invariant Haar measure on the group of unitary ...

**0**

votes

**0**answers

56 views

### Continuous self-information

Let $I(X,Y)$ be the mutual information between two continuous random variables $X$ and $Y$.
We have $I(X,Y) = H(X)-H(X|Y)$, and setting $X=Y$ leads to $I(X,X) = H(X)-H(X|X)$. If $X$ was discrete, ...

**0**

votes

**1**answer

34 views

### distances-based dispersion measuring approach

Is there any known approach or method to measure the dispersion of a set depending on the distances between its points (i.e.: without calculating the average or the mean) ?
thanks.