Applied, computational and theoretical statistics: e.g. statistical inference, regression, time series, multivariate analysis, data analysis, Markov chain Monte Carlo, design of experiments, case studies.

learn more… | top users | synonyms

0
votes
0answers
13 views

MLE of Gamma when only given observations [closed]

i've been given 10 observations of X, where X is a random variable. the observations are 141 16 46 40 351 259 317 1511 107 567 and now given they are gamma distributed, how do you find the MLE using ...
2
votes
0answers
81 views

Convergence rate of Pearson correlation matrix

I am interested in (rather sharp if not the finest) tail/concentration bounds for the Pearson correlation matrix: let $X_1,\ldots,X_N \sim \mathcal{N}(0,1)$ be correlated random variables; let ...
-1
votes
0answers
20 views

Statistics, the deviation and expection of a number sequence [closed]

There is a sequence of number $a_{0},a_{1},...,a_{n}$, $(0 < a_{i} < 1)$ Define $b_{t} = \frac{ \sum_{i=0}^{t}{w^{t-i}a_{i}} }{ \sum_{i=0}^{t}{w^{t-i}} }$ where $w \in (0, 1)$. Can we proof ...
-1
votes
0answers
54 views

Probability and Statistics [closed]

for the cards shown below, what is the probability of choosing a yellow card and then a D if the first card is replaced before the second card is drawn? [b] [1] [5] [D] [10] ...
3
votes
1answer
108 views

Practical bounds for the Wasserstein distance in 2 dimensions

Let $X_1,\dots,X_n$ be a set of independent samples of a distribution $\mu$ on the unit square, let $\hat\mu_n$ be the empirical distribution on the points $X_1,\dots,X_n$, and let ...
0
votes
0answers
19 views

ROC curve analysis [migrated]

I wanted to ask a question relating to the ROC curves. Suppose I have a drug intervention data set with pre-drug and post-drug values. Can I use a ROC curve for such paired data analysis? I know that ...
5
votes
2answers
118 views

Reference to iterated logarithm law and Smirnov law of empirical CDF

I am reading V. Vapnik's "Statistical Learning Theory". The author layouts following two statistical laws related to empirical CDF. I am looking for reference about proofs on these two laws. Let ...
0
votes
0answers
21 views

Consistency of M-estimators when the constraint set also has to be estimated

Let $K \subset \mathbb R^n$ compact and convex. Also let $H$, $G_i, \; i \in \{1,\dotsc,m\} $: $K \to \mathbb R$ be convex functions. Assume we have the following convex optimization problem: $$ ...
2
votes
1answer
72 views

Is there any parameter space of Cramér–Rao_bound

It is known that Cramér–Rao_bound is the lower bound of variance of a parameter. A useful link is https://en.wikipedia.org/wiki/Cram%C3%A9r%E2%80%93Rao_bound There is also a term called ...
0
votes
0answers
32 views

Validating a probability density distribution forecast model for a Markov process

Let's say we have a Markov process $X_t$, and we come up with a forecast model that takes some information from outside world and says: "value $X_{t+1}$ has probability density distribution $P_t(x)$". ...
0
votes
0answers
19 views

A book on discriminant analysis

Can anyone suggest a good book on discriminant analysis - comprehensible and detailed? (Kendall and Stuart write about the subject too concisely.) Thanks in advance.
0
votes
0answers
47 views

Best measure for curve similarity

I would like to measure similarity between two curves represented by two arrays of points. The similarity measure should not depend on the size of these shapes. Two similar shapes but have different ...
0
votes
1answer
21 views

Supremum of centered jointly generalized chi-square random variables

Let $\zeta_n$ be a sequence of centered jointly generalized chi-square random variables, i.e. $\zeta_n = \sum_{k=1}^{m_n} a_{k,n}(\xi_{k,n}^2 - E[\xi_{k,n}^2])$, and $\xi_{k,n}$ are centered jointly ...
0
votes
0answers
78 views

Probability of substring given string production probabilities

I originally posted this question on the Math StackExchange, but have not received answers there and thought it might be more appropriate to post it here. Let $\Sigma$ be an alphabet and let $y = x_1 ...
1
vote
2answers
98 views

Average Multivariate Gaussian

Suppose we have a (possibly infinite) collection k-variate gaussian distributions $\{(\mathcal{N}(\mu_{\lambda}, \Sigma_{\lambda}))\}$ ($\lambda$ is just a label), and for each distribution $\mu \in ...
-1
votes
0answers
6 views

Mean and variance for unequal samples [migrated]

I have a sampling of variable sized plots. Each plot contains the number of trees present on the plot. Given: $n=$ the number of plots $s_i=$ the size of the $i^{th}$ plot $y_i=$ the number of trees ...
0
votes
0answers
32 views

convergence of empirical distribution of random vectors

Given (a) random matrices $A^{n} \in \mathbb R^{n\times n}$ with iid normal entries $A_{ij}\sim \mathcal N(0, 1/n)$; and (b) $X^{n} \in \mathbb R^{n}$ with its empirical distributions converging ...
4
votes
0answers
145 views

Is there a name for this quantity between two distributions?

Let $f$ be a probability density on a compact domain $D$, and say that $x_1,\dots,x_n$ are samples from $f$. If we wanted to compute the Wasserstein distance between $f$ and the empirical ...
2
votes
1answer
106 views

Where can I find a copy of Moussatat's 1976 thesis “On the Asymptotic Theory of Statistical Experiments and Some of Its Applications”?

It was apparently written at Berkeley under the direction of Le Cam, and it is cited in a number of contributions to mathematical statistics, for example in Strasser's (1985) book "Mathematical Theory ...
0
votes
0answers
21 views

Mixture model: optimization vs regression

Consider a sample $\mathcal D = \{T_n\}_{n=1}^N$ of independent random variables, s.t.: $$ p(T_n) = p_n(T) = \sum _{m=1}^Mp_n(\mathcal C_m)p_n(T\mid \mathcal C_m) = \sum _{m=1}^Mw_{nm}q_m(T) $$ I will ...
0
votes
0answers
43 views

Stationarity and Regression

apologies this might turn out to be a bit on the simple side, but I've been thinking this through and haven't quite found the right approach. Suppose I have a bunch of time series (say ...
0
votes
0answers
17 views

K nearest neighbors estimation with a kernel

If I have a bunch of data points $x_1,\dots,x_n$, I can build a density function $f(x)$ based on these data points by defining $f(x) = c/d_k(x)$ for an appropriate constant $c$, where $d_k(x)$ is the ...
6
votes
4answers
97 views

Uniform Sampling Subject to Linear Equalities and Non-Negativity Constraint

I'm trying to sample uniformly on the intersections of faces of several simplicies, with all coordinates being non-negative. That is, given constraints $$A\vec{w}=\vec{b} \ \ and \ \ \vec{w} \geq ...
2
votes
3answers
76 views

Generate Bernoulli vector with given covariance matrix

I am from different background, so please forgive me if the answer is so well known. Let $C=(c_{ij})$ be a given $n\times n$ matrix. Do we have a way to generate samples of random Bernoulli vectors ...
3
votes
0answers
70 views

Kullback Leibler “variance”: does that divergence have a name?

If you consider two probability distributions $p$ and $q$, one way to measure the distance between the two is the Kullback-Leibler divergence: $$KL(p,q)=\int p \log (p/q) = E_p(\log p/q)$$ and this ...
2
votes
1answer
107 views

Bounds on the probability of k-of-n events in terms of bounds on single and pairwise probabilities

Let $A_1,\dotsc,A_n$ be events in a probability space, and let $N = \sum_{i=1}^n \mathbf{1}_{A_i}$ be the random number of events that occur. For a fixed value $k \in \{1,\dotsc,n\}$, what can be ...
2
votes
1answer
187 views

Expected value (probability) maximization with binomial distribution

I need to solve an optimization problem that involves an expected value like $$F(n,x) = \sum_{k=0}^n \binom{n}{k} p^k(1 - p)^{n - k} f(k,x).$$ Here $f(k,x)$ is actually a probability coming from a ...
0
votes
0answers
72 views

A question concerning distribution of $\mathbf{Y}/\|\mathbf{Y}\|_2$ where $\mathbf{Y}\sim \mathcal{N}(\boldsymbol{\mu},\mathbf{I})$

I know that when $\mathbf{Y}\sim\mathcal{N}(\mathbf{0},\mathbf{I})$, $\mathbf{Y}/\|\mathbf{Y}\|_2$ is distributed uniformly on the unit sphere. But to my surprise, I failed to find a simple closed ...
0
votes
0answers
15 views

Question on Asymptotic Normality of non-parameter estimands of a distribution

I'm currently taking an introductory statistics course and one of the topics we covered was Maximum Likelihood Estimates and their asymptotic normality (under reasonable conditions that were not ...
0
votes
1answer
56 views

Finding the distribution of a random variable numerically with sample data? [closed]

Just a thought that I had recently. Suppose given discrete data points for a random variable, could one numerically generate the probability function values at these discrete values? I tried looking ...
6
votes
4answers
101 views

What can be said about the concentration of measure of product of Gaussian variables?

I have a set of random variables $X_1,\ldots,X_n$, all Gaussian with mean 0 and variance 1, indepedent. Let $p(x_1,\ldots,x_n)$ be some polynomial that takes products and sums of $x_1,\ldots,x_n$. ...
2
votes
0answers
18 views

Is there some kind of lower bound for estimation error of the estimation of (near) low-rank matrices in high-dimension?

I'm reading S.Negahban and M.J.Wainright's paper, ESTIMATION OF (NEAR) LOW-RANK MATRICES WITH NOISE AND HIGH-DIMENSIONAL SCALING. In the paper, they give a upper bound for estimation error of the ...
4
votes
1answer
145 views

variance of compound binomial distributions

The below is motivated by a problem I'm observing in my experimental data I have m boxes, where each box is supposed to contain k molecules of mRNA. The measurement process includes labeling all the ...
0
votes
0answers
65 views

What is the concentration of measure for Gaussian random variables which are independent, but are transformed?

This might be a too easy question for Mathoverflow, but Googling led to similar questions and answers here (though not the one I was looking for). The question is split into two: I have a matrix $X ...
1
vote
0answers
52 views

How do you use the bits you get back from Bits Back Coding?

Bits Back coding is a scheme to transmit an observation x. You can read about it here [1]. To my understanding, it works like this: The encoder samples a message z from a distribution Q(z|x) that it ...
0
votes
0answers
42 views

Recursive parameter estimation for partially observed Ito SDEs

I'm trying to get my head around online (recursive) maximum-likelihood parameter estimation in the language of stochastic processes and in the context of stochastic filtering, i.e. where we have a ...
0
votes
1answer
210 views

Are such averages known with representations of $S_n$?

Like is there a sense in which one can quantify that for two group elements (in different conjugacy classes) their characters are "close" for some fixed irreducible representation? (feel free to ...
4
votes
2answers
299 views

Expectation of Mahalanobis norm

Let $(g_i)_{i=1,...,d}$ sampled i.i.d. from a standard Gaussian, and $(\lambda_i)_{i=1,...,d}$ non-random s.t. $\max_i(\lambda_i)=1$ and $\lambda_i>0, \forall i$. I am looking for the expectation ...
1
vote
0answers
71 views

Bounding correlation between blocks of Gaussian stationary process

Let $X_n$ be a stationary Gaussian process with covariance function $\gamma(n)=\mathrm{Cov}[X(n),X(0)]$. Let $\mathbf{X}_p^q=(X_p,\ldots,X_q)$, $s_n^2=\mathrm{Var}(X_1+\ldots+X_n)$, and ...
3
votes
1answer
160 views

A Generalized Version of Maximal Correlation and Hypercontractivity of Conditional Expectation Operator

Given a pair of random variables $(X,Y)$ over a product space $\mathcal{X}\times \mathcal{Y}$, the maximal correlation coefficient is defined as ...
2
votes
1answer
96 views

Does Schatten-p (quasi-)norm satisfy the norm inequality for 0<p<1?

I'm reading the paper by ANGELIKA ROHDE AND ALEXANDRE B. TSYBAKOV, ESTIMATION OF HIGH-DIMENSIONAL LOW-RANK MATRICES. And in the paper, they provide an inequation of the Schatten-p (quasi-)norm, ...
2
votes
0answers
83 views

Implication of MGF inequality

Let X and Y be two random variables. Denote by $F_X(x)$ and $F_Y(y)$ their CDFs and by $M_X(t)$ and $M_Y(t)$ their MGFs. It is known that X and Y have the same CDF iff they have the same MGF. My ...
2
votes
2answers
110 views

Do all positive distributions on $N$ variables factor pairwise?

The Hammersley-Clifford theorem says that any positive probability distribution satisfies one of the Markov properties with respect to an undirected graph G if and only if its density can be ...
1
vote
1answer
54 views

Rate-Distortion theory: What is the distribution of distortion on an optimal encoder?

If we wish to encode a gaussian source, $X\sim\mathcal{N}(0,\sigma^2)$ at rate $R$, then decode it to create an estimate $\hat{X}$, rate-distortion theory tells us that the lowest mean-squared-error ...
1
vote
0answers
106 views

Converse for Levy's continuity theorem

Levy's continuity theorem states that, for a sequence of random variables $\{X_n\}$ with characteristic functions $\{\varphi_n(t)\}$ and a random variable $X$ with a characteristic function ...
1
vote
1answer
191 views

Computing probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s

This question came up in my research: What is the probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s? So far I only figured out that I can do Monte ...
1
vote
0answers
57 views

Subclass of semimartingales for which all characteristics can be estimated?

I'm going to ask the question for Ito semimartingales rather than semimartingales in general, but more general answers would be great. An Ito semimartingale is a martingale for which the ...
2
votes
1answer
75 views

Reducing eigenvalues of symmetric PSD matrix towards 0: effect on ratios of original matrix elements?

Let $\boldsymbol{S}$ be $k \times k$ positive semi-definite real symmetric matrix with eigen decomposition $\boldsymbol{S} = \boldsymbol{X} \boldsymbol{\Lambda} \boldsymbol{X}'$ ...
2
votes
0answers
45 views

Derivation of gradient of SSE in Geodesic Regression

On page 79 (or page 5) of this this paper the gradient of the SSE of the Geodesic model is described explicitly. My question is how are these equitations derived in detail; where can I find the ...
0
votes
2answers
243 views

Generalized expression for balls and bins problem

$n$ number of balls are thrown randomly to $m$ number of bins, standing in a row. The balls are labeled as $1,2,3,....n$ and bins are also labeled as $1,2,3,...,m$. The probability of $i_{th}$ ball ...