Applied, computational and theoretical statistics: e.g. statistical inference, regression, time series, multivariate analysis, data analysis, Markov chain Monte Carlo, design of experiments, case studies.

learn more… | top users | synonyms

2
votes
2answers
245 views

Gaussian expectation of an exponentiated outer product

Given a normal random column vector $\mathbf{x} \sim N(\mu, \Sigma)$, I need the expectation, $$ E\left[ \exp(\mathbf{xx}^\top)\right]$$ where $\exp(\cdot)$ is element-wise exponential function (not ...
1
vote
1answer
48 views

How are two tailed p values (especially) and one tailed p values useful given the following? [closed]

So I'm a self-learner which is always dangerous because I don't have anything to test if I am understanding things correctly, so I wanted to ask what is wrong/right with my assumptions. When reading ...
1
vote
0answers
44 views

Can anything be said of the correlation of X and Y / X? [closed]

I apologize in advance if I overstep my (relatively minimal) statistical knowledge. I am looking at two random variables X and Y, and am unhappy with the correlation between the two. On a whim, I ...
0
votes
0answers
88 views

Quantile as solution to minimization problem

I posted this on Math Stack Exchange, but since I got no response, I'm trying my luck here. I'm studying basics of quantile regression now and I have trouble proving that $\tau-$th quantile of ...
5
votes
1answer
406 views

Is there a mistake in Vapnik's “Basic Lemma”?

I have a concern about the "Basic Lemma" which Valdimir Vapnik states and proves in his 1998 book Statistical Learning Theory (ch. 14.3, pp. 574–76): It seems like a certain coefficient should have ...
3
votes
1answer
174 views

An efficient method to find the MLE of the combination of two point processes

I have a point process defined in two parts as follows. Consider first the main process which we call $A$ which is homogeneous Poisson process with conditional intensity $$\lambda(t) = \mu$$ For ...
0
votes
0answers
223 views

Cholesky decomposition of a large covariance matrix

I have a tricky problem concerning a covariance matrix cholesky decomposition. What I need is to obtain the cholesky decomposition of the estimated variance matrix of the set of samples stored in a ...
0
votes
1answer
78 views

higher-level independence of three or more correlated RVs

I'm hoping for some help in nailing down a vague idea about independence. It starts with finding the expectation of a product of three RVs (or more, but I'll stick to three for now). These are not ...
0
votes
1answer
205 views

two correlated processes

I apologize if this question is not placed in the right place. But I am having a hard time to figure it out. It would be greatly appreciated if some one could help me out. Assume that there are two ...
2
votes
1answer
68 views

What is the problem with this model parameter estimation algorithm?

In a statistical model with parameters $\theta$ and unobserved laten variables $Z$, the model likelihood is $$L(\theta;X)=Pr(X|\theta)=\sum_ZPr(X,Z|\theta)$$ The standard way to estimate $\theta$ ...
0
votes
1answer
44 views

finite mixture of order statistics

Let $F(u)$ be a n-degree polynomial continuous distribution function in $[0,1]$, with $F(0)=0$, $F(1)=1$, that is $F(u)=\sum_{i=1}^{i=n} a_i u^i$. My question is: is that kind of distributions ...
1
vote
0answers
312 views

random walk with reflecting barriers [closed]

Consider a random walk on the line 1,...,d. You start at point 1. At each step you flip a coin: heads means go left, tails means go right. If you're at 1 and get a heads, just stay where you are (same ...
1
vote
0answers
80 views

Distribution of the Gram Matrices

Let $\mathbf{X}$ be an $m\times m$ random matrix full rank matrix, having the density function $f_{\mathbf{X}}(X)$. Also, let $\mathbf{W}$ be a deterministic $k\times m$ matrix of rank $k$ and ...
1
vote
1answer
150 views

Gibbs sampler with linear constraints

My problem concerns the estimation of truncated multivariate normal distributions under constraints. Let $X_1$ and $X_2$ two random variables following normal distributions ...
1
vote
0answers
234 views

Inflated independent samples for Monte Carlo estimation

In my particular problem, running an MCMC is too expensive, so I'm looking for a simple MC estimator, which would partially inherit the correlated samples of MCMC, yet would not require computing ...
3
votes
1answer
261 views

Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$. Is it true that: If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...
0
votes
1answer
102 views

Expected number of samples above certain value of a normally distributed variable with a given sample mean

Suppose $n$ values, $X_1,...,X_n,$ are generated by a random number generator with normal distribution $N(0,1).$ Suppose that the (sample) mean of $X_1,...,X_n$ is $\mu.$ What is known about the order ...
0
votes
1answer
340 views

Compound Poisson process and central limit theorem [closed]

If I have a compound Poisson process $$Y(t) = \sum_{i=1}{N(t)}D_{i}$$ where $ \{\,N(t) : t \geq 0\,\}$ is a Poisson process with rate $\lambda$, and $ \{\,D_i : i \geq 1\,\}$ are i.i.d random ...
2
votes
1answer
115 views

Distribution of the Gram matrix

Let $\mathbf{X}$ be an $m\times k$ random matrix ($m>k$) of rank $k$, having the density function $f_\mathbf{X}(X)$. What is the distribution of $\mathbf{Y}=\mathbf{XX}^T$? Basically my question is ...
1
vote
0answers
26 views

Minimal rectangular confidence regions

For a given multivariate pdf $f$ (mainly the gaussian one) I'm looking to compute a minimal rectangular confidence region for a given level $\alpha$. For example, I would like to solve problems of the ...
2
votes
1answer
230 views

Probability distribution of uAv…

Consider the complex domain ℂ. If U and V are 2 unitary random matrices and A is a deterministic matrix. What is the distribution of $u^HAv$ ( or $||u^HAv||^2$) where : u is a column vector of U. v ...
0
votes
2answers
167 views

Third order central moment of a positive linear combination of log-normal random variables

What is the sign (+tive/-tive) of the third order central moment of a positive linear combination of log-normal random variables? It seems to be a common notion that the skewness of random variables ...
2
votes
0answers
37 views

Where to read about this kind of “measure of irredundancy” of a set from a family of sets?

Studying a very practical problem from psychometrics, I encountered the following construction. Let $(X,\mu)$ be a measure space; if preferred, you can presume $\mu$ is a probability measure. In any ...
5
votes
3answers
194 views

Constructing a Bernoulli random variable for ratio of Bernoulli weights

$X$ and $Y$ are Bernoulli random variables with weights $0 < \alpha < 1$ and $0 < \beta < 1$. Is it possible to construct a sampler for the Bernoulli random variable with weight ...
2
votes
2answers
107 views

Sampling from maximally skewed stable distribution

I am reading a paper which refers to a maximally skewed stable distribution $F(x;1,-1,\pi/2,0)$ . Is there an efficient way to sample from this distribution? If $X$ has distribution ...
2
votes
0answers
143 views

Hilbert Schmidt Operators and the Conditional Expectation Operator

Consider the function $\text{E}_W: L_2(\mathbb{R},P_X) \mapsto L_2(\mathbb{R},P_W)$ where $P_X$ and $P_W$ are two different probability measures. They are related in such a way that if $f_X$, $f_W$ ...
5
votes
0answers
165 views

Inverse moment of the number of inversions of a permutation

Let $\pi$ be a permutation of $\{1,2,...,n\}$. A pair of elements ($\pi_i$,$\pi_j$) is called an inversion if $i$ $>$ $j$ and $\pi_i$ $<$ $\pi_j$. The total number of inversions in $\pi$ is ...
3
votes
1answer
124 views

Estimating total variation distance from a given distribution

Given a known distribution supported on a finite set of $n$ elements with probabilities $p_1, \dots, p_n$ and an access to an unknown distribution $q$ is it known what is the number of samples from ...
-1
votes
1answer
80 views

Express $cov(X^2,Z)$ in terms of means, variances, and covariance of $X$ and $Z$? [closed]

Suppose $X$ and $Z$ are random variables. Can the covariance of $X^2$ with $Z$ be expressed in terms of the means, population variances, and covariance of $X$ and $Z$ alone? My attempts at solving ...
2
votes
0answers
30 views

How to get the Expectation of the normalization of some log-normal-distributions?

Problem Definition: Suppose that a random variable of multivariate Gaussian distribution $X \sim N(\Sigma,\mu)$, $\Sigma$ is the covariance matrix, and $\mu$ is the mean. For each $x_i$ from $X$, $x_i ...
1
vote
1answer
79 views

Averaging function of sum of variables using central limit theorem

I'm trying to evaluate an integral of the following form $$\int \prod_i \left[ dx_i \,P(x_i) \right] \; f \Big( \frac{1}{N} \! \sum_{i=1}^N x_i \Big)$$ and I know that the distribution of $x$ is ...
5
votes
1answer
349 views

Central limit theorem for independent random variables, with a Gumbel limit

Consider independent random variables $Y_i$, $i>0$, such that $\mathbb{E}(Y_i)\approx \frac{1}{i}$ and $\text{Var}(Y_i)\approx \frac{1}{i^2}$, where $\approx$ means asymptotically equivalent up to ...
1
vote
0answers
52 views

Efficient evaluation of multidimensional kernel density estimate

Edit I have copied this discussion to the stats community site here, since I feel it is more relevant. Please feel free to close this in due course. I've seen a reasonable amount of literature about ...
2
votes
2answers
141 views

Bounds for the fat tail after trimming the mean?

I am interested in the quantity $$f(X,t) = \int_t^\infty\negthinspace x\ p(x)\ dx,$$ where $p$ is a probability distribution for a positive variable $X$. 1) Does this quantity $f(X,t)$ have a name? ...
1
vote
0answers
61 views

Whether r.v. with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)]$ is overdispersion?

When discrete r.v. $X$ is not Poisson distributed and ${\rm{Var}}X,EX < \infty $, I want to know whether r.v. $X$ with p.g.f. $\exp [\sum\limits_{i = 1}^\infty {{q_i}({z^i}} - 1)],({q_i} \in ...
4
votes
0answers
152 views

Optimization problem involving Multivariate Normal

I use $\phi(t)$ to describe the standard normal distribution density and $\Phi(t)$ as the normal distribution CDF and would like to prove that for all $n\geq3$, the function: ...
-1
votes
1answer
57 views

Finiteness of “novel variance” from a kernel on a compact space [closed]

Let $c(i,i')$ be a kernel function on a reasonable index space $I$. Choose a dense sequence of points $\{i_1, i_2, \cdots \} \subseteq I$, and define the one-point kernel functions $k_n := c(\cdot, ...
1
vote
3answers
137 views

How to estimate the entropy of a distribution on a power set?

Given a probability distribution $(X,p)$, its entropy is defined as $H=-\sum_{x\in X} p(x)\log p(x)$. Given a sample of observations $x_n,n=1..N$, one can estimate $p(x)=\frac{\#\{i:x_i=x\}}{N}$ and ...
1
vote
1answer
93 views

Can I test many p-values with KS or AD

(Sorry if this is a noob question. I'm a mathematician learning statistics.) I would like to know if it's sound (or advisable) to test many p-values against the continuous uniform distribution using ...
-4
votes
1answer
87 views

Is it possible to determine if these random numbers are not really random? [closed]

I've been given a big ordered list of integer numbers. Looks like this : 10 -11 -3 -6 -10 -1 ..... ..... ..... Allegedly, these values are random from -12 to +12 However, there has been ...
1
vote
2answers
287 views

Empirical estimator for total variation distance between two product distributions

Let $X = (X_1, X_2, \ldots , X_n)$ be an $n$-dimensional random variable, where each $X_i$ is a random variable on finite discrete set $S$. In addition, $X_i$ are independent of each other (but not ...
5
votes
1answer
192 views

Measures which exhibit the “uncorrelated implies independent” property

Let $X$ be a topological linear space, and let $X^*$ be its dual space. Suppose that $X$ is complete and Hausdorff, and $X^*$ separates points. Let $Y$ be another such space, and let $f : X \to Y$ be ...
0
votes
1answer
86 views

Understanding the derivation of a ML-estimator (statistics)

I'm trying to understand the derivation of a ML-estimator and more specifically the rewriting of the covariance matrix $\Sigma$. In this rewriting, a lemma is used to show that: $$ \tag{1} ...
1
vote
1answer
176 views

forward algorithm Hidden Markov Model

I am studying the the forward-backward algorithm used in Hidden Markov Models. I understand that that you are trying to propagate through a sequence (and the available states) to find the most ...
0
votes
1answer
91 views

Estimating the variance of error in empirical approximation to a distribution

Let $X_1,X_2,\ldots,X_n$ be i.i.d. random variables in $\mathbb{R}$ with common cumulative distribution function (CDF) $F(x)$. The empirical approximation to $F(x)$ is defined as follows: ...
1
vote
1answer
88 views

What is known about the distribution of the errors in empirical approximation of a CDF?

Let $X_1,X_2,\ldots,X_n$ be i.i.d. random variables in $\mathbb{R}$ with common cumulative distribution function (CDF) $F(x)$. The empirical approximation to $F(x)$ is defined as follows: ...
1
vote
0answers
75 views

Question in Wainwright's paper about signed support recovery in lasso

Sharp thresholds for high dimensional and noisy sparsity recovery using $l_1$ constrained quadratic programming (Lasso) This paper is about support recovery guarantees of the Lasso. I have an issue ...
13
votes
4answers
777 views

Are gaussians with different moments far in total variation distance?

If two Gaussians disagree on one moment, it seems like this should imply that they have a large variation distance--equivalently, if two Gaussians are close in variation distance it's hard for their ...
2
votes
1answer
72 views

Why does differencing create wide-sense stationary time series?

In time series analysis, a common assumption made is that the series is wide-sense stationary, ex. that it has time invariant mean and covariance. However, as this is often not the case in real life, ...
2
votes
0answers
61 views

Smallest distribution of points with genuinely different clusterings

An hierarchical clustering algorithm for (finite) sets of points in a given metric space is essentially determined by its linkage criterion, which defines the distance between arbitrary (finite) sets ...