Applied, computational and theoretical statistics: e.g. statistical inference, regression, time series, multivariate analysis, data analysis, Markov chain Monte Carlo, design of experiments, case studies.

learn more… | top users | synonyms

0
votes
1answer
178 views

Continuity of a Functional

A certain functional $T$ is defined as: $$T(F)=\int_{(0,1)}F^{-1}(s)M(ds)$$ where $M$ is a probability measure with support $[\alpha,1-\alpha]$,for $\alpha>0$. The result that above functional is ...
0
votes
0answers
18 views

Question on Stationary & Cointegration Test (Augmented Dickey Fuller & Engle Granger test) [on hold]

I'm performing the stationary and cointegration test on stock prices. What I'm confused is 1) the difference between ADF stationary test and ADF cointegration test. 2) Also, in ADF stationary test, ...
3
votes
1answer
63 views

Characterizing space that preserves positive-definiteness property

Given a symmetric positive-definite matrix $\Sigma$, consider the space $\mathcal{D}$ of diagonal matrices such that $\forall D\in\mathcal{D}$, the matrix $\Sigma-D\Sigma^{-1}D$ is positive definite. ...
0
votes
2answers
114 views

Third order central moment of a positive linear combination of log-normal random variables

What is the sign (+tive/-tive) of the third order central moment of a positive linear combination of log-normal random variables? It seems to be a common notion that the skewness of random variables ...
0
votes
0answers
50 views

Maximum Entropy for Dirichlet with Constrained Expectation [on hold]

How would I find the maximum entropy distribution of a Dirichlet with a known expectation (i.e if I know the expected value, a multinomial, how would I find the concentration parameter that maximizes ...
1
vote
2answers
1k views

How to construct a linear regression model with an unbalanced sample design?

A relatively simple question, but I cannot seem to find anything relevant to this. In fact, I'm not even sure of "unbalanced design" is even the right terminology here, but it was suggested to me. ...
4
votes
1answer
281 views

Strong Law of Large Numbers for arrays of partly dependent random variables

Suppose $X_1$, $X_2$ are two independent real-valued random variables. Let $F$ be a continuous (unbounded) function from $\mathbb{R^2}$ to $\mathbb{R}$. Assume that the necessary measurability and ...
3
votes
0answers
119 views

Donsker's Theorem for triangular arrays

I should mention that I already posed this question on Math Stack Exchange, but didn't receive much feedback. Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given ...
5
votes
1answer
253 views

Table with the most seated customers in Chinese restaurant process

Suppose we have some initial configuration of people seated at some tables. We start taking new customers and seat them following Chinese restaurant process. Is there some known work on finding the ...
0
votes
1answer
23 views

Is it possible to find an asymptotic distribution for the LRT without the ML estimators being consistent?

I'm reading a comment(last page) to a paper, and the author states that sometimes, even though the estimators (found by ML or maximum quasilikelihood) may not be consistent, the test may be ...
5
votes
1answer
259 views

How to check if a symmetric random variables is the difference of two iid symmetric random variables

I have the continuous symmetric random variable $X$ in $\mathbb{R}$. If I know its distribution function $F(x)$ what are the conditions on $F(x)$ so that $X=Y_1 - Y_2$ where $Y_i$ are also iid ...
0
votes
0answers
35 views

What is the Vapnik-Chervonenkis dimension of sigmoidal functions? [migrated]

Consider the following class of functions: $F=\{f_w:R^d \rightarrow [a,b], f_w(x)=\sigma(w^Tx), \forall x\in R^d\}$, where $\sigma(\cdot)$ is a sigmoidal function (e.g. tanh, or sigmoid so it has ...
6
votes
0answers
69 views

In what sense is the Bayesian posterior mean a “convex combination”?

I asked this on math.stackexchange with no response, I'm hoping someone here might have something. Suppose I want to estimate $x \in \mathbb{R}^n$ from two signals with zero mean, normally ...
0
votes
1answer
59 views

Rademacher complexity of a Lipschitz class: Are the boundedness constraints necessary?

Consider the following function class: $F={f:R^d\rightarrow [a,b], f(x)=\sigma(w^Tx)}$ where $\sigma(.)$ is Lipschitz, and $w\in R^d$ is a parameter vector. The problem I'm working on is a machine ...
1
vote
0answers
38 views

Finding a general form of the density function when we have a four dimensional random variable

Consider a subject having time of the specific event $T_i$, which is a single sample from a distribution $F_i$ with density $f_i$ and support $[t_{\min},t_{\max}]$, for $i= 1,\ldots,n$. Let these ...
-1
votes
0answers
10 views

Spline surface data fitting with constraints [migrated]

I'm trying to smooth surface-fit experimental results on 2D domain (x,y), while maintaining common sensce physics-based constraints (monotonous, convex, etc.). current procedure is hand-draw lines ...
2
votes
1answer
176 views

Mutual information decrease with coarse-graining

Let $X,A,Y,B,C,D$ be random binary variables. $D$ is independent from $X,A,C$ and $C$ is independent from $Y,B,D$. Is it true that: If $I(Y:B|D=0)\leq \epsilon$ then $I(X\oplus Y:A\oplus ...
0
votes
1answer
78 views

Independence of Eigenvalues of Wishart

This question regards a previous post, but it is not immediately obvious the two are related, so I ask it anyways: are the eigenvalues of a Wishart matrix $\mathbf{S}$ $=$ ...
0
votes
1answer
84 views

Expectation of exp(-1/(ax^2)) when x is a standard normal variable and a>0 is a parameter [closed]

I would like to know if the mean value of $\exp(-1/(ax^2)) $ when $x \sim N(0,1)$ and $a>0$ is a parameter is known.
4
votes
1answer
90 views

Earth mover/Wasserstein distance between a pdf and an empirical distribution

This question is inspired by this much older question: Convergence of an empirical distribution w.r.t. the Hellinger distance Let $P$ be a continuous probability distribution on a compact subset of ...
0
votes
1answer
247 views

Size of KL-divergence neighbourhoods

I am new here. I was reading another post here and this got me wondering what can be said about the size of the following kl divergence neighborhoods. Consider these two kl-divergence neighbourhood ...
1
vote
5answers
867 views

Estimating the number of clusters

For a collection of points in $\mathbb{R}^n$, is there a statistic that I can compute which will estimate the number of clusters with some level of confidence?
6
votes
1answer
144 views

Closure of random rotations

Are matrix Fisher random variables closed under multiplication? For those unfamiliar with the jargon, let me unpack the terms above and repose my question. This is a question about probability ...
5
votes
3answers
275 views

A. Markov's papers?

A. Markov published several papers on his chains, starting in 1906, so it is written, in the journal: (1) Извѣстія Физико-математического общества при Казанском университете I am surprised by the ...
17
votes
5answers
2k views

Inference using Topological Data Analysis: Is it worth it for a regular statistician to learn TDA?

After having read Gunnar Carlsson's http://www.ams.org/journals/bull/2009-46-02/S0273-0979-09-01249-X/S0273-0979-09-01249-X.pdf I feel enthusiastic to use some topological data analysis (TDA) methods ...
3
votes
2answers
298 views

Consistent price index

This question came out of a discussion with a colleague from economics about price indices. Here is MattF's formulation of the question which differs somehow from the original problem. Let ...
17
votes
3answers
1k views

What is quantum Brownian motion?

It seems that the current state of quantum Brownian motion is ill-defined. The best survey I can find is this one by László Erdös, but the closest the quantum Brownian motion comes to appearing is in ...
2
votes
1answer
63 views

Proof for power-law tail of Poisson-Dirichlet distribution (Pitman-Yor process & Zipf's law)

I'm trying to understand the motivation of using Pitman-Yor (PY) processes in language modeling, in particular Teh's hierarchical LM based on PY processes. A motivation frequently stated in research ...
1
vote
0answers
45 views

Is there an efficient algorithm for sampling from the negative hypergeometric distribution? [closed]

I'm writing a small statistics library currently. One of the algorithms I'm implementing has two variants: one that samples the hypergeometric distribution and one that samples the negative ...
3
votes
2answers
81 views

Is a function of complete statistics again complete?

suppose $T$ is a complete stats for a parameter $\theta$. Is any function $f(T)$ again complete? It sounds weird but the definition seems to confirm that $f(T)$ is indeed complete..
1
vote
0answers
31 views

Bounds on Product of CDF or Beta function

I have functions of the form \begin{align} I_i = \int_0^\infty F_0(x)^aF_1(x)^b(1-F_0(x))^c(1-F_1(x))^ddF_i(x)~~~~i = 0,1 \end{align} $F_0(x)$ and $F_1(x)$ are CDFs corresponding to the random ...
2
votes
0answers
35 views

Mean and variance of a general multivariate skew normal distribution

I have a problem about a general multivariate skew normal distribution. There is a $p\times 1$ vector, $\mathbf{y}=(\mathbf{y}_1',\mathbf{y}_2',\ldots,\mathbf{y}_n')',p>n$, which has the density as ...
2
votes
1answer
51 views

Linear least squares with unordered response variable

In the classical linear regression model one considers the equation $$ y = X \beta + \epsilon.$$ I was wondering whether there are also results when the ordering of the response variable $y$ is not ...
0
votes
0answers
57 views

Correlation between spatial variables

I am trying to understand what type of statistical test I can use to check if two or more variables that vary spatially are correlated. Suppose I have data acquired inside a company building, e.g., ...
1
vote
1answer
54 views

How to extend Dirichlet distribution to Dirichlet process

For a Dirichlet process, there are two parameter $\alpha$ and $H$, and the Dirichlet process $X$ is defined as $$(X(B_1),\cdots,X(B_n))\sim Dir(\alpha H(B_1),\cdots,\alpha H(B_n))$$ ...
0
votes
0answers
21 views

Merging regions of function with similar mean and deviation using statistical test

I have got a question related to statistical tests that I would like to use in a new algorithm I am developing. Given an action space $x$, the algorithm would identify the regions in the function ...
0
votes
0answers
33 views

Distribution of Wishart Sample Eigenvalues for Multiple Roots

I am interested in finding an asymptotic approximation to the latent roots $l_1>\dots>l_p$ of a white noise Wishart matrix $nS\sim W_p(n,I)$ as $n\rightarrow\infty$ (where $p$ is fixed). In ...
2
votes
2answers
645 views

Proof of no unbiased estimation of standard deviation.

It is well known that for iid random variables $X_1, \ldots, X_n$ with variance $\sigma^2$ that $$\frac{1}{n-1} \sum_{i=1}^n (X_i - \overline X)^2$$ gives an unbiased estimator for $\sigma^2$, but ...
2
votes
1answer
59 views

Unbiased sample from a product

Let $X = (x_1,\ldots,x_n)$ be an i.i.d sample from distribution $F%$ and let $y = \prod_{i=1}^n x_i$ Can we derive a randomized, unbiased. estimator $\hat{y}$ of $y$ that on average considers only a ...
5
votes
2answers
281 views

Random Vornoi Diagrams (particular measures)

This is my second question about Random Voronoi diagrams, in my first question was given some excellent advice but i was not clear in explaining what i was looking for. I'm interested to know ...
8
votes
2answers
622 views

Random Voronoi Diagrams

I'm interested in what research has already been done with regards to the statistics of random voronoi diagrams. I have had a look on google scholar and results are a little inconclusive. I'm ...
2
votes
2answers
242 views

Distribution of a random walk on a directed line

Is there a closed formula for the distribution of $x_t$ in the following random process, describing a random walk on a directed line? $x_0 = n$ $x_t$ is a uniformly random integer between 1 and ...
1
vote
1answer
64 views

Distance between two distribution of image

I am looking for a common distance method to compare two distribution (ex: histogram of image). Please suggest to me some common method to do it. I found some method ex: Bhattacharyya distance , K-L ...
5
votes
0answers
75 views

Convergence of Maximum Likelihood Estimator

I apologize for the basic question. If $\{p_\theta(x): \theta\in K\subseteq\mathbb{R}\}$ is a smooth family of distributions, then the MLE $\hat{\theta}_n,$ under suitable regularity conditions ...
1
vote
1answer
25 views

Multivariate Rayleigh [closed]

What is the closed form formula (pdf) for a multivariate Rayleigh distribution. Is it - $x^T \Sigma^{-1} x \times \exp(\frac{-x^T \Sigma^{-1} x}{2})$ How do you prove it is from the exponential ...
3
votes
1answer
119 views

Two matrix Fisher distributions on SO(3)?

After the uniform distribution (normalized Haar measure), the matrix Fisher distribution seems to be the most popular probability distribution on the Lie group SO(3). The density is proportional to ...
2
votes
0answers
57 views

Weighted Kaplan-Meier estimator

Let two samples $(T_1, \ldots ,T_n)\sim F$ and $(C_1, \ldots ,C_n)\sim G$ are given, but not observed. Instead we observe $\tilde T_i = \min (T_i, C_i)$ and $\Delta _i = \mathbf{1}(T_i \leq C_i)$, ...
2
votes
2answers
226 views

Gaussian expectation of an exponentiated outer product

Given a normal random column vector $\mathbf{x} \sim N(\mu, \Sigma)$, I need the expectation, $$ E\left[ \exp(\mathbf{xx}^\top)\right]$$ where $\exp(\cdot)$ is element-wise exponential function (not ...
0
votes
0answers
61 views

Maximizing the “uniformity” of a probability measure, with constraints, via path length minimization

Background I want to find a probability measure for a continuous random variable, subject to moment constraints, that is maximally "uniform", as defined below: Definition: Maximally Uniform ...
1
vote
1answer
97 views

Markov chain Monte Carlo: why is non-reversible MC MC not as popular?

I am new to methods for simulating Markov chains in order to sample from the target, unknown distribution. After a couple days of reading, I found out that even though people have realized that ...