Theory and applications of probability and stochastic processes: e.g. central limit theorems, large deviations, stochastic differential equations, models from statistical mechanics, queuing theory.

learn more… | top users | synonyms (1)

4
votes
0answers
92 views

power laws emerging from the sandpile model

Is there a rigorous proof that the abelian sandpile model generates a power law distribution of avalanche lengths?
3
votes
1answer
172 views

Approximating by independent Poisson random variables

Using the Chen-Stein method, one can bound the total variation distance between a sum of possibly dependent Bernoulli random variables $W=\sum_{i=1}^n X_i$ and a Poisson distribution using only the ...
3
votes
1answer
162 views

When does the cumulative distribution function solve the Kolmogorov backward equation?

For a diffusion $X$ define the cumulative distribution function for $X_T$ started with $X_t=x$: $$u(t,x):=E^{t,x}(1_{X_T\ge y})$$ Under what conditions does $u$ solve $X$'s Kolmogorov backward ...
1
vote
0answers
61 views

Cauchy Problem and stochastic representation for discontinuous initial data

Where can I read more about the Cauchy problem, i.e. solutions to $$ \frac{\partial u}{\partial t}+Lu=0 \text{ and } u(0,x)=f(x)$$ for some elliptic differential operator $L$ where $f$ is not ...
1
vote
1answer
120 views

Does $E^{x,t}(f(X_T))$ solve a PDE if $f$ is not continuous?

Many books [see below for references] explore the connections between partial differential equations and expectation values. Assume $X$ is a diffusion with generator $A$, then they conclude, that ...
0
votes
0answers
77 views

an elementary proof without using K-convexity constant?

Suppose that $A$ is an $n\times d$ matrix $(n\gg d)$ with orthonormal columns, and $g\sim N(0,I_d)$. I wish to show that $$ \mathbb{E}\sup_{x:\|Ax\|_1 = 1} \langle g,x\rangle \lesssim \sqrt{\log ...
0
votes
1answer
82 views

Norm of matrix with randomly deleted entries

Let $A$ be an $n \times n$ matrix with real entries and let $B$ be the random matrix whose $(i,j)$ entry is $$B_{i,j}=v_{i,j}A_{i,j}$$ where the $v_{i,j}$ are i.i.d Bernoulli random variables with ...
1
vote
1answer
93 views

Variation of Markov Chain Convergence Theorem

Assume the chain $\{X_n\}_{n\in\mathbb{N}}$ on the statespace $(S,\mathcal{F})$ (we may assume it is countable) is aperiodic, irreducible and positive recurrent. We denote with $\pi$ its (unique) ...
0
votes
0answers
92 views

Log-concavity of convolution log-concave and not log concave density functions

Let $Z = X +Y $ be a random variable (r.v.) where $X$ and $Y$ are independent r.vs. If the density function of $X$ and $Y$, $f(x)$ and $g(x)$ are log-concave in the support of $X$ and $Y$, ...
4
votes
1answer
221 views

Square root of normal distribution

Let $X$ and $Y$ be independent random variates with the same probability distribution, $P(x)$. Assuming that the product $Z=XY$ is a random variate with normal distribution, say $$f_Z(x) = ...
1
vote
0answers
49 views

Approximate determinantal point process

Consider a random process defined on $2^{\mathcal{X}}$, i.e. all subsets of a set $\mathcal{X}$. It's well known that this process is determinantal if one can find a positive semidefinite matrix K, ...
3
votes
2answers
85 views

Existence of an invariant measure on an infinite dimensional space via Lyapunov functional

Set-up. Assume that we have a complete separable metric space $\mathcal{X}$ that is not locally compact. Let $V: \mathcal{x} \to [0; +\infty]$ be a functional such that $K_r :=\{x \in \mathcal {X} : V ...
0
votes
0answers
90 views

How to decide a value of learning rate for Stochastic Gradient Descent?

I'd like to know how to decide a value of learning rate for Stochastic Gradient Descent (SGD), such as $\eta$ on the following parameter update iteration equation, $w_{i+1} = w_i + -\eta \nabla ...
14
votes
1answer
633 views

In how many steps a random walk visits all the elements of a finite group, with a probability 1/2?

This question is a variation of the return to the origin problem. Let $G$ be the finite group $\mathbb{Z}/n \times \mathbb{Z}/n$ and let the random transformation $T: G \to G$ such that $T(a,b) = ...
2
votes
2answers
169 views

Does $X_n \xrightarrow{d} N(0,1)$ and $X_n/Y_n \xrightarrow{d} N(0,1)$ imply that $Y_n \xrightarrow{d} 1$?

I'm thinking about the following question: If $X_n$ and $X_n/Y_n$ both converge in distribution towards a standard Gaussian random variable and $Y_n \geq 0$ for all $n$, does then $Y_n$ necessarily ...
12
votes
3answers
474 views

Expected value of the minimum with limited independence

Imagine you sample $n$ number with replacement uniformly from the integers $1,\dots, n$. Let $X$ be the minimum of these samples. I am interested in $\mathbb{E}(X)$ but with a twist. All I know is ...
1
vote
0answers
37 views

Maximum likelihood estimation with several distributions

My question concerns using Maximum likelihood to estimate unknown parameters used by several (poisson) distributions. The parameters are the pairs $(a_1,b_1),\dots,(a_N,b_N)$, and for each pair ...
1
vote
1answer
247 views

The probability that a 2d continuous time random walk avoids the origin

I am trying to find a reference of a proof of a continuous time version of a result of Dvoretzky and Erdos from their paper "Some problems on random walk in space" that says the probability ...
1
vote
2answers
197 views

$\lim_{t\rightarrow 0}P\left(X_t >0\right)=\frac 1 2$ for continuous semimartingales?

I am trying to prove the following Lemma, which seems intuitive, but I still have doubts: Lemma Given a Brownian motion $\{W_t,\mathcal F_t:0\le t \le1\}$, two bounded processes, $\mu$ and $\sigma$, ...
2
votes
1answer
134 views

Diffusion in a bounded domain

Let us consider an $\mathbb{R}^d$ diffusion $$dX_t = dW_t +\mu(X_t)dt.$$ Let further $D\subset \mathbb{R}^d$ be a bounded connected open domain. By $Y^D$ we denote the diffusion $X$ restricted to ...
0
votes
0answers
38 views

Upper bound for chi-square divergence in terms of KL divergence

In my research I need an upper bound for chi-square divergence in terms KL divergence which works for general alphabets. To make this precise, note that for two probability measures $P$ and $Q$ ...
3
votes
1answer
88 views

Lower bound on the tail of the hypergeometric distribution

Suppose there is a bag with $M$ white marbles and $N - M$ black marbles. Let $H(n, N, M)$ be a random variable which is number of white marbles in a draw, without replacement, of $n$ marbles from a ...
1
vote
0answers
63 views

How to fit a stochastic matrix to given data.?

Given a data sequence of noisy observations of a 3-state Markov chain $X$ -- $y_1$,$y_2$,...$y_n$, with two transition matrices $A_1$ and $A_2$ corresponding to different regions (**) in the (unit) ...
5
votes
0answers
82 views

Support of a Measure with Characteristic Functional Continuous in $L_p$, $1\leq p <2$?

Let $\mathcal{S}(\mathbb{R})$ be the space of smooth and rapidly decaying functions and $\mathcal{S}'(\mathbb{R})$ its dual, the space of tempered distributions. Let $\mu$ be a probability measure ...
0
votes
1answer
155 views

Volume of randomly changing sphere follows beta distribution

We are given $X,X_1,\ldots,X_N$ independent and identically distributed $k$-dimensional vectors. For a given query point $X_q\in\mathbb{R}^k$ assume without loss of generality that $X_1,\ldots,X_m$ ...
3
votes
4answers
163 views

Central limit theorem with degenerate covariance matrix

Are there known generalisations of the central limit theorem for several random variables when the covariance matrix is degenerate? The usual proof of CLT based on characteristic functions (see e.g. ...
2
votes
0answers
117 views

Fixed area, largest mass — is there a name?

Let $x\in \mathbb{R}^n$ and let $s_k(x)$ denote the sum of the $k$ largest entries of $x$. The function $s_k(x)$ is well-known to be convex and is often used in optimization, such as ...
5
votes
3answers
285 views

A balls and urns model for a hashing problem

Fix $N \in \mathbb{N}$. Suppose we throw $N$ numbered balls into $N$ numbered urns, so that for each $b \in \{1,\ldots,N\}$, ball $b$ lands in urn $j$ with equal probability $1/N$. Choose a number $c ...
1
vote
1answer
210 views

Coupon Collector Problem for Non-Uniform Coupons: Bound on the number of missed Coupons

Suppose $\mathcal B=\{1,2,..,b\}$ is the set of all possible coupons, with $\mathbf p = ( p_1,p_2,...,p_b)$ assigning the probability of occurrence for all coupons in $\mathcal B$. The "traditional ...
4
votes
0answers
63 views

Can the GUE be thought of as a uniform point in a high-dimensional polytope

I have thought about this question for a long time and could only find partial answers. The Gaussian Unitary Ensemble (or GUE) is the eigenvalues of a random Hermitian matrix with complex Gaussian ...
0
votes
0answers
92 views

When an integral with respect to a Poisson point process is finite?

Let $N(ds,dv)$ be a Poisson measure on $\mathbb{R} _+ \times \mathbb{R} _+$ with intensity $dsdv$. Let $N = \sum\limits \delta_{(s_i,v_i)}$. Assume that $N$ is compatible with a filtration $\{ ...
-1
votes
1answer
99 views

When does a d.r.v. take a value very close to the mean? [closed]

Suppose that $X$ is a discrete random variable with values $x_{1},x_{2},\ldots,x_{n}$ (not known precisely, but there is some information available about the mean and variance). Is there a result ...
6
votes
4answers
364 views

Expected value of a function over random sets

I am doing an analysis on the complexity of some set-related algorithm where the input is a random set. One of my setbacks can be formulated as follows: Pick $k$ distinct numbers out of numbers ...
6
votes
1answer
460 views

Bound on the sum of arguments

Problem: Show that for all real $s,t,u$ and all complex $z$ with $|z|<1$ one has $$(*)\qquad \arg\frac{1-zf(s-u)}{1-zf(s+u)} +\arg\frac{1-zf(t+u)}{1-zf(t-u)}<\pi, $$ where $f$ is the ...
2
votes
0answers
72 views

Concentration bound in high min entropy distribution

Let $(X_{1},\dots,X_{m})$ be joint distribution on $\{0,1\}^{m}$ with that $H_{\infty}(X_{1},\cdots,X_{m})\geq m-r$, where $H_{\infty}$ means min-entropy. Let $P_{1},...,P_{n}\subseteq [m]$ be sets ...
5
votes
2answers
174 views

Rademacher average based Hoeffding Inequality

I am following these lecture notes: Given the i.i.d. $\mathcal{Z}$-valued random variables $Z_1,\dotsc,Z_m$ and $\mathcal{G}$ is a set of bounded functions $g\colon \mathcal{Z}\to[a,b]$. Corollary ...
1
vote
0answers
42 views

Shift invariance for the distribution of quadratic polynomials

For a probability distribution $X$, supported on integers, define the shift-invariance of $X$, denoted by $shift(X)$ = total variation distance between the random variable $X$ and $X+1$. Let ...
5
votes
1answer
186 views

Does independence of the sequence $f(A_i, B)$ imply the sequence is independent of $B$?

Suppose $B, \{A_i: i \in \omega\}$ are i.i.d. random variables with uniform distributions on $[0,1]$. If $f$ is a map such that $\{f(A_i, B): i \in \omega\}$ are independent, must $\{f(A_i, B): i \in ...
1
vote
0answers
41 views

Conditions on probability measure that generates non-void random polytope

Let $C$ be a non-void compact convex set in $\mathbb{R}^d$, and $\nu$ a probability measure on $C$. Then under what conditions on $C$ and $\nu$, the following statement is true: If ...
2
votes
0answers
128 views

Ticket lottery — distributing $n$ tickets among $N$ people fairly

Suppose that I have $n$ tickets for an event that I want to distribute fairly among $N > n$ people. In this simple case, a lottery suffices. But suppose certain groups of people want to attend ...
0
votes
0answers
77 views

Expected value of a stochastic integral expression

I am wondering if the following expression can be processed a bit analytically, $$ E \left[ e^{aX} \int_0^X e^{bu}dW(u)\right], $$ where $W_u$ is the normal Brownian motion (1D Wiener process), and ...
0
votes
0answers
43 views

Taking power of the integrand in a Riemann-Stieltjie Integral

This is a problem I am trying to solve as part of a calculation for Value-at-Risk. Given that $P(X<x)=F(x)=\int_{\theta}F(x|\theta)dG(\theta)=1-\alpha$, where $F$ and $G$ are CDF's, is there a ...
0
votes
0answers
64 views

Consistency Conditions of the Kolmogorov Extension Theorem

Kolmogorov's extension theorem allows for the construction of a variety of measures on infinite-dimensional spaces, and its conditions are supposedly "trivially satisfied by any stochastic process". ...
5
votes
1answer
144 views

Asymptotic behavior of $X_n$ in a Dirichlet vector $(X_1, …, X_n)$

Let $(\alpha_k)$ be a sequence of positive numbers and let $(Y_k)$ be a sequence of independent random variables $Y_k \sim \text{Gamma}(\alpha_k,1)$. Set $X_n=\dfrac{Y_n}{\sum_{i=1}^nY_i}$. (edit) ...
3
votes
2answers
202 views

Picking codewords that are close

I posted this question in http://math.stackexchange.com/questions/1142698/picking-codewords-that-are-close a week back. Let $[n,k,d]$ be a linear code over $\Bbb F_q$ with minimum distance $d$ and ...
2
votes
0answers
181 views

Inequality with CDF of order statistics

here is a problem I have been struggling with for a while now. This is for a paper I am working on. Any help would be appreciated! Here we go: Each bidder's valuation $\theta _{i},$ $i=1,...,N$, is ...
2
votes
1answer
119 views

Does $\int \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \to \Phi(u)$ imply that $f_t \to \delta_1$?

I'm looking at a family $(f_t)$ of densities of some continuous random variables and know that $$\int_{-\infty}^{\infty} \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \xrightarrow{t \to ...
1
vote
1answer
153 views

Change of time variable in Wiener process

I'm following a solution of an SDE from here http://www.math.ethz.ch/~delbaen/ftp/preprints/CEV.pdf Start with the SDE $$ dX_t = \delta dt + 2\sqrt{X_t} dW_t $$ consider a deterministic time change ...
0
votes
1answer
55 views

Stationary distribution of random walk alias solving uncountably many linear equations [closed]

Let us have interval $I = (i_1,i_2)$, function $f_1 : I \mapsto I$, function $f_2 : I \mapsto I$. Let $x_0$, $x_1$, $x_2$, ... be series of random variables from interval $I$ denoting random walk. ...
5
votes
2answers
345 views

Applications of cohomology to probability and statistics

Are there interesting/useful applications of cohomology (and homological algebra in general) to probability and statistics, or information theory? By "interesting/useful", I mean "not merely ...