Theory and applications of probability and stochastic processes: e.g. central limit theorems, large deviations, stochastic differential equations, models from statistical mechanics, queuing theory.

learn more… | top users | synonyms (1)

3
votes
2answers
93 views

Existence of an invariant measure on an infinite dimensional space via Lyapunov functional

Set-up. Assume that we have a complete separable metric space $\mathcal{X}$ that is not locally compact. Let $V: \mathcal{x} \to [0; +\infty]$ be a functional such that $K_r :=\{x \in \mathcal {X} : V ...
0
votes
0answers
99 views

How to decide a value of learning rate for Stochastic Gradient Descent?

I'd like to know how to decide a value of learning rate for Stochastic Gradient Descent (SGD), such as $\eta$ on the following parameter update iteration equation, $w_{i+1} = w_i + -\eta \nabla ...
14
votes
1answer
673 views

In how many steps a random walk visits all the elements of a finite group, with a probability 1/2?

This question is a variation of the return to the origin problem. Let $G$ be the finite group $\mathbb{Z}/n \times \mathbb{Z}/n$ and let the random transformation $T: G \to G$ such that $T(a,b) = ...
2
votes
2answers
174 views

Does $X_n \xrightarrow{d} N(0,1)$ and $X_n/Y_n \xrightarrow{d} N(0,1)$ imply that $Y_n \xrightarrow{d} 1$?

I'm thinking about the following question: If $X_n$ and $X_n/Y_n$ both converge in distribution towards a standard Gaussian random variable and $Y_n \geq 0$ for all $n$, does then $Y_n$ necessarily ...
12
votes
3answers
499 views

Expected value of the minimum with limited independence

Imagine you sample $n$ number with replacement uniformly from the integers $1,\dots, n$. Let $X$ be the minimum of these samples. I am interested in $\mathbb{E}(X)$ but with a twist. All I know is ...
1
vote
0answers
41 views

Maximum likelihood estimation with several distributions

My question concerns using Maximum likelihood to estimate unknown parameters used by several (poisson) distributions. The parameters are the pairs $(a_1,b_1),\dots,(a_N,b_N)$, and for each pair ...
1
vote
1answer
260 views

The probability that a 2d continuous time random walk avoids the origin

I am trying to find a reference of a proof of a continuous time version of a result of Dvoretzky and Erdos from their paper "Some problems on random walk in space" that says the probability ...
1
vote
2answers
207 views

$\lim_{t\rightarrow 0}P\left(X_t >0\right)=\frac 1 2$ for continuous semimartingales?

I am trying to prove the following Lemma, which seems intuitive, but I still have doubts: Lemma Given a Brownian motion $\{W_t,\mathcal F_t:0\le t \le1\}$, two bounded processes, $\mu$ and $\sigma$, ...
2
votes
1answer
137 views

Diffusion in a bounded domain

Let us consider an $\mathbb{R}^d$ diffusion $$dX_t = dW_t +\mu(X_t)dt.$$ Let further $D\subset \mathbb{R}^d$ be a bounded connected open domain. By $Y^D$ we denote the diffusion $X$ restricted to ...
0
votes
0answers
48 views

Upper bound for chi-square divergence in terms of KL divergence

In my research I need an upper bound for chi-square divergence in terms KL divergence which works for general alphabets. To make this precise, note that for two probability measures $P$ and $Q$ ...
3
votes
1answer
95 views

Lower bound on the tail of the hypergeometric distribution

Suppose there is a bag with $M$ white marbles and $N - M$ black marbles. Let $H(n, N, M)$ be a random variable which is number of white marbles in a draw, without replacement, of $n$ marbles from a ...
1
vote
0answers
65 views

How to fit a stochastic matrix to given data.?

Given a data sequence of noisy observations of a 3-state Markov chain $X$ -- $y_1$,$y_2$,...$y_n$, with two transition matrices $A_1$ and $A_2$ corresponding to different regions (**) in the (unit) ...
5
votes
0answers
85 views

Support of a Measure with Characteristic Functional Continuous in $L_p$, $1\leq p <2$?

Let $\mathcal{S}(\mathbb{R})$ be the space of smooth and rapidly decaying functions and $\mathcal{S}'(\mathbb{R})$ its dual, the space of tempered distributions. Let $\mu$ be a probability measure ...
0
votes
1answer
159 views

Volume of randomly changing sphere follows beta distribution

We are given $X,X_1,\ldots,X_N$ independent and identically distributed $k$-dimensional vectors. For a given query point $X_q\in\mathbb{R}^k$ assume without loss of generality that $X_1,\ldots,X_m$ ...
3
votes
4answers
176 views

Central limit theorem with degenerate covariance matrix

Are there known generalisations of the central limit theorem for several random variables when the covariance matrix is degenerate? The usual proof of CLT based on characteristic functions (see e.g. ...
2
votes
0answers
118 views

Fixed area, largest mass — is there a name?

Let $x\in \mathbb{R}^n$ and let $s_k(x)$ denote the sum of the $k$ largest entries of $x$. The function $s_k(x)$ is well-known to be convex and is often used in optimization, such as ...
5
votes
3answers
295 views

A balls and urns model for a hashing problem

Fix $N \in \mathbb{N}$. Suppose we throw $N$ numbered balls into $N$ numbered urns, so that for each $b \in \{1,\ldots,N\}$, ball $b$ lands in urn $j$ with equal probability $1/N$. Choose a number $c ...
1
vote
1answer
217 views

Coupon Collector Problem for Non-Uniform Coupons: Bound on the number of missed Coupons

Suppose $\mathcal B=\{1,2,..,b\}$ is the set of all possible coupons, with $\mathbf p = ( p_1,p_2,...,p_b)$ assigning the probability of occurrence for all coupons in $\mathcal B$. The "traditional ...
4
votes
0answers
64 views

Can the GUE be thought of as a uniform point in a high-dimensional polytope

I have thought about this question for a long time and could only find partial answers. The Gaussian Unitary Ensemble (or GUE) is the eigenvalues of a random Hermitian matrix with complex Gaussian ...
0
votes
0answers
98 views

When an integral with respect to a Poisson point process is finite?

Let $N(ds,dv)$ be a Poisson measure on $\mathbb{R} _+ \times \mathbb{R} _+$ with intensity $dsdv$. Let $N = \sum\limits \delta_{(s_i,v_i)}$. Assume that $N$ is compatible with a filtration $\{ ...
-1
votes
1answer
104 views

When does a d.r.v. take a value very close to the mean? [closed]

Suppose that $X$ is a discrete random variable with values $x_{1},x_{2},\ldots,x_{n}$ (not known precisely, but there is some information available about the mean and variance). Is there a result ...
6
votes
4answers
375 views

Expected value of a function over random sets

I am doing an analysis on the complexity of some set-related algorithm where the input is a random set. One of my setbacks can be formulated as follows: Pick $k$ distinct numbers out of numbers ...
6
votes
1answer
464 views

Bound on the sum of arguments

Problem: Show that for all real $s,t,u$ and all complex $z$ with $|z|<1$ one has $$(*)\qquad \arg\frac{1-zf(s-u)}{1-zf(s+u)} +\arg\frac{1-zf(t+u)}{1-zf(t-u)}<\pi, $$ where $f$ is the ...
2
votes
0answers
72 views

Concentration bound in high min entropy distribution

Let $(X_{1},\dots,X_{m})$ be joint distribution on $\{0,1\}^{m}$ with that $H_{\infty}(X_{1},\cdots,X_{m})\geq m-r$, where $H_{\infty}$ means min-entropy. Let $P_{1},...,P_{n}\subseteq [m]$ be sets ...
5
votes
2answers
182 views

Rademacher average based Hoeffding Inequality

I am following these lecture notes: Given the i.i.d. $\mathcal{Z}$-valued random variables $Z_1,\dotsc,Z_m$ and $\mathcal{G}$ is a set of bounded functions $g\colon \mathcal{Z}\to[a,b]$. Corollary ...
1
vote
0answers
42 views

Shift invariance for the distribution of quadratic polynomials

For a probability distribution $X$, supported on integers, define the shift-invariance of $X$, denoted by $shift(X)$ = total variation distance between the random variable $X$ and $X+1$. Let ...
5
votes
1answer
187 views

Does independence of the sequence $f(A_i, B)$ imply the sequence is independent of $B$?

Suppose $B, \{A_i: i \in \omega\}$ are i.i.d. random variables with uniform distributions on $[0,1]$. If $f$ is a map such that $\{f(A_i, B): i \in \omega\}$ are independent, must $\{f(A_i, B): i \in ...
1
vote
0answers
43 views

Conditions on probability measure that generates non-void random polytope

Let $C$ be a non-void compact convex set in $\mathbb{R}^d$, and $\nu$ a probability measure on $C$. Then under what conditions on $C$ and $\nu$, the following statement is true: If ...
2
votes
0answers
129 views

Ticket lottery — distributing $n$ tickets among $N$ people fairly

Suppose that I have $n$ tickets for an event that I want to distribute fairly among $N > n$ people. In this simple case, a lottery suffices. But suppose certain groups of people want to attend ...
0
votes
0answers
106 views

Expected value of a stochastic integral expression

I am wondering if the following expression can be processed a bit analytically, $$ E \left[ e^{aX} \int_0^X e^{bu}dW(u)\right], $$ where $W_u$ is the normal Brownian motion (1D Wiener process), and ...
0
votes
0answers
43 views

Taking power of the integrand in a Riemann-Stieltjie Integral

This is a problem I am trying to solve as part of a calculation for Value-at-Risk. Given that $P(X<x)=F(x)=\int_{\theta}F(x|\theta)dG(\theta)=1-\alpha$, where $F$ and $G$ are CDF's, is there a ...
5
votes
1answer
148 views

Asymptotic behavior of $X_n$ in a Dirichlet vector $(X_1, …, X_n)$

Let $(\alpha_k)$ be a sequence of positive numbers and let $(Y_k)$ be a sequence of independent random variables $Y_k \sim \text{Gamma}(\alpha_k,1)$. Set $X_n=\dfrac{Y_n}{\sum_{i=1}^nY_i}$. (edit) ...
3
votes
2answers
204 views

Picking codewords that are close

I posted this question in http://math.stackexchange.com/questions/1142698/picking-codewords-that-are-close a week back. Let $[n,k,d]$ be a linear code over $\Bbb F_q$ with minimum distance $d$ and ...
2
votes
0answers
183 views

Inequality with CDF of order statistics

here is a problem I have been struggling with for a while now. This is for a paper I am working on. Any help would be appreciated! Here we go: Each bidder's valuation $\theta _{i},$ $i=1,...,N$, is ...
2
votes
1answer
119 views

Does $\int \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \to \Phi(u)$ imply that $f_t \to \delta_1$?

I'm looking at a family $(f_t)$ of densities of some continuous random variables and know that $$\int_{-\infty}^{\infty} \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \xrightarrow{t \to ...
1
vote
1answer
174 views

Change of time variable in Wiener process

I'm following a solution of an SDE from here http://www.math.ethz.ch/~delbaen/ftp/preprints/CEV.pdf Start with the SDE $$ dX_t = \delta dt + 2\sqrt{X_t} dW_t $$ consider a deterministic time change ...
0
votes
1answer
58 views

Stationary distribution of random walk alias solving uncountably many linear equations [closed]

Let us have interval $I = (i_1,i_2)$, function $f_1 : I \mapsto I$, function $f_2 : I \mapsto I$. Let $x_0$, $x_1$, $x_2$, ... be series of random variables from interval $I$ denoting random walk. ...
5
votes
2answers
357 views

Applications of cohomology to probability and statistics

Are there interesting/useful applications of cohomology (and homological algebra in general) to probability and statistics, or information theory? By "interesting/useful", I mean "not merely ...
3
votes
0answers
57 views

Sample based inversion of the Radon transform

I have a classic tomography problem in which I would like to infer the internal density $p_0: \mathbb R^2 \to \mathbb R$ from external Radon projections. The internal density however is viewed as a ...
4
votes
0answers
68 views

“One sided” fast times of Brownian motion

Let $B_t$, $t \in [0,1]$ be a standard Brownian motion. We call a time $t$ fast up if $$ \limsup_{h \searrow 0} \frac{B(t+h) - B(t)}{\sqrt{2 h \ln(1/h)}} =1. $$ (Note the absence of absolute value ...
0
votes
0answers
40 views

minimal entropy approximation of a truncated discrete measure

Consider a measure $\mu$ on $\mathbb{N}$ given by the sequence $(\mu(n))_{n \geq 0}$ with $\mu(0)>0$. For example $\mu(n)=n^2+1$ on the figure below. For each $n$, let $X_n \sim \mu(\cdot \mid ...
3
votes
2answers
301 views

Weak convergence of random measures

Let $\mu_n,n\in \mathbb N$ be a random probability measures and let $\mu$ be a deterministic probability measure on $\mathbb R$. That is to say, that the $\mu_n$ are measurable maps from a probability ...
2
votes
0answers
93 views

Equivalence of two non-degenerate Gaussian measures on Banach space

The motivation of this question is to show that two probabilities on $C_{0}^{n}(0,1)$ (the space of continuous $\mathbb R^{n}$ valued process on $[0,1]$ starting from zero) induced by two ...
6
votes
0answers
79 views

Rate of Convergence of Compound Poisson Laws to Infinitely Divisible Laws

It is known that every infinitely divisible random variable is the limit in law of a sequence of compound Poisson random variables (see for instance Theorem 1.2.18 of Lévy Processes and Stochastic ...
4
votes
1answer
151 views

Orlicz Norm and A result on expectation

I am reading paper which is mainly about Dobrushin's contraction coefficient and its generalization. In page 27, the following is defined: Consider arbitrary, non-negative, convex function ...
4
votes
1answer
191 views

Is the space of Radon measures a Prohorov space?

Consider the spaces $C_c(\mathbb{R})$ of compactly supported continuous functions equipped with the inductive limit topology and the Banach space $C_0(\mathbb{R}) = \overline{C_c(\mathbb{R})}^{\, ...
1
vote
0answers
96 views

Occupancy problem with limited capacity and two types of balls [closed]

I am considering the following problem that I suspect to be standard. One has a set of $N$ balls composed of a fraction $\alpha$ of red balls and $(1-\alpha)$ of black balls (we assume $\alpha N$ is ...
7
votes
1answer
174 views

Defining functions pointwise vs. almost everywhere (w.r.t. uncountably many mutually singular measures)

My question is motivated by a general measure-theoretic problem that one frequently encounters in probability: the need to work with uncountably many mutually singular measures at once, and with ...
2
votes
1answer
78 views

distance to median in terms of $L_1$ variance

Suppose that $X$ is a random variable with finite first moment and median $m$. Let $X'$ be an independent copy of $X$. What inequalities relate $E|X-X'|$ and $E|X-m|$? What is the best lower bound on ...
10
votes
2answers
332 views

An inequality for copulas

Suppose that $f$ from $[0,\infty]$ onto $[0,1]$ is completely monotonic on $(0,\infty)$, and let $g$ be the inverse of $f$. For $(u,v)$ in $[0,1]^{2}$, define $C(u,v) = f(g(u)+g(v))$, and let $a = ...