Theory and applications of probability and stochastic processes: e.g. central limit theorems, large deviations, stochastic differential equations, models from statistical mechanics, queuing theory.

learn more… | top users | synonyms (1)

0
votes
1answer
75 views

Norm of matrix with randomly deleted entries

Let $A$ be an $n \times n$ matrix with real entries and let $B$ be the random matrix whose $(i,j)$ entry is $$B_{i,j}=v_{i,j}A_{i,j}$$ where the $v_{i,j}$ are i.i.d Bernoulli random variables with ...
-2
votes
0answers
50 views

can you use Bayes' rule twice? [migrated]

I'm trying to build a classifier, to model the likelihood of an event C, that depends on two other events, X and Y. I know that one can use Bayesian analysis if you have $P(X|C)$ and $P(Y|C)$ ...
1
vote
1answer
79 views

Variation of Markov Chain Convergence Theorem

Assume the chain $\{X_n\}_{n\in\mathbb{N}}$ on the statespace $(S,\mathcal{F})$ (we may assume it is countable) is aperiodic, irreducible and positive recurrent. We denote with $\pi$ its (unique) ...
0
votes
0answers
14 views

Urn Ball Game - $m$ urns $n$ players Expected number of rounds the game to be played to get all the players selected [migrated]

This is an urn-ball game. There is a coordinator and there are $m$ urns and $n$ players. Each player has got one ball each. The game happens in rounds. In a specific round the users throw balls at ...
0
votes
0answers
53 views

Log-concavity of convolution log-concave and not log concave density functions

Let $Z = X +Y $ be a random variable (r.v.) where $X$ and $Y$ are independent r.vs. If the density function of $X$ and $Y$, $f(x)$ and $g(x)$ are log-concave in the support of $X$ and $Y$, ...
4
votes
1answer
190 views

Square root of normal distribution

Let $X$ and $Y$ be independent random variates with the same probability distribution, $P(x)$. Assuming that the product $Z=XY$ is a random variate with normal distribution, say $$f_Z(x) = ...
0
votes
0answers
26 views

How do I compute the variance of expected number of fair coin flips for HTH sequence using linear system of equations? [migrated]

Assuming fair coin flips, I know how to compute the expected number of coin flips to see HTH sequence by writing out the linear system of equations from the state transition diagram below. ...
1
vote
0answers
40 views

Approximate determinantal point process

Consider a random process defined on $2^{\mathcal{X}}$, i.e. all subsets of a set $\mathcal{X}$. It's well known that this process is determinantal if one can find a positive semidefinite matrix K, ...
1
vote
0answers
37 views

Existence of an invariant measure on an infinite dimensional space via Lyapunov functional

Set-up. Assume that we have a complete separable metric space $\mathcal{X}$ that is not locally compact. Let $V: \mathcal{x} \to [0; +\infty]$ be a functional such that $K_r :=\{x \in \mathcal {X} : V ...
0
votes
0answers
83 views

How to decide a value of learning rate for Stochastic Gradient Descent?

I'd like to know how to decide a value of learning rate for Stochastic Gradient Descent (SGD), such as $\eta$ on the following parameter update iteration equation, $w_{i+1} = w_i + -\eta \nabla ...
14
votes
1answer
590 views

In how many steps a random walk visits all the elements of a finite group, with a probability 1/2?

This question is a variation of the return to the origin problem. Let $G$ be the finite group $\mathbb{Z}/n \times \mathbb{Z}/n$ and let the random transformation $T: G \to G$ such that $T(a,b) = ...
2
votes
2answers
164 views

Does $X_n \xrightarrow{d} N(0,1)$ and $X_n/Y_n \xrightarrow{d} N(0,1)$ imply that $Y_n \xrightarrow{d} 1$?

I'm thinking about the following question: If $X_n$ and $X_n/Y_n$ both converge in distribution towards a standard Gaussian random variable and $Y_n \geq 0$ for all $n$, does then $Y_n$ necessarily ...
12
votes
3answers
430 views

Expected value of the minimum with limited independence

Imagine you sample $n$ number with replacement uniformly from the integers $1,\dots, n$. Let $X$ be the minimum of these samples. I am interested in $\mathbb{E}(X)$ but with a twist. All I know is ...
1
vote
0answers
33 views

Maximum likelihood estimation with several distributions

My question concerns using Maximum likelihood to estimate unknown parameters used by several (poisson) distributions. The parameters are the pairs $(a_1,b_1),\dots,(a_N,b_N)$, and for each pair ...
1
vote
1answer
233 views

The probability that a 2d continuous time random walk avoids the origin

I am trying to find a reference of a proof of a continuous time version of a result of Dvoretzky and Erdos from their paper "Some problems on random walk in space" that says the probability ...
1
vote
2answers
188 views

$\lim_{t\rightarrow 0}P\left(X_t >0\right)=\frac 1 2$ for continuous semimartingales?

I am trying to prove the following Lemma, which seems intuitive, but I still have doubts: Lemma Given a Brownian motion $\{W_t,\mathcal F_t:0\le t \le1\}$, two bounded processes, $\mu$ and $\sigma$, ...
2
votes
1answer
131 views

Diffusion in a bounded domain

Let us consider an $\mathbb{R}^d$ diffusion $$dX_t = dW_t +\mu(X_t)dt.$$ Let further $D\subset \mathbb{R}^d$ be a bounded connected open domain. By $Y^D$ we denote the diffusion $X$ restricted to ...
0
votes
0answers
34 views

Upper bound for chi-square divergence in terms of KL divergence

In my research I need an upper bound for chi-square divergence in terms KL divergence which works for general alphabets. To make this precise, note that for two probability measures $P$ and $Q$ ...
3
votes
1answer
74 views

Lower bound on the tail of the hypergeometric distribution

Suppose there is a bag with $M$ white marbles and $N - M$ black marbles. Let $H(n, N, M)$ be a random variable which is number of white marbles in a draw, without replacement, of $n$ marbles from a ...
1
vote
0answers
58 views

How to fit a stochastic matrix to given data.?

Given a data sequence of noisy observations of a 3-state Markov chain $X$ -- $y_1$,$y_2$,...$y_n$, with two transition matrices $A_1$ and $A_2$ corresponding to different regions (**) in the (unit) ...
5
votes
0answers
76 views

Support of a Measure with Characteristic Functional Continuous in $L_p$, $1\leq p <2$?

Let $\mathcal{S}(\mathbb{R})$ be the space of smooth and rapidly decaying functions and $\mathcal{S}'(\mathbb{R})$ its dual, the space of tempered distributions. Let $\mu$ be a probability measure ...
0
votes
1answer
146 views

Volume of randomly changing sphere follows beta distribution

We are given $X,X_1,\ldots,X_N$ independent and identically distributed $k$-dimensional vectors. For a given query point $X_q\in\mathbb{R}^k$ assume without loss of generality that $X_1,\ldots,X_m$ ...
3
votes
4answers
154 views

Central limit theorem with degenerate covariance matrix

Are there known generalisations of the central limit theorem for several random variables when the covariance matrix is degenerate? The usual proof of CLT based on characteristic functions (see e.g. ...
2
votes
0answers
115 views

Fixed area, largest mass — is there a name?

Let $x\in \mathbb{R}^n$ and let $s_k(x)$ denote the sum of the $k$ largest entries of $x$. The function $s_k(x)$ is well-known to be convex and is often used in optimization, such as ...
5
votes
3answers
273 views

A balls and urns model for a hashing problem

Fix $N \in \mathbb{N}$. Suppose we throw $N$ numbered balls into $N$ numbered urns, so that for each $b \in \{1,\ldots,N\}$, ball $b$ lands in urn $j$ with equal probability $1/N$. Choose a number $c ...
1
vote
1answer
177 views

Coupon Collector Problem for Non-Uniform Coupons: Bound on the number of missed Coupons

Suppose $\mathcal B=\{1,2,..,b\}$ is the set of all possible coupons, with $\mathbf p = ( p_1,p_2,...,p_b)$ assigning the probability of occurrence for all coupons in $\mathcal B$. The "traditional ...
4
votes
0answers
59 views

Can the GUE be thought of as a uniform point in a high-dimensional polytope

I have thought about this question for a long time and could only find partial answers. The Gaussian Unitary Ensemble (or GUE) is the eigenvalues of a random Hermitian matrix with complex Gaussian ...
0
votes
0answers
87 views

When an integral with respect to a Poisson point process is finite?

Let $N(ds,dv)$ be a Poisson measure on $\mathbb{R} _+ \times \mathbb{R} _+$ with intensity $dsdv$. Let $N = \sum\limits \delta_{(s_i,v_i)}$. Assume that $N$ is compatible with a filtration $\{ ...
-1
votes
1answer
96 views

When does a d.r.v. take a value very close to the mean? [closed]

Suppose that $X$ is a discrete random variable with values $x_{1},x_{2},\ldots,x_{n}$ (not known precisely, but there is some information available about the mean and variance). Is there a result ...
6
votes
4answers
356 views

Expected value of a function over random sets

I am doing an analysis on the complexity of some set-related algorithm where the input is a random set. One of my setbacks can be formulated as follows: Pick $k$ distinct numbers out of numbers ...
6
votes
1answer
457 views

Bound on the sum of arguments

Problem: Show that for all real $s,t,u$ and all complex $z$ with $|z|<1$ one has $$(*)\qquad \arg\frac{1-zf(s-u)}{1-zf(s+u)} +\arg\frac{1-zf(t+u)}{1-zf(t-u)}<\pi, $$ where $f$ is the ...
2
votes
0answers
72 views

Concentration bound in high min entropy distribution

Let $(X_{1},\dots,X_{m})$ be joint distribution on $\{0,1\}^{m}$ with that $H_{\infty}(X_{1},\cdots,X_{m})\geq m-r$, where $H_{\infty}$ means min-entropy. Let $P_{1},...,P_{n}\subseteq [m]$ be sets ...
5
votes
2answers
172 views

Rademacher average based Hoeffding Inequality

I am following these lecture notes: Given the i.i.d. $\mathcal{Z}$-valued random variables $Z_1,\dotsc,Z_m$ and $\mathcal{G}$ is a set of bounded functions $g\colon \mathcal{Z}\to[a,b]$. Corollary ...
1
vote
0answers
42 views

Shift invariance for the distribution of quadratic polynomials

For a probability distribution $X$, supported on integers, define the shift-invariance of $X$, denoted by $shift(X)$ = total variation distance between the random variable $X$ and $X+1$. Let ...
5
votes
1answer
178 views

Does independence of the sequence $f(A_i, B)$ imply the sequence is independent of $B$?

Suppose $B, \{A_i: i \in \omega\}$ are i.i.d. random variables with uniform distributions on $[0,1]$. If $f$ is a map such that $\{f(A_i, B): i \in \omega\}$ are independent, must $\{f(A_i, B): i \in ...
1
vote
0answers
40 views

Conditions on probability measure that generates non-void random polytope

Let $C$ be a non-void compact convex set in $\mathbb{R}^d$, and $\nu$ a probability measure on $C$. Then under what conditions on $C$ and $\nu$, the following statement is true: If ...
2
votes
0answers
124 views

Ticket lottery — distributing $n$ tickets among $N$ people fairly

Suppose that I have $n$ tickets for an event that I want to distribute fairly among $N > n$ people. In this simple case, a lottery suffices. But suppose certain groups of people want to attend ...
0
votes
0answers
62 views

Expected value of a stochastic integral expression

I am wondering if the following expression can be processed a bit analytically, $$ E \left[ e^{aX} \int_0^X e^{bu}dW(u)\right], $$ where $W_u$ is the normal Brownian motion (1D Wiener process), and ...
0
votes
0answers
41 views

Taking power of the integrand in a Riemann-Stieltjie Integral

This is a problem I am trying to solve as part of a calculation for Value-at-Risk. Given that $P(X<x)=F(x)=\int_{\theta}F(x|\theta)dG(\theta)=1-\alpha$, where $F$ and $G$ are CDF's, is there a ...
0
votes
0answers
59 views

Consistency Conditions of the Kolmogorov Extension Theorem

Kolmogorov's extension theorem allows for the construction of a variety of measures on infinite-dimensional spaces, and its conditions are supposedly "trivially satisfied by any stochastic process". ...
5
votes
1answer
135 views

Asymptotic behavior of $X_n$ in a Dirichlet vector $(X_1, …, X_n)$

Let $(\alpha_k)$ be a sequence of positive numbers and let $(Y_k)$ be a sequence of independent random variables $Y_k \sim \text{Gamma}(\alpha_k,1)$. Set $X_n=\dfrac{Y_n}{\sum_{i=1}^nY_i}$. (edit) ...
3
votes
2answers
198 views

Picking codewords that are close

I posted this question in http://math.stackexchange.com/questions/1142698/picking-codewords-that-are-close a week back. Let $[n,k,d]$ be a linear code over $\Bbb F_q$ with minimum distance $d$ and ...
2
votes
0answers
157 views

Inequality with CDF of order statistics

here is a problem I have been struggling with for a while now. This is for a paper I am working on. Any help would be appreciated! Here we go: Each bidder's valuation $\theta _{i},$ $i=1,...,N$, is ...
2
votes
1answer
117 views

Does $\int \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \to \Phi(u)$ imply that $f_t \to \delta_1$?

I'm looking at a family $(f_t)$ of densities of some continuous random variables and know that $$\int_{-\infty}^{\infty} \Phi \left( \frac{u}{\xi} \right) f_t(\xi) \mathrm{d} \xi \xrightarrow{t \to ...
1
vote
1answer
124 views

Change of time variable in Wiener process

I'm following a solution of an SDE from here http://www.math.ethz.ch/~delbaen/ftp/preprints/CEV.pdf Start with the SDE $$ dX_t = \delta dt + 2\sqrt{X_t} dW_t $$ consider a deterministic time change ...
0
votes
1answer
53 views

Stationary distribution of random walk alias solving uncountably many linear equations [closed]

Let us have interval $I = (i_1,i_2)$, function $f_1 : I \mapsto I$, function $f_2 : I \mapsto I$. Let $x_0$, $x_1$, $x_2$, ... be series of random variables from interval $I$ denoting random walk. ...
5
votes
2answers
329 views

Applications of cohomology to probability and statistics

Are there interesting/useful applications of cohomology (and homological algebra in general) to probability and statistics, or information theory? By "interesting/useful", I mean "not merely ...
3
votes
0answers
52 views

Sample based inversion of the Radon transform

I have a classic tomography problem in which I would like to infer the internal density $p_0: \mathbb R^2 \to \mathbb R$ from external Radon projections. The internal density however is viewed as a ...
4
votes
0answers
65 views

“One sided” fast times of Brownian motion

Let $B_t$, $t \in [0,1]$ be a standard Brownian motion. We call a time $t$ fast up if $$ \limsup_{h \searrow 0} \frac{B(t+h) - B(t)}{\sqrt{2 h \ln(1/h)}} =1. $$ (Note the absence of absolute value ...
0
votes
0answers
36 views

minimal entropy approximation of a truncated discrete measure

Consider a measure $\mu$ on $\mathbb{N}$ given by the sequence $(\mu(n))_{n \geq 0}$ with $\mu(0)>0$. For example $\mu(n)=n^2+1$ on the figure below. For each $n$, let $X_n \sim \mu(\cdot \mid ...