All Questions
Tagged with measure-concentration stochastic-processes
38 questions
0
votes
1
answer
80
views
Uniform concentration bound (function-valued random variable / continuous stochastic process)
I'm trying to consider a probability space $\Omega$ and
$f(x,\xi):\mathcal{X}\times\Omega\to\mathbb{R}$ (stochastic process over space? or function-valued random variable?), where $\mathcal{X}\subset\...
- 321
2
votes
0
answers
84
views
Concentration result for self-normalized empirical process
In Theorem 1.1 of this paper by Bercu, Gassiat and Rio, a concentration result is derived for the 'self-normalized' empirical process. Specifically, suppose that $(X,X_n)_{n \ge 1}$ is a sequence of i....
- 206
4
votes
1
answer
189
views
Sign of error in the central limit theorem
Let $X_n$ and $Y_n$ be independent copies of two random variables $X$ and $Y$ with domain $\{-1,0,1\}$ for $n\in \mathbb{N}$. For a given $k\in \mathbb{N}$, I would like to find conditions on $X$ and $...
- 53
2
votes
1
answer
250
views
A concentration inequality related to suprema of sub-Gaussian processes
Let $x_1,\dots,x_n$ be deterministic points in some space $X$ and consider a class of real-valued functions $\mathcal G$ on $X$. We further assume that for any $g \in \mathcal G$,
$$
\Bigl(\frac1n \...
- 1,741
1
vote
0
answers
131
views
Large-deviation inequalities for a class of simple random multivariate polynomials
Let $N$ be a large positive integer and let $[N] := \{1,2,\ldots,N\}$. For any $k$, let $K_{N,k}$ denote the collection of $k$-element subsets of $[N]$. Let $x=(x_1,\ldots,x_N)$ be a uniformly random ...
- 6,853
1
vote
1
answer
288
views
Rate of convergence to uniform distribution
Let $p=(p(1),\ldots,p(N))$ be a discrete distribution on $[N]:=\{1,2,\ldots,N\}$ with full support (i.e all the $p(i)$'s are strictly positive and sum to $1$). Let $i_1,i_2,\ldots,i_T$ be an iid ...
- 6,853
1
vote
1
answer
191
views
concentration of random field to its expectation function
Question
Given a random field $X(t)$ where the parameter space $T\subset\mathbb{R}_N$. Is there result regarding the concentration of the random field? For example
$\mathbb{P}\{\|X(t)-\mathbb{E}\{X(t)\...
- 405
4
votes
2
answers
434
views
Rate of convergence of sample maximum, $\Big|\max_{j \leq n} |f(U_j)| - \|f\|_\infty\Big|$
Suppose that $f \colon [0, 1] \to \mathbb{R}$ is a $1$-Lipschitz function.
Define the uniform norm $\|f\|_\infty = \sup_{x} |f(x)|$.
Given $\{U_j\}_{j=1}^\infty$ independent and identically ...
- 380
2
votes
1
answer
150
views
Normalized concentration inequality for empirical CDF (iid sum)
Consider the empirical and population CDF,
$$
F_n(t) = \frac{1}{n} \sum_{i=1}^n 1\{X_i \leq t\} \quad \mbox{and} \quad
F(t) = \mathbb{E} [F_n(t)],
$$
where above $X_1, \dots, X_n$ are iid, real-...
- 380
1
vote
1
answer
229
views
Gaussian width of intersection of cube and ball in high-dimensional euclidean space
Let $d$ be a large positive integer and fix $r \ge 0$. Set $S := B_2^n \cap [-r,r]^d$, where $B_2^d$ is the euclidean unit-ball in $\mathbb R^d$. Finally, let $\omega(S)$ be the Gaussian width of $S$, ...
- 6,853
2
votes
0
answers
184
views
Sudakov's lower bound type inequality for supremum of Chi-squared random variables
Let $\varepsilon$ be $n$-dimensional standard Gaussian veector, i.e., $\varepsilon \sim N_n(0, I_n)$. Let $\mathcal{P}$ be a subset of symmetric projection matrices in $\mathbb{R}^{n \times n}$ with $|...
- 399
1
vote
1
answer
216
views
Rademacher complexity of function class $(x,y) \mapsto 1[|yf(x)-\alpha| \ge \beta]$ in terms of $\alpha$, $\beta$, and Rademacher complexity of $F$
Let $X$ be a measurable space and let $P$ be a probability distribution on $X \times \{\pm 1\}$. Let $F$ be a function class on $X$, i.e., a collection of (measurable) functions from $X$ to $\mathbb R$...
- 6,853
1
vote
1
answer
178
views
Tail bound on the RKHS norm of a zero-mean Gaussian process
Let $f \sim \mathcal{GP}(0, K)$ be a zero-mean Gaussian process defined on a compact set $\mathcal{D} \subset \mathbb{R}^d$, where $K \colon \mathcal{D} \times \mathcal{D} \rightarrow \mathbb{R} $ is ...
- 1,127
1
vote
0
answers
68
views
(Anti-)concentration of gap between largest and second largest component of multivariate random gaussian vector
Let $n$ be a large positive integer and let $Y=(Y_1,\ldots,Y_n)$ be a zero-centered random $n$-dmensional real vector with covariance matrix $\Sigma$, an $n$-by-$n$ positive definite matrix with ...
- 6,853
1
vote
1
answer
141
views
Central limit theorem for chi-squared random field on $\mathbb R^p$
Let $X:x \mapsto X(x)$ be a centered stationary Gaussian process on the $\Omega:=\mathbb R^p$, such that $X(x) \overset{d}{=}X(x')$ for all $x,x' \in \Omega$. Set $\sigma^2 := \mbox{Var}(X(0)) = \...
- 6,853
1
vote
1
answer
343
views
Concentration inequality for the supremum of $L_2$ norm of a vector-valued Gaussian process with iid components
Let $\Omega$ be a compact subset of $\mathbb R^p$ and let $f_1,\ldots,f_k$ be zero mean identically distrubuted Gaussian processes on $\Omega$ such that $f_1(x),\ldots,f_k(x)$ are independent $x \in \...
- 6,853
3
votes
0
answers
103
views
Concentration inequalities for gradient flows induced by random fields
Let $G=(G(x))_{x \in \mathbb R^m}$ be a conservative random field with values in $\mathbb R^m$, for large positive integer $m$. That is, there exists a scalar random field $g=(g(x))_{x \in \mathbb R^m}...
- 6,853
1
vote
0
answers
45
views
Chernoff-type Bounds for Continuous-space Markov Chains
Let $X_1, X_2, \dots, X_n$ be $n$ samples from a discrete-time continuous-space Markov Chain.
Are there any good references who have provided a Chernoff-type bound regarding the behaviour of the ...
- 143
1
vote
0
answers
110
views
Exponentially suppressed events for bounded difference super-martingales
Let $\{ Z_n \mid n = 0,1,..\}$ be a non-negative super-martingale and assume that it is of bounded difference i.e $\exists ~c_i >0$ s.t $\vert Z_{i+1} - Z_i \vert \leq c_i$. Then we know (Azuma-...
- 2,246
3
votes
1
answer
1k
views
Chernoff-type bound for sum of Bernoulli random variables, with outcome-dependent success probabilities
Let $X = (X_1, X_2, \ldots, X_n)$ be a sequence of (not necessarily independent) Bernoulli random variables where for each $i$, the success probability $\Pr[X_i = 1]$ itself is a random variable ...
- 153
0
votes
1
answer
273
views
Sum of sequences of random variables, with variable success probabilities
Consider two sequences of (not necessarily independent) Bernoulli random variables $X_1, X_2, \ldots, X_n$ and $Y_1, Y_2, \ldots, Y_n$. Suppose that for any $i$, we have $\Pr[X_i = 1] = \Pr[Y_i = 1] = ...
- 153
7
votes
3
answers
496
views
Chernoff-type bounds for a stopped sum of independent random variables
Let $Y_1, \ldots, Y_n$ and $X_1, \ldots, X_n$ be i.i.d. $p$-Bernoulli random variables and let $T \in \{0, \ldots, n\}$ be a stopping time for the process. From Wald's equation, we know
$$
E\left[\...
- 153
2
votes
2
answers
542
views
Chaining tail bound for centered sub-Gaussian process?
On page 5 of a recent manuscript by Lugosi-Mendelson, a claim equivalent to the following statement is made:
Suppose $Z$ is a centered, $\mathbf{R}^d$-valued random variable with $\mathbf{E} e^{\...
- 380
2
votes
1
answer
287
views
Bernstein Inequality for continous local martingale
I'm looking for a simple proof of the following fact, which is somehow Bernstein inequality in continuous time.
Let $(M_t)_{t\geq 0}$ be a continuous local martingale. Then :
$$P\left(\sup_{t\in [0,...
- 245
7
votes
1
answer
409
views
Do i.i.d. sums concentrate any faster than martingales?
Suppose $X_1,X_2, \ldots, X_N \in \mathbb R^d$ are random variables with each $\|X_n\|_2 \le 1/2$ (this choice of the constant simplifies later formulae).
The simplest concentration inequality I know ...
- 1,955
4
votes
1
answer
240
views
Uniform inequality of the form $\text{Proba}(\sup_{v \in [-M,M]^k}|p^Tv-\hat{p}_n^Tv| \le \epsilon_n) \ge 1 - \delta$
Let $M > 0$, $k$ be a positive integer, and $\mathcal V:=[-M,M]^k$. Finally, let $p \in \Delta_k$, (where $\Delta_k$ is the $(k-1)$-dimensional probability simplex) and let $\hat{p}_n$ be an ...
- 6,853
5
votes
0
answers
1k
views
Asymptotic behavior of row sums in 2-d array of random variables
Set-up. Let $f : \mathbb{N} \to \mathbb{N}$ be increasing. For each $m \in [0,1]$, consider an infinite two-dimensional array of random variables, where row $n$ has $f(n)$ variables:
$B^m_{1,1}$ $B^...
- 61
2
votes
1
answer
326
views
What is the Wiener measure of the curves with Hölder index $\frac 1 2$?
One may show that the Wiener measure (for curves in $\mathbb R^n$) is concentrated on the Hölder-continuous curves of Hölder index $< \frac 1 2$. What happens to the curves of Hölder index ...
- 5,407
3
votes
2
answers
319
views
Concentration inequality of joint event over time of a submartingale
Consider a discrete time submartingale $X_n$ with bounded difference $|X_n-X_{n-1}|\leq c$. With Azuma inequality we have the concentration of a single time event as
$$
P(X_t-X_0 \leq -t) \leq exp\...
- 185
2
votes
1
answer
508
views
Extension of Gordon's comparison inequality to subgaussian processes?
"Theorem A" in this paper by Y. Gordon:
http://www.math.uiuc.edu/~mjunge/Comps/Gordonm.pdf
is a comparison inequality for Gaussian processes:
Is there an analogue of this result for subgaussian ...
- 517
1
vote
0
answers
146
views
minimum eigenvalue of Katri-Rao product of two Gaussian matrices
Let $\mathbf{A}\in\mathbb{R}^{k\times n}$ and $\mathbf{B}\in\mathbb{R}^{d\times n}$ be independent matrices with i.i.d. $\mathcal{N}(0,1)$ entries. I'm interested in lower bounding the minimum ...
- 363
7
votes
2
answers
594
views
Large deviation/concentration inequality for submartingale
Let $S_t = M_t + D_t$ be the sum of a martingale $\left(M_t\right)_{t=1,2,\ldots}$ and a predictable process $(D_t)_{t=1,2,\ldots}$ such that the variance of the increments of $M$ is uniformly bounded ...
- 355
1
vote
0
answers
295
views
One-sided Talagrand concentration inequality for empirical processes
Let $\mathcal{F}$ denote a function class. A classic result by Talagrand states that
\begin{align*}
\mathbb{P}\bigg\{\sup_{f\in\mathcal{F}}\big|\sum_{i=1}^nf(X_i)-\mathbb{E}\big[\sum_{i=1}^nf(X_i)\...
- 859
7
votes
2
answers
606
views
Uniform Concentration Bounds on Weighted Sum of i.i.d. Bernoulli Random Variables
Let $\delta_1,...,\delta_n$ be $n$ independent identically distributed Bernoulli random variables with $\mathbb{P}(\delta_1=1)=p$. We consider a set $\Omega = \{\mathbf{a}:=(a_1,...,a_n)~|~a_i\in [0,c/...
- 71
4
votes
0
answers
417
views
concentration of functions of Gaussian processes
Let $\mathcal{C}\in\mathbb{R}^n$ be a subset of the unit ball. Also let $\mathbf{a}_1,\mathbf{a}_2,\ldots,\mathbf{a}_m\in\mathbb{R}^n$ be i.i.d. random Gaussian vectors $\mathcal{N}(\mathbf{0},\mathbf{...
- 859
1
vote
0
answers
611
views
Upper bound on expectations of the sum of product of a martingale difference sequence with a predictable sequence, weighted by certain random weights
Let $(\mathcal{F}_i)_{i\geq 1}$ be a filtration. Let $0\leq p_i\leq 1$, be a random variable measurable w.r.t. $\mathcal{F}_i$. Consider two sequences of random vectors $v_i\in\mathbb{R}^M,w_i\in\...
- 323
2
votes
1
answer
439
views
Upper bound on the maxima of ratio of expectation of quantities under Gaussian measure
Let $\lambda,\eta >0$ be given, and $u:\mathbb{R}\rightarrow \mathbb{R}$ be a real valued function. Define
$$\Delta(u)= \frac{\int u(h) \exp(-\eta u(h))\exp(-\frac{\lambda}{2}h^2)~\mathrm{d}h}{\...
- 323
5
votes
3
answers
901
views
Lower bound for Gaussian random vector with negative correlation
Let $X = (X_1,\ldots,X_n) \in \mathbb{R}^n$ be jointly Gaussian with mean $0$, covariance matrix: $Var(X_i) = 1$, $Cov(X_i, X_{i+1}) = -1/2$, and $Cov(X_i, X_j) = 0$ else.
Let $\zeta \in \mathbb{R}^...
- 1,010