A stochastic process is a collection of random variables usually indexed by a totally ordered set.

learn more… | top users | synonyms

-1
votes
0answers
28 views

void probability for Poisson point process

Assume we have a Poisson point process (PPP) on 2D space with density $\lambda$. Let $d_i$ be the distance of each node respect to the origin. Assume that we mark each point $i$, independent of other ...
0
votes
0answers
19 views

Construction of a path of quadratic variation

This question has been posted to Stack Exchange earlier, and no answer is available yet. Consider a path $x: [0,1] \to \mathbb R$. it's $p$-variation on an interval is defined by $$V_{p}(x, [a, b]) ...
0
votes
0answers
21 views

Ergodicity property for continuous-time Harris positive Markov process

I have posted this question on there, but got no answer. The following theorem is Theorem 13.3.3 of Meyn and Tweedie's Markov Chains and Stochastic Stability on page 328: Theorem 13.3.3. If ...
0
votes
0answers
9 views

The inter-request time distribution after aggregating some arrivals in the renewal process

This is a follow-up question of the question "Aggregate arrivals from a Poisson Process" The inter-arrival time of a renewal process, $t$, conforms to a general distribution, denoted by PDF ...
-3
votes
0answers
81 views

Find the joint density function? [on hold]

Assume that $X_t$ is the OU process , i.e, $dX_t=\kappa(\theta-X_t)dt +\sigma dW_t$ where $0\leq t\leq T$ and $X_0=x_0>0$. Let $q(x)=\frac{\kappa}{\sigma}(\theta-x)x +\frac{\sigma}{2}$. I want ...
-2
votes
0answers
26 views

Branching process and process stochastic [closed]

Consider a discrete time branching process $X_{n}$ with $X_{0}=1.$ Establish the simple inequality $$P\{X_{n}>L\ \textrm{for some}\ 0\leq n\leq m\ |\ X_{m}=0 \}\leq [P\{X_{m}=0\}]^L$$ Note: This ...
1
vote
0answers
34 views

Spectral densities of stationary Feller processes with no diffusion, constant positive drift and negative jumps

For a (real valued, finite variance, centered) stationary process $X_t$ on $\mathbb R$, the auto-correlation function $k(\tau) = \mathbb E(X_{t+\tau}-X_t)^2$ and its inverse Fourier transform $\rho$, ...
0
votes
0answers
23 views

Writing eigen functions of one Stochastic Process in terms of the eigen functions of another

Let us consider a centred square integrable stochastic process $\{X_t:t\in [0,2]\}$. Also let the eigen values and the eigen function of the kernel of the covariance operator of $X_t$ are ...
0
votes
1answer
48 views

Sum of two parts of a continuous stochastic process

Let $X$ be a centered continuous stochastic process which is square integrable on $[0,2]\times \Omega$ and the basis of $L^2(0,2)$ is $\{e_i\}$. By using Karhunen-Leove Theorem one can write for all ...
2
votes
0answers
53 views

Customers and Anti-Customer Queueing Problem: What is the Customer delete probability

Hello may I ask for your help? First the setting: I have got a problem with some queueing theory. The whole problem would be a grid of nodes, all nodes have an operation intensity $\mu_{i,j}$. ...
0
votes
0answers
72 views

Why is this distribution exponential?

Take the interval $[0, 1]$. Now sample 10000 points in this interval randomly according to the uniform distribution. The fact is that the distribution of the distances between adjacent points on ...
7
votes
7answers
551 views

Semicircle law universality elsewhere

Wigner's semicircle distribution is: $$f(x)=\frac{1}{2 \pi}\sqrt{4-x^2}, \ \ -2\leq x\leq 2.$$ Under reasonable conditions, the rescaled eigenvalue density of random symmetric matrices $M_n$ follows ...
1
vote
0answers
51 views

Convergence to equilibrium for time in-homogeneous diffusions

Consider the long time behavior for a time in-homogeneous diffusion such as $$dX_t = dB_t - \nabla V(X_t)\,dt + b_t(X_t)dt,$$ where $V(x)$ is a smooth convex function and $b_t(x)$ is a time-dependent ...
1
vote
1answer
51 views

When is the hitting time of an open set a stopping time?

Let $(\Omega, \mathcal{F},P)$ be a probability space and $(\mathcal{F}_t)_{t \in [0,T]}$ a filtration. Consider an adapted, right-continuous process $X$ taking values in $\mathcal{X}$ and let $B$ be ...
0
votes
0answers
39 views

characterization of the equivalence between two probability measures

Let $X=(X_1,...,X_n)$ be a canonical process defined on the Euclidean space $R^n$, i.e. $X(x)=x$ for all $x\in R^n$ and $\mathbb F=\{\mathcal{F}_k\}_{1\le k\le n}$ be its natural filtration, i.e. ...
1
vote
0answers
46 views

Quadratic Variation of a Martingale in Hlibert Spaces

I'm looking at a Martingale (actually a Martingale difference sequence), $$ M_n = \sum \delta M_n, $$ and I'd like to prove something about convergence. If Martingale is Hilbert space valued ...
1
vote
0answers
29 views

Stochastically coloring a graph in a local way

Suppose you are assigning values in $S$ (assume $|S|<\infty$) to nodes of a (directed) graph in a stochastic way. At the beginning, none of the node is assigned values. At the $i^{th}$ step, you ...
1
vote
0answers
35 views

Asymptotics of Variable Drift Ornstein–Uhlenbeck Process

The Ornstein–Uhlenbeck process is defined as the stochastic process that solves the following SDE: $dx_t = \theta (\mu-x_t)\,dt + \sigma\, dW_t$ where $\theta>0$, $\mu$ and $\sigma>0$ are ...
0
votes
0answers
49 views

conditionning by a Gaussian field

I know that if $(X,Y)$ is a Gaussian vector, then $(X|Y=y)$ is a Gaussian vector which covariance matrix is explicit in function of the covariance matrix of $(X,Y)$, and does not depend on $y$. What ...
0
votes
0answers
21 views

Probability that a Lipschitz Gaussian field vanishes nearby

Let $X(t),t\in T$ be a Gaussian field on some bounded open set $T$ of $R^d$. Let $x\in T,\varepsilon>0$. Is there a finite number $K$ such that $P(\exists t\in B(x,\varepsilon):X(t)=0)\leq ...
0
votes
0answers
56 views

Markov chains on a polyhedron

A modification of a question from Gerard Letac (1976): A m-sided q-adjacent-faced polyhedron has one of its faces "up." Each round, the polyhedron rolls so that any of the adjacent faces is now up. ...
1
vote
0answers
56 views

permutations sampling by probability matrix [closed]

I am looking for effective and reliable algorithm which is able to generate random samples of permutations by square doubly stochastic probability matrix $P$ (n x n) distribution ($\sum_{i}p_{i,j} = ...
1
vote
0answers
34 views

Oscillating Markovprocess Transition Probabilities

Suppose we have an irreducible positive-recurrent Markov process $\{X(t), t\geq0\}$ with generator $G$. Let $P(t)$ be its transition probability matrix and $\pi$ its stationary distribution. Then we ...
1
vote
1answer
123 views

Arc Sine law for Random Walk conditioned to non-absorption or not?

Let $S_n$ be simple symmetric Random walk on the integers in $[-N,N]$ with states $N$ and $-N$ absorbing. Let $\tau$ be the time to absorption when $S_0 = 0$. Is the $E(S^{2}_{n}| \tau \geq n)$ ...
7
votes
1answer
246 views

understanding of rough path

A rough path is defined as an ordered pair $ (X, \mathbb X)$, where $X$ is a path mapping from $[0,T]$ to some Banach space $V$ and $\mathbb X:[0,T]^2 \mapsto V^2$ is another mapping for additional ...
0
votes
0answers
27 views

On the induced norms of stochastic operator and its adjoint operator

The background: when studying the paper published in Automatica named '$H_{\infty}$ control and filtering of discrete-time stochastic systems with multiplicative noise' (volume 37, pp. 409-417), I ...
0
votes
0answers
23 views

Truncated Robbins-Monro

I'm reading Han-Fu Chen's book "Stochastic Approximation and Its Applications", and in Chapter 1, he's got a statement of a theorem and proof on a truncated Robbins-Monro algorithm. In this version, ...
1
vote
0answers
72 views

Scaling of First-passage times for Random Walk on integer lattices

Consider simple symmetric random walk $S_{n} = (S_{n}^{(1)},\dots, S_{n}^{(d)})$ on the d-dimensional integer lattice with starting point the origin. Let $\tau_{N}$ be the first time $S_{n}$ exits ...
0
votes
1answer
52 views

How can two random variables are continuous infers that their jointly random variable is continuous [closed]

We assume that $\forall a,b$ suchthat $a^2+b^2>0$, $aX+bY$ is continuous random variable. But we don't assume that $X$ and $Y$ are independent. My question is the following: Is it true that the ...
2
votes
0answers
63 views

Cramer-Rao type bound for absolute estimation error

Let $\{X_1, X_2, \ldots, X_n\}$ be independent and identically distributed (i.i.d.) random variables sampled from a common distribution with density $f_{\theta}(x)$, where $\theta$ is an unknown ...
4
votes
1answer
152 views

Upper bound of the waiting time of a sum process

Let $n \in \mathbb{N}$, $x_1, \ldots, x_n \in (0,1)$ fix but arbitrary, s.t. $\sum_{i=1}^n x_i = 1$. Let $X_i \sim \operatorname{Unif}(\{x_1, \ldots, x_n\})$ i.i.d., and $T_n = \min\{t \in \mathbb{N} ...
4
votes
2answers
228 views

Is $B(t-1)$ an Ito process?

Let $I(\cdot)$ be an indicator, and $B_{t}$ be an 1-dim standard Brownian motion in a nice filtered probability space $(\Omega, \mathcal{F}, P, \mathcal{F}_{t})$. We consider a random process $$Y_{t} ...
0
votes
1answer
103 views

probability in galton watson processes [closed]

I am trying to study the Elementary new proofs of classical limit theorems for Galton Watson processes written by Jochen Geiger. I don't understand what Z_(n,i) stand for. And in the proof of Theorem ...
1
vote
2answers
135 views

Principal bundles and Subriemannian Geometry

In sub-Riemannian geometry, one considers manifolds $P$ equipped with a subbundle $\mathcal{H}$ of $TP$, the horizontal distribution. One then has a Riemannian metric only on this distribution ...
0
votes
0answers
39 views

Strong Markov Property of the joint process $(B_t,L_t)_{t\ge 0}$

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion and $L=(L_t)_{t\ge 0}$ be its local time in zero. Given two strictly increasing functions $\phi_1$, $\phi_2: \mathbb R_+\to\mathbb R$ such that ...
7
votes
1answer
211 views

Central limit theorem for biased random walk

Define random variables $X_n$ by $X_0 = 0$ and \begin{equation*}X_n - X_{n-1} = \begin{cases} 1 & \text{with probability } g(X_{n-1}) \\ 0 & \text{with probability } 1-g(X_{n-1}) \end{cases} ...
2
votes
1answer
116 views

Stochastic interpretation of heat kernel on fiber bundle

I'm looking for a stochastic interpretation of the heat equation for vector valued function. The classical set up is the following : If $(M,g)$ is a riemannian manifold then we could consider the ...
1
vote
0answers
117 views

Joint law of a standard Brownian motion and its local time at a nonzero level

Let $B_t$ be the standard Brownian motion and $L_t^a$ be the local time at level $a$. It is known that the joint-density of $(L_t^0,B_t)$ is $$ P\left(B_t\in d y, L_t^0\in d v\right) = ...
0
votes
0answers
39 views

Recursive parameter estimation for partially observed Ito SDEs

I'm trying to get my head around online (recursive) maximum-likelihood parameter estimation in the language of stochastic processes and in the context of stochastic filtering, i.e. where we have a ...
1
vote
0answers
93 views

Horizontal vs Vertical sides Exit from a Rectangle for simple symmetric Random Walk on $\textbf{Z}^{2}$

Consider simple symmetric random walk, $X_{n} = (X_{n}^{(1)}, X_{n}^{(2)})$ with $X_0= (0,0)$, on the 2 dimensional integer lattice, $\textbf{Z}^{2}$. Let $T_{M}, T_{N}$ be the smallest $n$ such ...
6
votes
1answer
115 views

Does a Gaussian process shrink under a contraction map

Let $T \subset \mathbb R^n$, and assume it's a finite set if that helps. Consider the symmetric Gaussian process $(X_t)_{t\in T}$ defined by $X_t = \langle G, t\rangle$, where $G$ is a standard ...
2
votes
1answer
127 views

Stochastic differential equation associated with an optimal control problem

We know how to find the stochastic differential equation (Hamilton-Jacobi-Bellman equation, HJB) of the control problem where a process $X_t$ is controlled up until it is stopped at a stopping time ...
1
vote
0answers
36 views

Question about the characteristics of semimartingales

Let $D=D([0,1,R)$ be the space of cadlag (right-continuous with left limits) functions defined on [0,1] and $X:=(X_t)_{t\in [0,1]}$ be the canonical process on $D$, i.e. $X_t(x)=x(t)$ for all $x\in ...
1
vote
0answers
61 views

Bounding correlation between blocks of Gaussian stationary process

Let $X_n$ be a stationary Gaussian process with covariance function $\gamma(n)=\mathrm{Cov}[X(n),X(0)]$. Let $\mathbf{X}_p^q=(X_p,\ldots,X_q)$, $s_n^2=\mathrm{Var}(X_1+\ldots+X_n)$, and ...
5
votes
0answers
175 views

Quadratic variation and predictable quadratic variation for martingales

Let $(M_{t})_{0\le t\le 1}$ be a continuous martingale with respect to the filtration $(\mathcal{F}_{t})_{0\le t\le 1}$. Assume that $E M_1^2<\infty$. Fix $N$ and consider now a discrete version ...
4
votes
1answer
137 views

Area enclosed by Brownian motion (without winding number)

The question Average Value of Area Closed by Brownian Motion turned out to be about the Lévy area process, which measures "signed area with multiplicity" enclosed by Brownian motion (e.g. each ...
1
vote
2answers
62 views

SDEs: Bounding the variance of a solution

I've been thinking about something that would seem intuitive, but I haven't really been able to dig a direct answer to. This is a rough draft of it. Let $$X_t = \mu_{X,t} \mathrm{d}t + \sigma_{X,t} ...
2
votes
1answer
121 views

Criterion for weak convergence of probability measures on S' or D'

Let $X_n$ in $S'$ and $\mu_n$, $\mu$ in $M(S')$. $S'$ is the space of tempered distributions. I'm looking for a reference that says if $< f, X_n >$ converges in distribution to $< f,X>$ ...
25
votes
5answers
1k views

Deep Learning / Deep neural nets for mathematician

I am interested in finding out the math ideas behind the technologies that are under the umbrella of "Deep Learning" or "Deep neural nets". Most of the papers/books that are often quoted in ...
9
votes
1answer
231 views

a question on 0-1 valued stochastic process

Here's a question on probability theory from a layman (I'm a game theorist). It is very likely that the question will be a straightforward matter for someone who is a probability theorist. I guess I'm ...