A stochastic process is a collection of random variables usually indexed by a totally ordered set.

learn more… | top users | synonyms

0
votes
0answers
16 views

On the induced norms of stochastic operator and its adjoint operator

The background: when studying the paper published in Automatica named '$H_{\infty}$ control and filtering of discrete-time stochastic systems with multiplicative noise' (volume 37, pp. 409-417), I ...
0
votes
0answers
12 views

Truncated Robbins-Monro

I'm reading Han-Fu Chen's book "Stochastic Approximation and Its Applications", and in Chapter 1, he's got a statement of a theorem and proof on a truncated Robbins-Monro algorithm. In this version, ...
3
votes
1answer
235 views

Quasi-stationary distribution for a death process

In the paper, Survival in a quasi-death process by van Doorn and Pollett, the quasi-stationary distribution of a transient CTMC is discussed and QSD for a simple death process is derived. Consider a ...
1
vote
0answers
29 views

Scaling of First-passage times for Random Walk on integer lattices

Consider simple symmetric random walk $S_{n} = (S_{n}^{(1)},\dots, S_{n}^{(d)})$ on the d-dimensional integer lattice with starting point the origin. Let $\tau_{N}$ be the first time $S_{n}$ exits ...
4
votes
1answer
130 views

Upper bound of the waiting time of a sum process

Let $n \in \mathbb{N}$, $x_1, \ldots, x_n \in (0,1)$ fix but arbitrary, s.t. $\sum_{i=1}^n x_i = 1$. Let $X_i \sim \operatorname{Unif}(\{x_1, \ldots, x_n\})$ i.i.d., and $T_n = \min\{t \in \mathbb{N} ...
1
vote
0answers
46 views

Cramer-Rao type bound for absolute estimation error

Let $\{X_1, X_2, \ldots, X_n\}$ be independent and identically distributed (i.i.d.) random variables sampled from a common distribution with density $f_{\theta}(x)$, where $\theta$ is an unknown ...
2
votes
1answer
274 views

weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$. $$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$ ...
0
votes
1answer
43 views

How can two random variables are continuous infers that their jointly random variable is continuous [on hold]

We assume that $\forall a,b$ suchthat $a^2+b^2>0$, $aX+bY$ is continuous random variable. But we don't assume that $X$ and $Y$ are independent. My question is the following: Is it true that the ...
-1
votes
0answers
67 views

Long time statistics of random functions

I'd like to understand if an average over random functions can be factorized in the long-time limit. Let $$ X_t = \sum_{k=1}^M a_k \cos(\omega_k t + \phi_k) $$ a random function, where ...
4
votes
2answers
201 views

Is $B(t-1)$ an Ito process?

Let $I(\cdot)$ be an indicator, and $B_{t}$ be an 1-dim standard Brownian motion in a nice filtered probability space $(\Omega, \mathcal{F}, P, \mathcal{F}_{t})$. We consider a random process $$Y_{t} ...
2
votes
1answer
97 views

Criterion for weak convergence of probability measures on S' or D'

Let $X_n$ in $S'$ and $\mu_n$, $\mu$ in $M(S')$. $S'$ is the space of tempered distributions. I'm looking for a reference that says if $< f, X_n >$ converges in distribution to $< f,X>$ ...
2
votes
1answer
183 views

Diffusion processes with different diffusion coefficients and absolute continuity

I would first of all like to say that I am an analyst, and so I am familiar with probabilistic methods only on a basic level. My initial situation is the following. Consider two stochastic ...
7
votes
1answer
192 views

Central limit theorem for biased random walk

Define random variables $X_n$ by $X_0 = 0$ and \begin{equation*}X_n - X_{n-1} = \begin{cases} 1 & \text{with probability } g(X_{n-1}) \\ 0 & \text{with probability } 1-g(X_{n-1}) \end{cases} ...
0
votes
1answer
96 views

probability in galton watson processes [closed]

I am trying to study the Elementary new proofs of classical limit theorems for Galton Watson processes written by Jochen Geiger. I don't understand what Z_(n,i) stand for. And in the proof of Theorem ...
1
vote
2answers
117 views

Principal bundles and Subriemannian Geometry

In sub-Riemannian geometry, one considers manifolds $P$ equipped with a subbundle $\mathcal{H}$ of $TP$, the horizontal distribution. One then has a Riemannian metric only on this distribution ...
0
votes
0answers
33 views

Strong Markov Property of the joint process $(B_t,L_t)_{t\ge 0}$

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion and $L=(L_t)_{t\ge 0}$ be its local time in zero. Given two strictly increasing functions $\phi_1$, $\phi_2: \mathbb R_+\to\mathbb R$ such that ...
2
votes
1answer
180 views

Time integral of a diffusion

Define $\bar\sigma^2_t=\frac{1}{t}\int_0^t\sigma^2(X_s)ds$ where $\sigma(x)\geq0$ is a measurable function and $X_t$ a diffusion process defined by \begin{equation} ...
3
votes
1answer
254 views

Convergence of random variables with hypergeometric distribution

This is a very interesting conjecture of large scale property of hypergeometric distribution. Let $a>1$ be a integer constant, $N\in\mathbb{N_+}$, for any $x<N-1$, consider $N+(a-1)x$ balls in ...
2
votes
1answer
108 views

Stochastic interpretation of heat kernel on fiber bundle

I'm looking for a stochastic interpretation of the heat equation for vector valued function. The classical set up is the following : If $(M,g)$ is a riemannian manifold then we could consider the ...
1
vote
1answer
361 views

question about uniform continuity under Skorokhod Metric

Let $D=D([0,1], \mathbb{R})$ be the space of cadlag functions $x$ with $x(0)=0$ and $x$ is continuous on $1$. If we endow $D$ with Skorokhod Metric, see: http://en.wikipedia.org/wiki/C%C3%A0dl%C3%A0g ...
1
vote
1answer
135 views

Question about the stochastic integral of martingales

Let $M=(M_t)_{t\ge 0}$ be a continuous martingale defined on some filtered probability space taking values in $R$. Let $H=(H_t)_{t\ge 0}$ be some bounded progressively measurable process, i.e. ...
1
vote
0answers
97 views

Joint law of a standard Brownian motion and its local time at a nonzero level

Let $B_t$ be the standard Brownian motion and $L_t^a$ be the local time at level $a$. It is known that the joint-density of $(L_t^0,B_t)$ is $$ P\left(B_t\in d y, L_t^0\in d v\right) = ...
8
votes
1answer
1k views

Gluing Markov processes

I am looking for a reference on the gluing together of strong Markov processes to get a new one. Here is an example of what I have in mind. Let $B^1, B^2, \ldots $ be independent one-dimensional ...
0
votes
0answers
37 views

Recursive parameter estimation for partially observed Ito SDEs

I'm trying to get my head around online (recursive) maximum-likelihood parameter estimation in the language of stochastic processes and in the context of stochastic filtering, i.e. where we have a ...
7
votes
1answer
460 views

Strong Markov property for Poisson point process

The question is thoroughly contained in the title. I just say that I would only like to find a reference for this question. I have searched in some books, to no avail. Here is what I mean exactly. ...
0
votes
1answer
253 views

Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...
3
votes
2answers
1k views

Brownian local time density

Dear All, I am not a mathematican, please be patient if I ask something in a not appropriate way! Let we suppose a Brownian motion with inital value of W(0)=0, and we look its possible realizations ...
1
vote
0answers
87 views

Horizontal vs Vertical sides Exit from a Rectangle for simple symmetric Random Walk on $\textbf{Z}^{2}$

Consider simple symmetric random walk, $X_{n} = (X_{n}^{(1)}, X_{n}^{(2)})$ with $X_0= (0,0)$, on the 2 dimensional integer lattice, $\textbf{Z}^{2}$. Let $T_{M}, T_{N}$ be the smallest $n$ such ...
5
votes
0answers
158 views

Quadratic variation and predictable quadratic variation for martingales

Let $(M_{t})_{0\le t\le 1}$ be a continuous martingale with respect to the filtration $(\mathcal{F}_{t})_{0\le t\le 1}$. Assume that $E M_1^2<\infty$. Fix $N$ and consider now a discrete version ...
0
votes
1answer
54 views

Defining a brownian bridge indexed by angle

I have a random closed curve of the form $(\theta,r_\theta)$, where $\theta\in [0,2\pi]$, is the counter clockwise angle from the x-axis and $r_\theta$ is the radial distance from the origin ...
2
votes
1answer
163 views

explicit characterization of the stochastic integrand

Let $V$ be a cadlag positive supermartingale with the following decomposition: $$V_t=V_0+\int_0^tH_sdX_s-K_t$$ where $X$ is a cadlag local martingale and $K$ is an adapted increasing process with ...
2
votes
1answer
117 views

Stochastic differential equation associated with an optimal control problem

We know how to find the stochastic differential equation (Hamilton-Jacobi-Bellman equation, HJB) of the control problem where a process $X_t$ is controlled up until it is stopped at a stopping time ...
6
votes
1answer
101 views

Does a Gaussian process shrink under a contraction map

Let $T \subset \mathbb R^n$, and assume it's a finite set if that helps. Consider the symmetric Gaussian process $(X_t)_{t\in T}$ defined by $X_t = \langle G, t\rangle$, where $G$ is a standard ...
4
votes
1answer
347 views

Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by: $X_{i}= h(i) + \varepsilon_i $, $h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$ where $\{\varepsilon_i\}$ are i.i.d. ${\cal ...
5
votes
1answer
130 views

Relative vulnerabilities in SIS epidemic model

Consider the SIS model of epidemic spreading. There is a finite graph $G(V,E)$, link infection rates $\lambda_{ij}$ and node recovery rates $\mu_i$. There are a few initial nodes which are infected at ...
2
votes
1answer
171 views

Is there a theory of SDEs whose coefficients are themselves adapted processes (i.e. “may depend on the past”)?

Is there an existence and uniqueness theorem for SDEs of the following type: $dW_{t}=d\tilde{W}_{t}+\mu\left(\left(W_{s}\right)_{0\le s\le t},t\right)dt$, where $\tilde{W}_{t}$ is say ...
5
votes
0answers
221 views

Squaring random Schwartz distributions

Let $\mu$ denote the centered Gaussian measure on $S'(\mathbb{R}^d)$ with covariance $$ \mathbb{E} [\phi(f)\phi(g)]=\int_{\mathbb{R}^d} \frac{\overline{\widehat{f}(\xi)} ...
1
vote
0answers
32 views

Question about the characteristics of semimartingales

Let $D=D([0,1,R)$ be the space of cadlag (right-continuous with left limits) functions defined on [0,1] and $X:=(X_t)_{t\in [0,1]}$ be the canonical process on $D$, i.e. $X_t(x)=x(t)$ for all $x\in ...
0
votes
1answer
212 views

Poisson approximation of random sub-graphs

I add the edges of $G(n)$ the complete graph on $n$ vertices one by one, at random and without replacement, and denote by $G(n,m)$ the resulting Erdos Renyi random graph process. At step $m$ in the ...
7
votes
2answers
344 views

Markov processes lacking the Feller property

Let $E$ be a LCH second countable topological space and let $\mathcal{E}$ be its Borel $\sigma$-algebra. Let $(P_t)_{t \geq 0}$ be a conservative transition function on $(E, \mathcal{E})$. This ...
1
vote
0answers
55 views

Bounding correlation between blocks of Gaussian stationary process

Let $X_n$ be a stationary Gaussian process with covariance function $\gamma(n)=\mathrm{Cov}[X(n),X(0)]$. Let $\mathbf{X}_p^q=(X_p,\ldots,X_q)$, $s_n^2=\mathrm{Var}(X_1+\ldots+X_n)$, and ...
3
votes
2answers
93 views

Existence of an invariant measure on an infinite dimensional space via Lyapunov functional

Set-up. Assume that we have a complete separable metric space $\mathcal{X}$ that is not locally compact. Let $V: \mathcal{x} \to [0; +\infty]$ be a functional such that $K_r :=\{x \in \mathcal {X} : V ...
4
votes
1answer
129 views

Area enclosed by Brownian motion (without winding number)

The question Average Value of Area Closed by Brownian Motion turned out to be about the Lévy area process, which measures "signed area with multiplicity" enclosed by Brownian motion (e.g. each ...
23
votes
5answers
1k views

Deep Learning / Deep neural nets for mathematician

I am interested in finding out the math ideas behind the technologies that are under the umbrella of "Deep Learning" or "Deep neural nets". Most of the papers/books that are often quoted in ...
1
vote
2answers
56 views

SDEs: Bounding the variance of a solution

I've been thinking about something that would seem intuitive, but I haven't really been able to dig a direct answer to. This is a rough draft of it. Let $$X_t = \mu_{X,t} \mathrm{d}t + \sigma_{X,t} ...
4
votes
2answers
212 views

Generalization of Lévy's continuity theorem for nuclear spaces

I am interested in a generalization of the following finite-dimensional results in infinite dimensional vector-space with nuclear structure, especially for the cases of the spaces of distributions ...
9
votes
1answer
225 views

a question on 0-1 valued stochastic process

Here's a question on probability theory from a layman (I'm a game theorist). It is very likely that the question will be a straightforward matter for someone who is a probability theorist. I guess I'm ...
16
votes
2answers
808 views

Random Walk on $\mathbb{R}$ with Uniformly Distributed Steps and “Reflective” Boundary at Origin

A particle lies on the real number line at the origin. For each step taken, the particle moves from its current position a distance (and direction) chosen equi-probably from range $[-1,r]$. However, ...
0
votes
0answers
22 views

a judicious choice of a parametrix expansion for a Kolmogorov equation?

Consider two SDEs: Let $b, \sigma$ be two smooth lipshitz functions on $\mathbb{R}$ and consider $\left \{ X(s), s\geq t \right \}$ the solution of the following SDE $d X(s) = b(X(s)) d s + ...
1
vote
1answer
144 views

Langevin equation with position-dependant damping: existence of an invariant measure?

The usual Langevin equation for a particle in a 1D harmonic potential $dq(t) = p(t)~dt$ $dp(t) = -q(t)~dt + a ~dW(t) - b~p(t)~dt$ admits as an invariant measure the Gibbs measure ${1\over ...