A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**0**

votes

**0**answers

16 views

### On the induced norms of stochastic operator and its adjoint operator

The background: when studying the paper published in Automatica named '$H_{\infty}$ control and filtering of discrete-time stochastic systems with multiplicative noise' (volume 37, pp. 409-417), I ...

**0**

votes

**0**answers

12 views

### Truncated Robbins-Monro

I'm reading Han-Fu Chen's book "Stochastic Approximation and Its Applications", and in Chapter 1, he's got a statement of a theorem and proof on a truncated Robbins-Monro algorithm. In this version, ...

**3**

votes

**1**answer

235 views

### Quasi-stationary distribution for a death process

In the paper, Survival in a quasi-death process by van Doorn and Pollett, the quasi-stationary distribution of a transient CTMC is discussed and QSD for a simple death process is derived.
Consider a ...

**1**

vote

**0**answers

29 views

### Scaling of First-passage times for Random Walk on integer lattices

Consider simple symmetric random walk $S_{n} = (S_{n}^{(1)},\dots,
S_{n}^{(d)})$ on the d-dimensional integer lattice with starting point the origin.
Let $\tau_{N}$ be the first time $S_{n}$ exits ...

**4**

votes

**1**answer

130 views

### Upper bound of the waiting time of a sum process

Let $n \in \mathbb{N}$, $x_1, \ldots, x_n \in (0,1)$ fix but arbitrary, s.t. $\sum_{i=1}^n x_i = 1$. Let $X_i \sim \operatorname{Unif}(\{x_1, \ldots, x_n\})$ i.i.d., and $T_n = \min\{t \in \mathbb{N} ...

**1**

vote

**0**answers

46 views

### Cramer-Rao type bound for absolute estimation error

Let $\{X_1, X_2, \ldots, X_n\}$ be independent and identically distributed (i.i.d.) random variables sampled from a common distribution with density $f_{\theta}(x)$, where $\theta$ is an unknown ...

**2**

votes

**1**answer

274 views

### weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$.
$$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$
...

**0**

votes

**1**answer

43 views

### How can two random variables are continuous infers that their jointly random variable is continuous [on hold]

We assume that $\forall a,b$ suchthat $a^2+b^2>0$, $aX+bY$ is continuous random variable.
But we don't assume that $X$ and $Y$ are independent.
My question is the following:
Is it true that the ...

**-1**

votes

**0**answers

67 views

### Long time statistics of random functions

I'd like to understand if an average over random functions can be factorized in the long-time limit.
Let $$ X_t = \sum_{k=1}^M a_k \cos(\omega_k t + \phi_k) $$
a random function, where ...

**4**

votes

**2**answers

201 views

### Is $B(t-1)$ an Ito process?

Let $I(\cdot)$ be an indicator, and $B_{t}$ be an 1-dim standard Brownian motion in a nice filtered probability space
$(\Omega, \mathcal{F}, P, \mathcal{F}_{t})$. We consider a random process
$$Y_{t} ...

**2**

votes

**1**answer

97 views

### Criterion for weak convergence of probability measures on S' or D'

Let $X_n$ in $S'$ and $\mu_n$, $\mu$ in $M(S')$. $S'$ is the space of tempered distributions. I'm looking for a reference that says if $< f, X_n >$ converges in distribution to $< f,X>$ ...

**2**

votes

**1**answer

183 views

### Diffusion processes with different diffusion coefficients and absolute continuity

I would first of all like to say that I am an analyst, and so I am familiar with probabilistic methods only on a basic level.
My initial situation is the following. Consider two stochastic ...

**7**

votes

**1**answer

192 views

### Central limit theorem for biased random walk

Define random variables $X_n$ by $X_0 = 0$ and
\begin{equation*}X_n - X_{n-1} = \begin{cases}
1 & \text{with probability } g(X_{n-1}) \\
0 & \text{with probability } 1-g(X_{n-1})
\end{cases}
...

**0**

votes

**1**answer

96 views

### probability in galton watson processes [closed]

I am trying to study the Elementary new proofs of classical limit theorems for Galton Watson processes written by Jochen Geiger.
I don't understand what Z_(n,i) stand for.
And in the proof of Theorem ...

**1**

vote

**2**answers

117 views

### Principal bundles and Subriemannian Geometry

In sub-Riemannian geometry, one considers manifolds $P$ equipped with a subbundle $\mathcal{H}$ of $TP$, the horizontal distribution. One then has a Riemannian metric only on this distribution ...

**0**

votes

**0**answers

33 views

### Strong Markov Property of the joint process $(B_t,L_t)_{t\ge 0}$

Let $B=(B_t)_{t\ge 0}$ be a Brownian motion and $L=(L_t)_{t\ge 0}$ be its local time in zero. Given two strictly increasing functions $\phi_1$, $\phi_2: \mathbb R_+\to\mathbb R$ such that ...

**2**

votes

**1**answer

180 views

### Time integral of a diffusion

Define $\bar\sigma^2_t=\frac{1}{t}\int_0^t\sigma^2(X_s)ds$ where $\sigma(x)\geq0$ is a measurable function and $X_t$ a diffusion process defined by
\begin{equation}
...

**3**

votes

**1**answer

254 views

### Convergence of random variables with hypergeometric distribution

This is a very interesting conjecture of large scale property of hypergeometric distribution.
Let $a>1$ be a integer constant, $N\in\mathbb{N_+}$, for any $x<N-1$, consider $N+(a-1)x$ balls in ...

**2**

votes

**1**answer

108 views

### Stochastic interpretation of heat kernel on fiber bundle

I'm looking for a stochastic interpretation of the heat equation for vector valued function.
The classical set up is the following :
If $(M,g)$ is a riemannian manifold then we could consider the ...

**1**

vote

**1**answer

361 views

### question about uniform continuity under Skorokhod Metric

Let $D=D([0,1], \mathbb{R})$ be the space of cadlag functions $x$ with $x(0)=0$ and $x$ is continuous on $1$. If we endow $D$ with Skorokhod Metric, see:
http://en.wikipedia.org/wiki/C%C3%A0dl%C3%A0g
...

**1**

vote

**1**answer

135 views

### Question about the stochastic integral of martingales

Let $M=(M_t)_{t\ge 0}$ be a continuous martingale defined on some filtered probability space taking values in $R$. Let $H=(H_t)_{t\ge 0}$ be some bounded progressively measurable process, i.e.
...

**1**

vote

**0**answers

97 views

### Joint law of a standard Brownian motion and its local time at a nonzero level

Let $B_t$ be the standard Brownian motion and $L_t^a$ be the local time at level $a$. It is known that the joint-density of $(L_t^0,B_t)$ is
$$
P\left(B_t\in d y, L_t^0\in d v\right) = ...

**8**

votes

**1**answer

1k views

### Gluing Markov processes

I am looking for a reference on the gluing together of strong Markov processes to get a new one.
Here is an example of what I have in mind. Let $B^1, B^2, \ldots $ be independent one-dimensional ...

**0**

votes

**0**answers

37 views

### Recursive parameter estimation for partially observed Ito SDEs

I'm trying to get my head around online (recursive) maximum-likelihood parameter estimation in the language of stochastic processes and in the context of stochastic filtering, i.e. where we have a ...

**7**

votes

**1**answer

460 views

### Strong Markov property for Poisson point process

The question is thoroughly contained in the title. I just say that I would only like to find a reference for this question. I have searched in some books, to no avail.
Here is what I mean exactly. ...

**0**

votes

**1**answer

253 views

### Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...

**3**

votes

**2**answers

1k views

### Brownian local time density

Dear All,
I am not a mathematican, please be patient if I ask something in a not appropriate way!
Let we suppose a Brownian motion with inital value of W(0)=0,
and we look its possible realizations ...

**1**

vote

**0**answers

87 views

### Horizontal vs Vertical sides Exit from a Rectangle for simple symmetric Random Walk on $\textbf{Z}^{2}$

Consider simple symmetric random walk, $X_{n} = (X_{n}^{(1)}, X_{n}^{(2)})$ with $X_0= (0,0)$, on the 2 dimensional integer lattice, $\textbf{Z}^{2}$.
Let $T_{M}, T_{N}$ be the smallest $n$ such ...

**5**

votes

**0**answers

158 views

### Quadratic variation and predictable quadratic variation for martingales

Let $(M_{t})_{0\le t\le 1}$ be a continuous martingale with respect to the filtration $(\mathcal{F}_{t})_{0\le t\le 1}$. Assume that $E M_1^2<\infty$.
Fix $N$ and consider now a discrete version ...

**0**

votes

**1**answer

54 views

### Defining a brownian bridge indexed by angle

I have a random closed curve of the form $(\theta,r_\theta)$, where $\theta\in [0,2\pi]$, is the counter clockwise angle from the x-axis and $r_\theta$ is the radial distance from the origin ...

**2**

votes

**1**answer

163 views

### explicit characterization of the stochastic integrand

Let $V$ be a cadlag positive supermartingale with the following decomposition:
$$V_t=V_0+\int_0^tH_sdX_s-K_t$$
where $X$ is a cadlag local martingale and $K$ is an adapted increasing process with ...

**2**

votes

**1**answer

117 views

### Stochastic differential equation associated with an optimal control problem

We know how to find the stochastic differential equation (Hamilton-Jacobi-Bellman equation, HJB) of the control problem where a process $X_t$ is controlled up until it is stopped at a stopping time ...

**6**

votes

**1**answer

101 views

### Does a Gaussian process shrink under a contraction map

Let $T \subset \mathbb R^n$, and assume it's a finite set if that helps. Consider the symmetric Gaussian process $(X_t)_{t\in T}$ defined by $X_t = \langle G, t\rangle$, where $G$ is a standard ...

**4**

votes

**1**answer

347 views

### Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by:
$X_{i}= h(i) + \varepsilon_i $,
$h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$
where $\{\varepsilon_i\}$ are i.i.d. ${\cal ...

**5**

votes

**1**answer

130 views

### Relative vulnerabilities in SIS epidemic model

Consider the SIS model of epidemic spreading. There is a finite graph $G(V,E)$, link infection rates $\lambda_{ij}$ and node recovery rates $\mu_i$. There are a few initial nodes which are infected at ...

**2**

votes

**1**answer

171 views

### Is there a theory of SDEs whose coefficients are themselves adapted processes (i.e. “may depend on the past”)?

Is there an existence and uniqueness theorem for SDEs of the following type:
$dW_{t}=d\tilde{W}_{t}+\mu\left(\left(W_{s}\right)_{0\le s\le t},t\right)dt$,
where $\tilde{W}_{t}$ is say ...

**5**

votes

**0**answers

221 views

### Squaring random Schwartz distributions

Let $\mu$ denote the centered Gaussian measure on $S'(\mathbb{R}^d)$ with covariance
$$
\mathbb{E}
[\phi(f)\phi(g)]=\int_{\mathbb{R}^d} \frac{\overline{\widehat{f}(\xi)}
...

**1**

vote

**0**answers

32 views

### Question about the characteristics of semimartingales

Let $D=D([0,1,R)$ be the space of cadlag (right-continuous with left limits) functions defined on [0,1] and $X:=(X_t)_{t\in [0,1]}$ be the canonical process on $D$, i.e. $X_t(x)=x(t)$ for all $x\in ...

**0**

votes

**1**answer

212 views

### Poisson approximation of random sub-graphs

I add the edges of $G(n)$ the complete graph on $n$ vertices one by one, at random and without replacement, and denote by $G(n,m)$ the resulting Erdos Renyi random graph process. At step $m$ in the ...

**7**

votes

**2**answers

344 views

### Markov processes lacking the Feller property

Let $E$ be a LCH second countable topological space and let $\mathcal{E}$ be its Borel $\sigma$-algebra.
Let $(P_t)_{t \geq 0}$ be a conservative transition function on $(E, \mathcal{E})$.
This ...

**1**

vote

**0**answers

55 views

### Bounding correlation between blocks of Gaussian stationary process

Let $X_n$ be a stationary Gaussian process with covariance function $\gamma(n)=\mathrm{Cov}[X(n),X(0)]$. Let $\mathbf{X}_p^q=(X_p,\ldots,X_q)$, $s_n^2=\mathrm{Var}(X_1+\ldots+X_n)$, and ...

**3**

votes

**2**answers

93 views

### Existence of an invariant measure on an infinite dimensional space via Lyapunov functional

Set-up.
Assume that we have a complete separable metric space $\mathcal{X}$ that is not locally compact. Let $V: \mathcal{x} \to [0; +\infty]$ be a functional such that $K_r :=\{x \in \mathcal {X} : V ...

**4**

votes

**1**answer

129 views

### Area enclosed by Brownian motion (without winding number)

The question Average Value of Area Closed by Brownian Motion turned out to be about the Lévy area process, which measures "signed area with multiplicity" enclosed by Brownian motion (e.g. each ...

**23**

votes

**5**answers

1k views

### Deep Learning / Deep neural nets for mathematician

I am interested in finding out the math ideas behind the technologies that are under the umbrella of "Deep Learning" or "Deep neural nets".
Most of the papers/books that are often quoted in ...

**1**

vote

**2**answers

56 views

### SDEs: Bounding the variance of a solution

I've been thinking about something that would seem intuitive, but I haven't really been able to dig a direct answer to. This is a rough draft of it.
Let
$$X_t = \mu_{X,t} \mathrm{d}t + \sigma_{X,t} ...

**4**

votes

**2**answers

212 views

### Generalization of Lévy's continuity theorem for nuclear spaces

I am interested in a generalization of the following finite-dimensional results in infinite dimensional vector-space with nuclear structure, especially for the cases of the spaces of distributions ...

**9**

votes

**1**answer

225 views

### a question on 0-1 valued stochastic process

Here's a question on probability theory from a layman (I'm a game theorist). It is very likely that the question will be a straightforward matter for someone who is a probability theorist. I guess I'm ...

**16**

votes

**2**answers

808 views

### Random Walk on $\mathbb{R}$ with Uniformly Distributed Steps and “Reflective” Boundary at Origin

A particle lies on the real number line at the origin. For each step taken, the particle moves from its current position a distance (and direction) chosen equi-probably from range $[-1,r]$. However, ...

**0**

votes

**0**answers

22 views

### a judicious choice of a parametrix expansion for a Kolmogorov equation?

Consider two SDEs:
Let $b, \sigma$ be two smooth lipshitz functions on $\mathbb{R}$ and consider $\left \{ X(s), s\geq t \right \}$ the solution of the following SDE
$d X(s) = b(X(s)) d s + ...

**1**

vote

**1**answer

144 views

### Langevin equation with position-dependant damping: existence of an invariant measure?

The usual Langevin equation for a particle in a 1D harmonic potential
$dq(t) = p(t)~dt$
$dp(t) = -q(t)~dt + a ~dW(t) - b~p(t)~dt$
admits as an invariant measure the Gibbs measure ${1\over ...