A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**10**

votes

**1**answer

2k views

### Gluing Markov processes

I am looking for a reference on the gluing together of strong Markov processes to get a new one.
Here is an example of what I have in mind. Let $B^1, B^2, \ldots $ be independent one-dimensional ...

**7**

votes

**1**answer

616 views

### Strong Markov property for Poisson point process

The question is thoroughly contained in the title. I just say that I would only like to find a reference for this question. I have searched in some books, to no avail.
Here is what I mean exactly. ...

**1**

vote

**2**answers

72 views

### Understanding the limits of the Ito Process Defintion

I would like to understand what kind of stochastic process are Ito Processes. According to Kuo[p. 102] an Ito Process is a stochastic process of the form
$$dX_t=g(t)dt+f(t)dW(t),$$
where $W(t)$ is a ...

**0**

votes

**1**answer

334 views

### Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...

**1**

vote

**1**answer

93 views

### General solution to system of stochastic linear differential equations

Assume we are given the system of linear stochastic differential equations
$$dx_i = \sum_{j=1}^n a_{ij}(t) \cdot x_j \cdot dt + \sum_{j=1}^n \sigma_{ij}(t) \cdot x_j \cdot dB_{ij,t} + b_j(t)\cdot ...

**0**

votes

**0**answers

14 views

### Proofing Analytic continuation and stationary increments of an exponential Family

In U.Küchler "Exponential Families of Stochastic Processes" 1997 Theorem 4.2.1 we have the following setup.
Let $(\Omega,\mathcal{F},(\mathcal{F}_{t})_{t\geq0})$ be a filtered measurable space. Let ...

**0**

votes

**0**answers

58 views

### Onsager-Machlup function for special matrix-valued diffusion process

Potentially useful background info
For standard vector-valued diffusion processes the following result is well-known:
Suppose we have a diffusion $X_{t}$ on $\mathbb{R}^{m}$ given by
\begin{align*}
...

**3**

votes

**1**answer

213 views

### explicit characterization of the stochastic integrand

Let $V$ be a cadlag positive supermartingale with the following decomposition:
$$V_t=V_0+\int_0^tH_sdX_s-K_t$$
where $X$ is a cadlag local martingale and $K$ is an adapted increasing process with ...

**1**

vote

**1**answer

71 views

### Intuition about Skorohod integral

I'm teaching myself Malliavin calculus and Skorohod integrals and with this kind of math I find myself following the logic through but lacking solid intuition about what is going on.
In particular ...

**12**

votes

**1**answer

896 views

### surprisingly difficult filtration problem

I am interested in a proof of the following statement which seems intuitive, but is somehow really tricky:
Let $X$ be a stochastic process and let $(\mathcal{F}(t) : t \geq 0)$ be the filtration ...

**4**

votes

**1**answer

110 views

### Cramer-Rao type bound for absolute estimation error

Let $\{X_1, X_2, \ldots, X_n\}$ be independent and identically distributed (i.i.d.) random variables sampled from a common distribution with density $f_{\theta}(x)$, where $\theta$ is an unknown ...

**0**

votes

**1**answer

179 views

### What is the derivative of this integral?

I have asked this question here
http://math.stackexchange.com/questions/1536018/how-to-find-derivative-of-this-intergral
but still has no response.
Might I ask it here ?
Let $\alpha(t)\in\{0,1\}: ...

**1**

vote

**2**answers

151 views

### Can I use Birkhoff's Ergodic Theorem for Vector Valued Process?

I have a stationary process $\{u_n\}$ and I have a function $f:\mathbb{R}^L\to \mathbb{R}^+$. I want to evaluate the following limit $$\lim_{n\to \infty}\frac{1}{n}\sum_{k=1}^n g(f(\mathbf{u}_{k}))$$ ...

**1**

vote

**1**answer

63 views

### Differentiability of stochastic process

Is it possible to construct a stochastic process $X_t$ where the limit
$\lim_{\Delta \rightarrow 0} \rm{Var}\left(\frac{X_{t_0+\Delta}-X_{t_0}}{\Delta}\right)$
does not exist but the sample paths ...

**7**

votes

**1**answer

1k views

### Progressively measurable vs adapted

I often see in stochastic calculus books the terms 'adapted process' and 'progressively measurable process'. I know there is a small difference between them (every progressively measurable process is ...

**1**

vote

**2**answers

685 views

### Stochastic process with Bessel function autocorrelation. (Rayleigh (Jakes) fading for radiowave propagation)

Have the following stochastic process $f(t)$ been studied in mathematics ?
It is stationary, Gaussian, $f(t)-$complex independent Gaussians $N(0,1)$.
The autocorrelation is given by the
zero-order ...

**16**

votes

**4**answers

3k views

### A Markov process which is not a strong markov process?

Can anyone give an example of a Markov process which is not a strong Markov process? The Markov property and strong Markov property are typically introduced as distinct concepts (for example in ...

**5**

votes

**1**answer

304 views

### Quasi-stationary distribution for a death process

In the paper, Survival in a quasi-death process by van Doorn and Pollett, the quasi-stationary distribution of a transient CTMC is discussed and QSD for a simple death process is derived.
Consider a ...

**0**

votes

**1**answer

76 views

### Generalized Ito's lemma

I have the following quantity:
$$
g(t)=(f(t))^{M_{t}},
$$
where $M_{t}$ is a jump process neither Markovian nor Levy and $f(t)$ is a positive, increasing but limited, right-continuous function.
How ...

**-1**

votes

**0**answers

14 views

### Under what conditions does a continuous-time Markov chain is also a Feller process? [on hold]

It is known that not all continuous-time Markov chains are Feller, but are there any discussions on the sufficient conditions? For example, is a continuous-time Markov chain with finite number of ...

**0**

votes

**0**answers

29 views

### How the diffusion in the unit ball induce the boundary process on the boundary directly?

This is Example 1.2.3 from Fukushima, Masatoshi, Oshima, Yoichi and Takeda, Masayoshi's book "Dirichlet Forms and Symmetric Markov Processes".
In this example, we define a Dirichlet form in the unit ...

**2**

votes

**1**answer

73 views

### Solve SDE $dX_t=(c+\sigma_\zeta W'_tX_t)dt + \sigma_\epsilon dW_t$

I am trying to solve the following SDE
$$dX_t=(c+\sigma_\zeta W'_tX_t)dt + \sigma_\epsilon dW_t$$
$c\in \mathbb{R}$ is a constant, $X_t$ is a stochastic process, $\sigma_\zeta,\sigma_\epsilon \in ...

**2**

votes

**2**answers

162 views

### Numerical solution of SDEs with colored noise

I am trying to numerically solve an SDE with both white and colored noise that models a non-linear circuit:
$$
dX_t = f(X_t) dt + \sigma_w dW + \sigma_c dC
$$
where $W$ is a standard Brownian motion ...

**4**

votes

**1**answer

385 views

### weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$.
$$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$
...

**0**

votes

**0**answers

43 views

### Non-existence for a sort of probability measures

We suppose $X$ solves our SDE $dX_{t}=-X_{t}dt+dW_{t}$ for $t\geq0$ with initial condition $X_{0}=0$ w.r.t to our measure $P$ on $(\Omega,\mathcal{F})$.
$W_{t}$ ist standard Wiener.
This solution is ...

**0**

votes

**1**answer

95 views

### Is it safe to work on a Cadlag modification of a Feller process?

Let $f$ be a continuous bounded function.
$X$ is a Feller process, and $\hat X$ is its Cadlag modification. By the definition of the modification, one can write
$$\mathbb E[f(X_t)] = \mathbb E[f(\hat ...

**1**

vote

**1**answer

23 views

### Problem of random scheduling of queues of tasks

Consider $L$ queues in a discrete time system. At each time $n=0,1,2,\ldots$, one task would arrive at one of the queues with equal probability $\frac{1}{L}$. Immediately after that, a task scheduler ...

**1**

vote

**1**answer

50 views

### Compactness of cadlag martingales w.r.t. to the point-wise topology

Given a sequence of cadlag (right-continuous with left limits) martingales $X^n=(X^n_t)_{0\le t\le 1}$, we may use the well known criteria to determine whether it is weakly convergent, i.e. subtract a ...

**5**

votes

**2**answers

327 views

### What is the optimal growth of the constant in BDG?

Let $X$ be a continuous local martingale, and $\langle X \rangle$ be its quadratic variation process. The "standard" proof of Burkholder-Davis-Gundy inequalities found in books yields $(\mathsf{E} ...

**5**

votes

**3**answers

133 views

### Product and convex combination of two stochastic matrices

Let $K_1$ and $K_2$ be two $N \times N$ stochastic matrices (hence non-negative and rows adding up to one) with zeros on the diagonal. If $\alpha \in (0,1)$, is it possible to have
$$K_1 K_2 = ...

**2**

votes

**2**answers

83 views

### A question about Skorokhod embedding problem

The Skorokhod Embedding Problem is well known and has many solutions. Now let $B=(B_t)_{t\ge 0}$ be a standard Brownian motion and $\tau$ be an embedding to the centered distribution $\mu$, i.e. the ...

**4**

votes

**1**answer

148 views

### Blumenthal and Kolmogorov 0-1 law

Blumenthal's 0-1 law see theorem 5.8/5.9 tells us that an event in the germ $\sigma-$ algebra has either probability zero or one with respect to a measure induced by a Brownian motion starting in some ...

**2**

votes

**1**answer

568 views

### Stochastic integrals as honest martingales — exponential damping

We have a given positive martingale ρt, with the dynamics:
$$\textrm{d}\rho_t = \lambda_t \rho_t \textrm{d}W_t$$
where $W_t$ is a standard Brownian motion. Now we have an "exponentially dampened" ...

**3**

votes

**1**answer

428 views

### Stochastic integrals as honest martingales — comparison criterion

We have a given positive martingale $\rho_t$, with the dynamics:
$$\textrm{d} \rho_t = \lambda_t \rho_t \textrm{d} W_t$$
where $W_t$ is a standard Brownian motion. Now we have a "dumped" process p_t:
...

**5**

votes

**2**answers

155 views

### Brownian motion in $n$ dimensions

Consider a particle starting at the origin in $\mathbb{R}^n$ and undergoing Brownian motion. Is there an expression known for the probability of the particle hitting the sphere $S^{n - 1}_r = \{x \in ...

**1**

vote

**0**answers

48 views

### Modify exponential family representation to a semimartingale

Given a filtered space $(\Omega, F,\mathcal{F}_{t})$ with rightcontinous filtration. We have a class of probability measures $P=\{P_{\theta}:\theta \in \Theta\}$ definied on the filtered space.
We ...

**1**

vote

**0**answers

35 views

### Factorization of the Fokker-Planck semigroup

I have posted this question on stackexchange over four month ago, but didn't get an answer: "In the classical theory of Markov processes, the Fokker-Planck semigroup $\{T_t:t\ge 0\}$ can be factored ...

**2**

votes

**1**answer

85 views

### Integral over a point process. Asymptotic of the dispersion

I consider an integral (or a sum with random index)
$$
M(t) =\int\limits_0^t f(t-u)dX(u),
$$
where
$$
X(u) = \sum\limits_{i=1}^{N(u)} \xi_i,\qquad N(u)=\max\{k: \tau_1+\,\dots,\,\tau_k\, <\, u\},
...

**3**

votes

**1**answer

325 views

### Convergence of random variables with hypergeometric distribution

This is a very interesting conjecture of large scale property of hypergeometric distribution.
Let $a>1$ be a integer constant, $N\in\mathbb{N_+}$, for any $x<N-1$, consider $N+(a-1)x$ balls in ...

**3**

votes

**1**answer

177 views

### Prediction with positive weights?

Consider a covariance function (positive definite function) on $\mathbb{Z}$:
$$
\gamma(k)=(1+|k|)^{-\alpha},\quad \alpha>0.
$$
It is guaranteed to be positive definite by Polya's criterion ...

**0**

votes

**0**answers

41 views

### methods to analyze martingale conditioned on return in the future

Consider a martingale $S_t$ on $\mathbb{Z}$ starting from 0. Assume that for any $t$, $Var[s_t\, | \, \mathcal{F}_{t-1}] < V$, where $V$ is some positive constant. Fix an $n$ and for $t \leq n$, ...

**0**

votes

**0**answers

43 views

### skorokhod integral as Weak Integral

Is it possible to express the skorokhod integral on a Banach space $B$ as a special case of the weak (or Pettis) integral over an appropriate Banach space $E$?
For example if $E$ is the space of ...

**5**

votes

**1**answer

214 views

### Does every smooth manifold carry a gaussian random field?

Let $M$ be an arbitrary finite-dimensional smooth manifold. For simplicity, let's assume that $M$ has no boundary. Does there always exist a gaussian random field with constant variance on $M$? If ...

**4**

votes

**0**answers

102 views

### regularity of zero point

We consider 1-d process $X$
$$ X(t) = b t + J_{t} + M_{t}$$
where $b$ is constant, $M$ is a continuous martingale process with
$M(0) = 0$, and
$J$ is a symmestric $\alpha$-stable process with its ...

**5**

votes

**2**answers

147 views

### Recurrence of Poisson binomial distributed random walk

Let $X_n$ be the outcome of a Bernoulli trial where the probability of getting 1 is $p_n$ and the probability of getting 0 is $1-p_n$, and let $S_n = \sum_{i=1}^n \left(X_i - \textrm{E} X_i \right)$. ...

**3**

votes

**1**answer

94 views

### Markov-semigroup sobolev inequality

I have a question about the following definition:
A probability measure $\mu$, such that the Markov semi-group $e^{Lt} \in L(L^2)$ exists and is symmetric, satisfies the Sobolev inequality iff for ...

**1**

vote

**1**answer

256 views

### Colored noise in SDE

I want to numerically study the behavior of a system described by a set of differential equations in the presence of colored noise. It seems that the standard procedure is to use the Langevin ...

**2**

votes

**0**answers

98 views

### Supermartingale inequality on a particular event

Say, I have a supermartingale $Y_t$ with respect to the filtration $F_t$. Let $T$ and $S$ two stopping times greater than $t>0$ such that on the event $A$, $T>S$, then since $Y_t$ is a ...

**0**

votes

**1**answer

117 views

### Functional representation of adapted jointly measurable stochastic processes

It seems like the question stated here in MSE has no answer yet and seems therefore for me to be not of a basic question type. For this reason I move it to MO.
Let $X_t : \Omega \to E, \ t \geq 0$ be ...

**1**

vote

**0**answers

64 views

### Finding a stochastic differential equation as limit of a discrete stochastic equation

I'm dealing with the following problem:
Choose $Z_0 \in [0,1]$ and define a process governed by the following discrete stochastic equation:
$Z_{k+1}-Z_k=P_k(1-2Z_k)$
where $P_k=0$ with probability ...