A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**4**

votes

**1**answer

94 views

### Stopping times for Brownian motion

Let $B_t, t\geq 0$ be standard Brownian motion.
Let $\big(\mathcal{G}_t, t\geq 0\big)$ be the natural filtration, defined by $\mathcal{G}_t=\sigma(B_s, 0\leq s\leq t)$.
Define also a filtration $\...

**4**

votes

**0**answers

106 views

### Hierarchical (Recursive) Random Walk Model

Consider the following hierarchical (recursive) random walk model.
For the first level $\ell=1$, let $\{X_t^{(\ell)}\}_{t=1}^{T}$ be a (discrete) random walk.
For the next level $\ell=2$, we ...

**2**

votes

**1**answer

56 views

### Calculate Moments of SDE

I have posted a similar question on math.stackexchange (http://math.stackexchange.com/questions/1848492/calculate-mean-of-sde), but didn't find anyone who could help.
I'm interested in the one-...

**0**

votes

**0**answers

27 views

### About Ito integral of power of brownian motion

Using Ito's lemma, one can get the following expression for Ito integral of monomials:
$\int_0^TW(t)^ndW(t) = \frac{1}{n+1}W(t)^{n+1} - \frac{n}{2}\int_0^TW(t)^{n-1}dt.$
What can we say about the ...

**1**

vote

**1**answer

68 views

### Is there an easy way to convert a non-deterministic optimal policy to a deterministic optimal policy for a given MDP?

For a MDP (Markov Decision Process) is there an easy way to convert a non-deterministic optimal policy into a deterministic optimal policy?
The trivial way will take $O(|\mathcal{A}|^{|\mathcal{S}|}$...

**6**

votes

**1**answer

96 views

### Stochastic Analogue of Stokes Theorem

Dynkin's formula can be thought of as the stochastic version of the Fundamental Theorem of calculus,
$$E^x[f(X_{\tau})]=f(x)+E^x\left[\int_0^{\tau}Af(X_u)du\right],$$
where $\tau$ is a first exit time ...

**0**

votes

**1**answer

33 views

### Convergence of an inhomogeneous markov chain

A markov chain is defined as $X_t=F(X_{t-1})X_{t-1}$, where $X_t$ and $X_{t-1}$ are both vector. So the transition matrix depends on the current states. I want to show that for any given initial ...

**2**

votes

**1**answer

65 views

### Version of Donsker-Invariance-Principle

Assume we have a Levy process $(X_t)_{t\geq 0}$ with a finite second moment for all $t>0$. For simplicity, say $\operatorname{Var}\left[X_1\right]=1$. Let $\tilde{X}_t:=X_t-t\cdot E\left[X_1\right]$...

**6**

votes

**2**answers

96 views

### Uniform Concentration Bounds on Weighted Sum of i.i.d. Bernoulli Random Variables

Let $\delta_1,...,\delta_n$ be $n$ independent identically distributed Bernoulli random variables with $\mathbb{P}(\delta_1=1)=p$. We consider a set $\Omega = \{\mathbf{a}:=(a_1,...,a_n)~|~a_i\in [0,c/...

**0**

votes

**1**answer

32 views

### Analyzing a multiple-queue single-server model

Consider the following multiple-queue single-server model of a packet network problem. At each discrete time $t=0,1,\ldots,n$, a packet may arrive at the server R with probability $1-\epsilon_1$. The ...

**0**

votes

**0**answers

69 views

### Variation on stones in buckets

This is a spinoff, see Collecting stones in n buckets. Frankly speaking my only motivation is that I became curious: what happens if one redistributes the stones into the same buckets?
More ...

**4**

votes

**1**answer

197 views

### Collecting stones in n buckets

There are $n$ stones distributed in $n$ buckets (initially one stone in each bucket). At each step the content of each bucket is put in a random bucket, chosen independently out of a set of $n$ new ...

**0**

votes

**0**answers

42 views

### Conditions for supremum and conditional Expectation to commute

I am working with a continuous process $Y_t$ generating the filtration $(F_t)$ and have (for simplicity) two stopping times $\tau_1$ and $\tau_2$ such that $\tau_2 \leq \tau_1$ and $U:\Bbb R\...

**0**

votes

**0**answers

65 views

### Given $\mathbb Q$ and $X_t$ is $\mathbb Q$-Brownian, find $\frac{d\mathbb Q}{d\mathbb P}$ / Uniqueness of Brownian or Radon-Nikodym derivative

The problem:
Let $T >0$, and let $(\Omega, \mathscr F, \{ \mathscr F_t \}_{t \in [0,T]}, \mathbb P)$ be a filtered probability space where $\mathscr F_t = \mathscr F_t^W$ where $W = \{W_t\}_{t \...

**2**

votes

**1**answer

97 views

### Example of progressively measurable process that is not predictable

Is there an example of progressively measurable process that is not predictable?
This question is motivated by Revuz-Yor, Continuous Martingales and Brownian Motion http://www.springer.com/gb/book/...

**0**

votes

**1**answer

287 views

### Generalized Ito's lemma

I have the following quantity:
$$
g(t)=(f(t))^{M_{t}},
$$
where $M_{t}$ is a jump process which is neither Markovian nor Levy, and $f(t)$ is a positive, increasing but limited, right-continuous ...

**6**

votes

**1**answer

109 views

### Basic Definition and Notations in RWRE

From the definition of Zeitouni's lecture notes on RWRE: $(V, E)$ is a special graph, and $N_v:= \{k \in V: (v,k) \in E\}$ is the neighborhood of $v \in V$. $\Omega = \prod_{v \in V} M_1(N_v)$ ...

**4**

votes

**1**answer

493 views

### weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$.
$$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$
...

**1**

vote

**0**answers

51 views

### Stochastic process with discontinuous drift

While studying a portfolio optimization problem, I came across the process
$$dX(t) = X(t)\,\Big(\,\big(\mu - \alpha\,1_{\{X(t)\,\geq\,C\}}\big)\,dt + \sigma\,dW(t) \Big)$$
which has a discountinuous ...

**2**

votes

**0**answers

66 views

### Differentiability of a simple value function driven by a diffusion

Consider a diffusion given by,
$d X_t = \mu(X_t) dt + \sigma(X_t) dB_t$
$X_0 = x$.
Suppose the functions $\mu$ and $\sigma$ are as follows -
$f(x) = \mu(x) = \sigma(x) = \begin{cases} 2 & \...

**1**

vote

**1**answer

100 views

### Problem of random scheduling of queues of tasks

Consider $L$ queues in a discrete time system. At each time $n=0,1,2,\ldots$, one task would arrive at one of the queues with equal probability $\frac{1}{L}$. Immediately after that, a task scheduler ...

**7**

votes

**0**answers

56 views

### Distribution of the stopping time of an autoregressive sequence

Consider $e_t$ be i.i.d. uniformly chosen from $\pm 1$. Let $\eta$ be a small positive constant. What is the distribution of $T$ such that $\eta^{0.5} (1+\eta)^T W_T$ first hits $\pm 1$, in which
$$
...

**0**

votes

**0**answers

34 views

### Boundary behavior for Ito diffusions

The classification of boundary behavior for a time-homogeneous diffusion satisfying an Ito stochastic differential equation (SDE) is well known. According to the Feller classification, there are four ...

**1**

vote

**0**answers

37 views

### Probability for a SRW to be at some place in an even number of steps

I am looking for some references for the following problem.
Consider a graph $G$ and a simple continuous time random walk $(X_t)_{t\geqslant 0}$ on this graph. Consider the family of events $(e_t)...

**2**

votes

**1**answer

258 views

### Does random walk have more concentration surrounding the origin?

Consider a simple random walk $S_n$ on one dimension, starting at $0$. In this case, $S_n$ fluctuates between $-\infty$ and $\infty$, but intuition says that it might stay more often in an interval ...

**2**

votes

**0**answers

66 views

### Progressive measurability and functional composition

Suppose we have a progressively measurable process $X$ taking values in $\mathbb{R}^d$.
What are sufficient conditions on a function $$f( x, t, \omega ) \colon \mathbb{R}^d \times [0,\infty) \...

**5**

votes

**2**answers

170 views

### Frequency of visiting states in Markov chains

Given a finite, ergodic Markov $\{X_i\}$, and two natural numbers $a>b$. Let
$$p=P\left[\forall n, \sum_{k=n}^{n+a-1} \mathbf{1}_m(X_k)\leq b\right]$$
where $\mathbf{1}_m(X_k) =1$ if $X_k=m$ and 0 ...

**1**

vote

**1**answer

128 views

### A problem about the quotient space of an extended Dirichlet space

Let $(\mathscr{E},\mathscr{F})$ be a recurrent Dirichlet form on $L^2(X;m)$ and $\mathscr{F}_e$ the corresponding extended Dirichlet space, then $1\in\mathscr{F}_e$ and $\mathscr{E}(1,1)=0$. Let ${\...

**1**

vote

**1**answer

91 views

### Limit of first passage time

I have a conjecture that seems rather obvious but the proof seems elusive.
Consider a diffusion given by,
$dX_t = \mu(X_t) dt + \sigma(X_t) db_t$
where $b_t$ is a standard Brownian motion.
$\mu,\...

**4**

votes

**1**answer

165 views

### Transition semigroup of Ito diffusion on $L^2(\mathbb{R})$

I am considering the transition semigroup $P_t$ associated with the Ito diffusion process
$$dX_t=b(X_t)dt+\sigma(X_t)dB_t,$$
where the coefficients are assumed to be Lipschitz continuous.
I hope to ...

**1**

vote

**1**answer

95 views

### Finding a stochastic differential equation as limit of a discrete stochastic equation

I'm dealing with the following problem:
Choose $Z_0 \in [0,1]$ and define a process governed by the following discrete stochastic equation:
$Z_{k+1}-Z_k=P_k(1-2Z_k)$
where $P_k=0$ with probability $...

**0**

votes

**0**answers

33 views

### Adiabatic elimination of a variable in a system of nonlinear stochastic ODEs?

If this is too basic for MathOverflow... say the word and I shall move it to Math.SE
First consider this system of ODEs. Say I have two variables $u$ and $a$, following
$$
\dot u = -u + f(a)
$$
$$
\...

**4**

votes

**1**answer

149 views

### Can all Local Martingales Be Represented using Only Brownian Motion and Finite Variation Processes?

This is a cross-post of my unanswered (more than a week) question on Math.SE. Since it covers topics from my graduate-level course on stochastic processes, I thought it might be appropriate to try to ...

**1**

vote

**1**answer

277 views

### Supremum of a martingale

Let $(X_n)$ be a martingale. What can be said about the distribution of its maximum over a window of fixed length:
$$M_n = \max_{n-10 \leq k \leq n} X_k$$ or about the "range" over a window:
$$R_n = \...

**5**

votes

**2**answers

1k views

### Random walk to stay in an interval forever

Consider a random walk on the real time, starting from $0$. But this time assume that we can decide, for each step $i$, a step size $t_i>0$ to the left or the right with equal probabilities.
To ...

**1**

vote

**0**answers

102 views

### Strong law of large number for semimartingale

I just want to know if for semimartingale $X$ we have $\lim_{t \rightarrow \infty} \frac{X_{t}}{\langle X\rangle_{t}}=0$ or when it is possible. I know it is true for Brownian motion.
Thanks

**1**

vote

**0**answers

41 views

### Power spectrum of the difference of two Poisson processes with equal rates

I am studying the asymptotic properties of a dynamic a model involving the difference of two balanced Poisson processes (i.e., $\lambda_1 = \lambda_2$). I recently discovered the Skellam Distribution ...

**1**

vote

**1**answer

67 views

### The (infinite) invariant measure of an SPDE

Consider a 1-dimensional stochastic heat equation on $[0, 1]$, with boundary conditions of Neumann's type:
\begin{equation}\left\{
\begin{aligned}
&\partial_t u(t, x) = \frac{1}{2}\partial_x^2 u(...

**0**

votes

**1**answer

422 views

### Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...

**1**

vote

**1**answer

137 views

### Scaling of First-passage times for Random Walk on integer lattices

Consider simple symmetric random walk $S_{n} = (S_{n}^{(1)},\dots,
S_{n}^{(d)})$ on the d-dimensional integer lattice with starting point the origin.
Let $\tau_{N}$ be the first time $S_{n}$ exits ...

**4**

votes

**0**answers

66 views

### I have an embedding $\iota$ between two Hilbert spaces and want to know if $\iota\iota^\ast$ is something simple like an orthogonal projection

I'm reading A Concise Course on Stochastic Partial Differential Equations. In Proposition 2.5.2 the authors define the notion of a cylindrical $Q$-Wiener process $W$. It turns out that $W$ is just a $...

**1**

vote

**0**answers

25 views

### Reference Request: $M_t/M_t/1/K$ queue length distributions

I am investigating functionals defined over sequences of discrete probability distributions related to dynamical/stochastic system performance. As an initial step, I am searching for references that ...

**0**

votes

**0**answers

17 views

### Nonparametric estimation in diffusion

Fan and Wang
In the above paper, the Authors provide estimators for the squared spot volatility process $\left(\sigma^{2}_{t}\right)_{t\geq 0}$.
My question is how to find estimators for the process ...

**3**

votes

**2**answers

178 views

### Lévy measure and Lévy process

A Lévy measure $\nu$ on $\mathbb R^{d}$ is a measure satisfying
$$\nu\{0\} = 0, \ \int_{\mathbb R^{d}} (|y|^{2}\wedge 1) \nu(dy) <\infty.$$
A Lévy process can be characterized by triples $(b, A, \...

**3**

votes

**1**answer

101 views

### On the spectrum of stationary Gaussian process

What is the condition for ergodicity, weakly mixing, and strongly mixing properties of Gaussian process in terms of its spectrum?
In a similar way let us consider a stationary vector valued Gaussian ...

**1**

vote

**1**answer

62 views

### Uniqueness of invariant measure for equivalent transition probabilities

Suppose $P(x,dy)$ and $Q(x,dy)$ are two Markov transition kernels on a topological space $E$ equipped with Borel $\sigma$-algebra $\mathcal B(E)$. Suppose for every $x \in E$, $P(x,\cdot)$ and $Q(x, \...

**0**

votes

**0**answers

99 views

### Radon-Nikodym for continuous time processes

Likelihood theory for statistical inference concerning stochastic processes in continuous time are well used. How ever i've found no real literature concerning the fundamentals.
What is know from ...

**2**

votes

**2**answers

741 views

### Change of time or change of measure

Consider simple diffusion $dX_t = \sigma dw_t$ and a parameter $a>0$ and $X_0=x$. Let us denote $Y_t = X_{at}$ - thus we made a change of time. Let us denote an original measure as $P$. How to find ...

**0**

votes

**0**answers

55 views

### invariant measure for piecewise deterministic Markov process with only measurable switching intensity

Let $L$ denote the extended generator of a Markov process $(X_t)$ on a locally compact space with domain $\mathcal D(L)$. This means that for all $f \in \mathcal D(L)$, the process
$$ f(X_t) - f(X_0) -...

**13**

votes

**1**answer

183 views

### Convergence of an implicitly defined sequence of random variables

Let $\{X_n\}_{n\ge 1}$ be a sequence of independent identically distributed Poisson random variables with mean $\lambda^*$. Consider a sequence of random variables $\{\hat{\lambda}_{n}\}_{n\ge 1}$ ...