Questions tagged [stochastic-processes]
A stochastic process is a collection of random variables usually indexed by a totally ordered set.
201 questions
4
votes
0
answers
804
views
Feynman-Kac formula for domains with boundary
As far as I know (I am not an expert), any solution of the heat equation on $\mathbb{R}^n$ or on a closed Riemannian manifold with the given initial condition can be presented in terms of stochastic ...
- 21.8k
4
votes
1
answer
694
views
Concurrency related problems in $n$ independent, parallel $M/M/1$ queues
Queueing Model:
Consider $n$ independent, parallel $M/M/1$ queues with identical arrival rate $\lambda$ and service rate $\mu$. For each $M/M/1$ queue, we use the FCFS (First Come First Served) ...
- 139
4
votes
1
answer
829
views
Probability that a "closable" self-avoiding random walk forms a polygon
Consider a self-avoiding random walk on an infinite graph (for concreteness, the grid of 2-dimensional lattice points $\mathbb{Z}^2$), in which on each step, the next position is chosen uniformly at ...
- 141
4
votes
1
answer
447
views
Area enclosed by Brownian motion (without winding number)
The question Average Value of Area Closed by Brownian Motion turned out to be about the Lévy area process, which measures "signed area with multiplicity" enclosed by Brownian motion (e.g. each ...
- 29.7k
4
votes
2
answers
367
views
Fokker-Planck equation for a truncated process
Let $X_t = x + bt + \sigma W_t$ be an arithmetic Brownian motion, where $x$ is a random variable independent to $W$, and $\sigma>0$. Suppose the initial distribution is given by $\mathbb P(X_0 \in ...
- 1,399
3
votes
1
answer
277
views
Question on the martingale representation theorem
Let $(X_t)_{0\le t\le 1}$ be a continuous Markov martingale (with respect to its natural filtration) s.t. $X_0=0$ and $X_1\in\{-1,1\}$. Can we prove the existence of some measurable function $\sigma: [...
- 1,334
3
votes
1
answer
315
views
Strong blow up limits for SDE
Note: This is a strengthening of the following result, motivated by the need for strong convergence in applications.
Let $W$ be a one dimensional standard Brownian motion, and let $X$ be the solution ...
- 6,155
3
votes
2
answers
297
views
Does my construction always result in a stationary Poisson point process of intensity $1$? How so?
My construction is as follows: Let $X_k$ be a real-valued continuous random variable centered at $k$ (an integer), having distribution $F_k(x,s)$ where $k$ is the location parameter and $s$, a ...
- 3,098
3
votes
2
answers
331
views
Extreme couplings
Let $X,Y$ be Polish spaces, and $\mu$ and $\nu$ are probability measures on $X$ and $Y$ respectively. We say that $M$ is a coupling of $\mu$ and $\nu$ if it is a probability measure on $X\times Y$, ...
- 1,655
3
votes
0
answers
516
views
The distribution of collision stopping time in 2D random walk
Assume two particles A at $(0, 0)$ and B at $(a, b)$ in 2D discrete grid, both of them have the same possibility of $\frac{1}{4}$ for moving up/down/left/right (i.e. 2D random walk). We define the ...
3
votes
2
answers
264
views
Probability of one species reaching zero before the other in a Markov process on a 2d lattice
$\textbf{Background}$: Say we've got a two-variable system of stochastic chemical reactions, with quantities $\vec{x}(t) = (x_1(t),x_2(t)) \in \mathbb{N}^2$ evolving according to the following system, ...
- 41
3
votes
0
answers
78
views
Modify exponential family representation to a semimartingale
Given a filtered space $(\Omega, F,\mathcal{F}_{t})$ with rightcontinous filtration. We have a class of probability measures $P=\{P_{\theta}:\theta \in \Theta\}$ definied on the filtered space.
We ...
3
votes
2
answers
973
views
How much larger than the relaxation time can the mixing time be?
The notation is mostly taken from the book "Markov chains and mixing times" by Levin, Peres, and Wilmer.
Consider an irreducible, aperiodic, time-reversible, discrete-time Markov chain on a finite ...
- 1,269
3
votes
1
answer
902
views
Exercise on a hitting time for a Brownian Motion
I'm following Chapter 3 of "Brownian Motion", by Peres and Mörters, about The Dirichlet Problem(DP). As it is known, in order to obtain existence and uniqueness of a solution for DP it is necessary to ...
- 203
3
votes
1
answer
1k
views
Strong solution for geometric brownian motion with varying drift and volatility
I have an equation of the form:
$$dX_{t}=\mu(X_{t})X_{t}dt+\sigma(X_{t})X_tdZ_{t}$$
I know that if I wrote it as $dX_{t}=\mu(X_{t})dt+\sigma(X_{t})dZ_{t}$, I would need strong assumptions on the ...
- 315
3
votes
2
answers
194
views
A Really Simple Stochastic Dynamic Billiard
Consider the following stochastic dynamical system.
Fix $a > 0$, $b > 0$, $c>0$ and $v > 0$, and let $\mathbf{r}(t)=(x(t),y(t),z(t))$ be the position at time $t$ of a point which moves ...
- 640
3
votes
1
answer
127
views
A Simple Stochastic Dynamic Billiard
Consider the following stochastic dynamical system.
Fix $a > 0$, $b > 0$, and $v > 0$, and let $\mathbf{r}(t)=(x(t),y(t))$ be the position at time $t$ of a point which moves in the ...
- 640
3
votes
1
answer
1k
views
How can we define the Stratonovich integral rigorously?
Let
$T>0$
$(\Omega,\mathcal A,\operatorname P)$ be a probability space
$(\mathcal F_t)_{t\in[0,\:T]}$ be a right-continuous filtration on $(\Omega,\mathcal A)$
$B$ be a Brownian motion on $(\Omega,...
- 167
3
votes
1
answer
475
views
Numerical computation of Skorokhod integral
How can I numerically compute the Skorokhod integral of a non-adapted process? If it is adapted, that is easy since the integral is just an Ito integral.
I have found that computing the Malliavin ...
- 33
3
votes
1
answer
2k
views
On a reflecting Brownian motion and its boundary local time
I have a question about a reflecting Brownian motion and its boundary local time.
Bass and Hsu studied the existence of Reflecting Brownian motion and boundary local time on a bounded Lipschitz ...
- 721
3
votes
1
answer
233
views
Brownian level sets and continuous functions
Let $V_t$ and $W_t$ be independent standard Wiener processes ($t\ge 0$, $W_t,V_t\in\mathbb R$).
Let $C$ be the event that there is a continuous function $f$ such that for all $s$, $t$,
$$
W_t=W_s\iff ...
- 24.8k
3
votes
1
answer
474
views
Orthonormal frame bundles on a manifold
Let $(\mathcal{M},g)$ be a torsion free compact Riemannian manifold of dimension $n$. Hence from the metric we know there is an associated horizontal sub-bundle $H_u F \mathcal{M}$ of the orthonormal ...
- 396
3
votes
1
answer
218
views
Pathwise linearization of diffusion processes
Let $W$ be a standard $n$-dimensional Brownian motion, and $X$ the diffusion process given by the solution to the SDE
$$dX_t = \mu(X_t) \, dt + \sigma(X_t) \, dW_t,$$
with $\mu: \mathbb R^n \to \...
- 6,155
2
votes
1
answer
413
views
Is it true that all stationary measurable stochastic processes are "measurably stationary"?
(Philosophically, the following question is of a similar flavour to A stochastic process that is 1st and 2nd order (strictly) stationary, but not 3rd order stationary, but more "advanced".)
Let $(\...
- 708
2
votes
1
answer
3k
views
Empirical estimator fot the total variation distance on a finite space
I have two probability measures $p$ and $p'$ on a finite set $X$ which I do not know precisely, but which I can sample from. I would like to estimate their total variation (omitting multiplier $2$):
$$...
- 1,655
2
votes
1
answer
49
views
Infinite-variance associated processes are (BL, $\theta$)-dependent
Setting and definitions
Let $X = \{X(t), t \in T \}$, $T \subset \mathbb{Z}$, be an infinite-variance associated stochastic process, i.e.
$$
\text{Cov}(f(X(I)), g(X(J))) \geq 0
$$
for all finite ...
- 299
2
votes
1
answer
596
views
Question about the exit time of a time-homogeneous Itô diffusion
Consider a one-dimensional Itô diffusion:
$$\mathrm{d} X_{t}=b\left(X_{t}\right) \mathrm{d} t+\sigma\left(X_{t}\right) \mathrm{d} B_{t}$$
where $X_0 = 0$ and $B_t$ is the standard Brownian Motion. ...
- 331
2
votes
1
answer
533
views
Time interval of existence of an SDE solution with locally Lipschitz drift
Consider the stochastic ODE $$
dX = F(X) \, dt + dB
$$
where $B$ is Brownian motion. If the drift $F$ is locally Lipschitz, then the solution exists and is unique over $[0,T]$ where $T$ is an "...
- 51
2
votes
1
answer
493
views
Is the solution to this SDE always positive?
Let $W$ be a standard one dimensional Brownian motion, and consider the SDE
$$dX_t = \sigma(X_t) \, dW_t, \, \, \, X_0 = 1 \, \text {a.s.}$$
Assume $\sigma$ is regular enough that the above SDE admits ...
- 6,155
2
votes
2
answers
416
views
Short time limits for SDE
Let $W$ be a standard one dimensional Brownian motion, and let $X$ be the solution to the SDE
$$dX_t = \sigma(X_t) \, dW_t \;, \quad X_0 = x_0\;.$$
where $\sigma:\mathbb R \to \mathbb R$ is a ...
- 6,155
2
votes
0
answers
66
views
Is $F: \mathbb T \times \mathbb R^d \times \Omega \to \mathbb R^d$ (constructed from Itô integral) Borel measurable in the product $\sigma$-algebra?
$
\newcommand{\RR}{\mathbb{R}}
\newcommand{\TT}{\mathbb{T}}
\newcommand{\NN}{\mathbb{N}}
\newcommand{\PP}{\mathbb{P}}
\newcommand{\EE}{\mathbb{E}}
\newcommand{\FF}{\mathbb{F}}
\newcommand{\PPP}{\...
- 835
2
votes
2
answers
11k
views
How to Calculate the Expectation and Variance for Stochastic Integral with correlated Brownian Motions
Right now I dont know how to find the expectation and the variance for the following stochastic integral:
$$\int_{0}^t B(s) dW(s)$$
where $B(t)$ and $W(t)$ are correlated standard Brownian Motions ...
- 135
2
votes
1
answer
191
views
Range of $a$ such that $w \leftarrow w-a x \langle w, x \rangle$ converges almost surely?
Suppose $x_i$ come from 2-d standard Normal centered at 0. What is the range of $a$ for which the following iteration converges almost surely?
$$w_{i+1} = w_i-a x_i \langle w_i, x_i \rangle$$
For 1-d, ...
- 2,442
2
votes
3
answers
458
views
More natural example of measurable but not progressive process
All examples of measurable but not progressive processes I have ever seen seemed to be based on the huge difference between $\mathcal{F}$ and $\mathcal{F}_\infty$. Here is what I mean.
Consider ...
- 620
2
votes
0
answers
47
views
Asymptotic behaviour of the solution to some delayed stochastic differential equation
Consider the delayed stochastic differential equation as below:
$$dX_t^\theta=X_{(t-\theta)^+}^\theta(1-X_{(t-\theta)^+}^\theta)(dt+dW_t),\quad \forall t>0$$
$$dY_t^\theta=Y_{(t-\theta)^+}^\theta(1-...
- 1,389
2
votes
1
answer
638
views
$L^p$-convergence of submartingale
Let $p\geq1.$ Consider a $\mathcal{F}_k$-submartingale $(X_k)_k$ in $L^p.$ We can prove easily that $(X_k)_k$ converges in $L^p$ if and only if $(|X_k|^p)_k$ is uniformly integrable.
If $(X_k)_k$ was ...
- 249
2
votes
1
answer
246
views
Can we construct close martingales if their terminal marginal laws are close?
Let $M=(M_t)_{0\le t\le 1}$ be a real-valued continuous martingale. Let $\mu := {\rm Law}(M_1)$ and $\varepsilon \in (0,1)$. For any $\nu$ satisfying $W_2(\mu,\nu)\le \varepsilon$, can we construct ...
- 1,389
2
votes
1
answer
773
views
On the continuity of map $\Gamma$
Let $M$ be the space of right continuous functions $\ell: \mathbb R_+\to [0,1]$ that are non increasing s.t. $\ell(0)=0$. Define the map $\Gamma : M\to M$ by $\Gamma[\ell](t):=\mathbb P[\tau^{\ell}>...
- 1,334
2
votes
1
answer
404
views
Feynman-Kac formula for lattice heat equation with non-diagonal potential
Suppose that $X$ is the continuous-time simple symmetric random walk on the lattice $\mathbb Z^d$ (i.e., a simple symmetric random walk with i.i.d. exponential jump times), and let
$$u(t,x):=\mathbf E\...
- 891
2
votes
1
answer
640
views
Reachability for Markov process
Let $X$ be a Markov process (in continuous or discrete time) and define an event
$$
R(T,A) = (\exists t\leq T: X_t \in A).
$$
I have seen in one paper that
$$
\Pr[R(\infty,A)] = \sup\limits_{\tau} \...
- 1,655
2
votes
0
answers
193
views
If the operators $B_i'$ satisfy an inequality, prove that $B_1'+\dotsb+ B_n'$ also satisfies the same inequality
Related: On a deceptively tricky calculus problem.
The way that Leonard Gross proves the log Sobolev inequality is in the following stages:
He proves that for any operator $B$ that satisfies the log ...
- 90
2
votes
1
answer
760
views
If a continuous function of a Markov martingale is a martingale, does the function have to be affine linear?
Let $M$ be an almost surely continuous martingale that is not almost surely constant in time - that is, it is not the case that almost surely, $M_t = M_0$ for all $t$.
Assume further that $M$ is a ...
- 6,155
2
votes
1
answer
236
views
Self-adjointness of generator and semigroup of an SDE
$
\newcommand{\bR}{\mathbb{R}}
\newcommand{\bE}{\mathbb{E}}
\newcommand{\bT}{\mathbb{T}}
\newcommand{\bP}{\mathbb{P}}
\newcommand{\bF}{\mathbb{F}}
\newcommand{\cF}{\mathcal{F}}
\newcommand{\eps}{\...
- 835
2
votes
1
answer
124
views
Limiting behavior of $k^{th}$ order statistics of n non-i.i.d chi square random variables
This is related to one of my previous questions here.
Let $(Z_1, Z_2, \ldots, Z_n)\sim N(0, \Omega)$, where $\Omega = (1-\mu) I_{n\times n} + \mu \boldsymbol{1}_n\boldsymbol{1}_n^\top $. Here $\...
- 399
2
votes
1
answer
309
views
A bound for the occupation time of a diffusion
Let $\sigma: \mathbb R \times \mathbb R \to \mathbb R$ be a Lipschitz continuous function bounded below by some $M > 0$.
Let $W$ be a standard Brownian motion, and let $X$ be the solution to the ...
- 6,155
1
vote
2
answers
278
views
Is integral of adapted separable process adapted?
Assume $f(t,\omega)$ is (i)separable, (ii) measurable as function from $((0,T)×\Omega)$ into $R$ and (iii) is adapted to the filtration $F_t, 0<t<T$
Also $\int_0^Tf^2(s)ds<\infty$ almost sure....
1
vote
1
answer
300
views
Convergence of concave/convex function
Let assume that you have a sequence of twice differentiable functions $(f_n)_{n\in\mathbb{N}}\in\mathscr{C}^2(\mathbb{R})^{\mathbb{N}}$. Let suppose that for each $f_n$, it exists a $x_n\in\mathbb{R}$ ...
- 393
1
vote
1
answer
260
views
Garsia-Rodemich-Rumsey without Markov
Let $X$ be a $\mathbb R^d$ valued continuous stochastic process. I am interested in bounding $$P(\|X\|_\gamma>R).$$
The standard technique to do so, is to apply Markov inequality and then Garsia-...
- 1,904
1
vote
0
answers
99
views
Expectation of $B_u \operatorname{argmax}_t B_t$
This question is a repost from math.stackexchange. The question turned out to be harder than I initially thought, so I decided to try my luck here.
Yesterday I asked a question about the joint law of ...
- 620
1
vote
1
answer
99
views
Comparison of hitting probability of two Markov chains both with only one absorbing state version 3
Let $N_n:=\{1,2,\cdots,n\}$. Given two finite states Markov chains $\big(X^{(j)}_t\in N_n\}\big)_{t=0}^\infty$ for $j\in\{1,2\}$, both of which have two absorbing states at $1$ and $n$. Define
$p_{i,j}...
- 2,239