All Questions
Tagged with markov-chains stochastic-calculus
18 questions
2
votes
0
answers
41
views
Approximate the adjoint generator of the discretization of an SDE
Let
$d\in\mathbb N$;
$\sigma\in\mathbb R^{d\times d}$;
$p\in C^1(\mathbb R^d)$ be positive with $$c:=\int p(x)\;{\rm d}x<\infty\tag1$$ and $$b:=\frac12\Sigma\nabla\ln p;$$
$(X_t)_{t\ge0}$ denote ...
- 167
4
votes
0
answers
328
views
Convergence to unique stationary distribution for SDEs and Markov processes
I am interested in understanding the behavior of solutions to stochastic differential equations (SDEs) and continuous-time Markov processes with constant coefficients. Specifically, I would like to ...
- 807
0
votes
0
answers
101
views
Simulation of Markov processes with exponential timestepping
Let $(Y_t)_{t\ge0}$ be a time-homogeneous Markov process with transition semigroup $(\kappa_t)_{t\ge0}$. Numerical simulation of $(Y_t)_{t\ge0}$ can be done in the following way:
Choose an initial ...
- 167
5
votes
2
answers
369
views
Markov process on a torus with prescribed invariant distribution
In Euclidean space, $\mathbb R^d$, the Langevin diffusion $${\rm d}X_t=b(X_t){\rm d}t+\sigma(X_t){\rm d}W_t\tag1,$$ where $\sigma:\mathbb R^d\to\mathbb R^{d\times k}$, $$b:=\frac{\Sigma+U}2\nabla\ln p+...
- 167
2
votes
0
answers
103
views
Find a function $f\geq 0$ such that $e^{-t[(x-\partial_x)\partial_x]^2} f$ is not non-negative for some $t\geq 0$
Consider the square of the Ornstein-Uhlenbeck operator $$A=[(x-\partial_x)\partial_x]^2=(x-\partial_x)\partial_x (x-\partial_x)\partial_x.$$ We know that $[(x-\partial_x)\partial_x]^2$ cannot be a ...
- 90
0
votes
1
answer
262
views
Construction of a Markov process with prescribed local behavior and state-dependent jump distribution
Let
$(E,\mathcal E)$ be a measurable space
$\mathcal E_b:=\left\{f:E\to\mathbb R\mid f\text{ is bounded and }\mathcal E\text{-measurable}\right\}$
$(\kappa_t)_{t\ge0}$ be a Markov semigroup on $(E,\...
- 167
0
votes
0
answers
236
views
Canonical Markov process and abstract Markov process
I have the following question:
Why do some books work with the canonical Markov process instead of just the abstract one, as from my point of view they both share exactly the same properties in terms ...
2
votes
1
answer
101
views
Preservation of the Markov Property under Conditioning
Let $(X_t,Z_t)_t$ be an $\mathbb{R}^{n}\times \mathbb{R}^m$-valued time-homogeneous Markov process on a filtered probability space $(\Omega,\mathcal{F},(\mathcal{F}_t)_t,\mathbb{P})$ with transition ...
- 77
1
vote
0
answers
276
views
Path dependent Markov property
Let's consider a function $\Psi\in \mathcal{C}_B(\mathcal{C}[t,T])$ continuous and bounded
\begin{align*}
\Psi \colon \mathcal{C}[t,T] \longrightarrow [0,+\infty)
\end{align*}
Then my question is:...
- 159
2
votes
0
answers
41
views
If a stochastic flow is Fréchet differentiable in the spatial parameter, does the induced transition semigroup preserve differentiability?
Let $(\Omega,\mathcal A,\operatorname P)$ be a probability space, $(E,\mathcal E)$ be a measurable space, $X:\Omega\times[0,\infty)\times E\to E$ be $(\mathcal A\otimes\mathcal B([0,\infty))\otimes\...
- 167
2
votes
1
answer
827
views
Calculate Radon-Nikodym derivative
For the laws of two pure-jump Markov processes $\mu_1$ and $\mu_2$ on $\mathbb R^n$, which generators are
$H_1f(x)=\int h(x,dy) (f(y)-f(x))$
and $H_2f(x)=\int e^{-g(x,y)} h(x,dy) (f(y)-f(x))$ (...
- 31
2
votes
0
answers
74
views
Literature/Book on counting processes
I seek literature that makes a rigorous treatment of counting processes. In particular im interested in a precise treatment of the conditional intensity $\lambda_t$ which is often informally defined ...
- 315
3
votes
1
answer
199
views
Markov-semigroup Sobolev inequality
I have a question about the following definition:
A probability measure $\mu$, such that the Markov semigroup $e^{Lt} \in \mathcal{L}(L^2)$ exists and is symmetric, satisfies the Sobolev inequality ...
- 259
0
votes
0
answers
73
views
Strong Markov Property of the joint process $(B_t,L_t)_{t\ge 0}$
Let $B=(B_t)_{t\ge 0}$ be a Brownian motion and $L=(L_t)_{t\ge 0}$ be its local time in zero. Given two strictly increasing functions $\phi_1$, $\phi_2: \mathbb R_+\to\mathbb R$ such that $\phi_1(0)=\...
- 1,835
0
votes
1
answer
175
views
Monte Carlo estimator with autocorrelated samples
Given an integration problem $I=\int{f(x)dx}$, we can construct an ordinary Monte Carlo estimator as
$E[I]=\sum\limits_i\frac{f(x_i)}{p(x_i)}$
where the samples $x_i$ are usually i.i.d. and drawn ...
- 101
8
votes
4
answers
1k
views
Invariant measure of Euler-Maruyama Discretisation of an Ito diffusion
Let $(X_t)_{t \geq 0}$ be a diffusion process with dynamics governed by the stochastic differential equation
\begin{equation}
dX_t = b(X_t)dt + \sigma(X_t)dW_t, ~~ X_0 = x_0,
\end{equation}
where $b,\...
- 203
0
votes
1
answer
2k
views
Markov Chain: state reduction
Hi I am trying to understand a proof in a paper (written by Isaac Sonin), I don't know if anyone could give me a clarification on the following:
Firstly we have a Markov chain $\{Y_k\}$ with finite ...
- 23
4
votes
1
answer
383
views
initial condition of a diffusion approximation
I am trying to prove that a certain sequence of Markov chains $x^N_k$ converges towards a diffusion process. The invariant measure of $x^N$ is $\pi^N$ and the Markov chain $x^N$ is started in ...
- 2,133