Questions tagged [stochastic-processes]
A stochastic process is a collection of random variables usually indexed by a totally ordered set.
2,354
questions
0
votes
0
answers
32
views
MDP Average Reward independent of Initial State
Consider a Markov Decision Process where the state space $S$ and the action space $A$ are continuous and compact.
In state $s$, if action $a$ is chosen and the next state becomes $s'$, the ...
0
votes
0
answers
52
views
White noise: a tempered distribution version of the stochastic convolution
Let $\xi$ be a space-time white noise, that is a centered Gaussian process with covariance $E[\xi_{f}\xi_h]=\int_{\mathbb{R}_+ \times \mathbb{R}^d}fh,$ for $f,h\in L^2(\mathbb{R}_+ \times \mathbb{R}^d)...
1
vote
1
answer
126
views
Feynman–Kac formula for other operators
I recently came across the Feynman-Kac formula which states that given an open domain $\Omega\in\mathbb{R}^n$ and $f \in L^2(\Omega)$
where $x \in \Omega$ and $t > 0$, then
$e^{t\Delta_D}f(x) = ...
-1
votes
0
answers
55
views
Stroboscopic sampling of a random process
Consider a random process that is an alternation of two phases, labeled "0" and "1".
The duration of phase events are governed by the exponential distributions, $Exp_{\lambda_0}(\...
1
vote
1
answer
36
views
translation invariance of expectation value of hit counting variable for Lévy process
Let $(X_t)_{t \in [0, \infty)}$ a $\mathbb{R}$- valued
Markov process (in my question I'm primary interested in dealing with Lévy process), $s, a, u >0$,
$I(a) :=
\{[k \cdot a, (k+1) \cdot a] \ : \...
0
votes
0
answers
39
views
Reference request: "doubly empirical" measure associated to a random measure
I am considering the following type of situation. Suppose we have a random probability measure, by which I mean a probability measure on a space of probability measures atop some Polish space $X$. In ...
1
vote
1
answer
46
views
Equivalence vs modification
Suppose that two processes have the same finite-dimensional distributions. Does there exist a coupling of them such that they are modifications of each other?
7
votes
2
answers
209
views
PDE for the probability of Brownian motion staying in an area (reference request)
I am looking for a (preferably some monograph) reference on the following fact:
$$
u ( t, x ) = \mathbb{P} \{ x + B_s \in A \ \text{for all} \ s \leq t \}
$$
satisfies the heat equation
$$
\frac{\...
4
votes
1
answer
226
views
What is the convergence rate of this "infinite monkey"-type probability?
Cross-posted from Math Stack Exchange, where it hasn’t received an answer yet:
Let $S$ be a finite set and $n,m\in\mathbb N$. Consider the process $R=(R_i)_{i\in\mathbb N}$ where all $R_i$ are iid ...
1
vote
0
answers
42
views
The limit ratio of two Markov Chain Probability
Suppose there are two given SDE in $\mathbb{R}^d$:
$$
\begin{align}
\left\{
\begin{aligned}
dX_t&=\begin{bmatrix}-\nabla V(X_t)+2\beta^{-1}v_F^\theta(X_t)\end{bmatrix}dt+\sqrt{2\beta^{-1}}dW_t,&...
0
votes
0
answers
82
views
Comparison between the expected values of the inverse of the CDF of binomial-distributed random variables
Let us denote with $F(x;j,\mu)$ the cdf of a Binomial distributed random variable with $j$ trial with success probability $\mu$ considered in $x$, and let $f(x;j,\mu)$ be the pmf. Defining $0\leq \...
3
votes
2
answers
103
views
What is the expected remaining life duration of a cell in the $t\to\infty$ limit?
Consider the following population model: We start with a population of a single cell at time $t=0$. Each cell divides into $k$ new cells at random times $T$ distributed according to a probability ...
1
vote
0
answers
94
views
A question about one Malliavin derivative calculation
Recently, I've asked here a question. While trying to find an answer on my own, I found an idea which I now will briefly describe below. I am not familiar enough with the Malliavin calculus, so my ...
1
vote
0
answers
86
views
Expectation of $B_u \operatorname{argmax}_t B_t$
This question is a repost from math.stackexchange. The question turned out to be harder than I initially thought, so I decided to try my luck here.
Yesterday I asked a question about the joint law of ...
2
votes
0
answers
51
views
Concentration result for self-normalized empirical process
In Theorem 1.1 of this paper by Bercu, Gassiat and Rio, a concentration result is derived for the 'self-normalized' empirical process. Specifically, suppose that $(X,X_n)_{n \ge 1}$ is a sequence of i....
1
vote
0
answers
36
views
Example of $F\in W_0^{1,2}$ a.s. so that the law of $F+B$ is equivalent to that of $B$ but DD exponential isn't integrable?
Is there an explicit example of progressively measurable $F=\int_0^\cdot f(s) ds\in W_0^{1,2}(0,1)$ a.s. so that the law of $F+B$ on $(0,1)$ is equivalent to that of a Brownian motion $B$ on $(0,1)$ ...
7
votes
0
answers
122
views
Stochastic analysis on nuclear Fréchet spaces
This is a reference request question, so to make it clear what I am after, I will give a quick outline of the area I am thinking in and some questions that arise.
A lot of the time in infinite-...
1
vote
0
answers
50
views
Derivative with respect to initial condition for the solution of an SDE
Suppose we have an SDE (assuming the Lipschitz continuous conditions required for the existence of the solution):
\begin{align}
dX_t = \mu(X_t,t)dt + \sigma(X_t,t)dW_t
\end{align}
and define its ...
2
votes
0
answers
41
views
Including fixed-time transitions into a continuous time Markov chain system
I have system which is mostly described by a CTMC (Continuous-time Markov chain) with a single absorbing state and a large but tractable and sparse transition matrix. However, at a fixed set of "...
10
votes
1
answer
462
views
The drunken blind man’s walk
Consider a drunk, blind man starting in the middle of the two dimensional open unit ball. At each turn, the man chooses a direction to move a step of size $\delta > 0$ in. Unfortunately, he is very ...
1
vote
0
answers
101
views
Solutions to ODE/SDE with singular coefficients $dX_t = -X_t/t \, dt + g\,dW_t$
I encountered a question regarding the solutions to SDEs with singular drifts. I searched the literature but had a hard time figuring out the intuition behind these analytic results assuming different ...
4
votes
0
answers
69
views
Does this filtration have a name?
In the context of Ethier&Kurtz Markov Processes: Characterization and Convergence (Chapter 4, equation (3.2)) as well as the two papers Martingale problems for conditional distributions of Markov ...
1
vote
0
answers
131
views
Ask assistance for finding K. Sato - Lévy Processes on the Euclidean Spaces
The paper me and my professor want is called K. Sato (1995) Lévy Processes on the Euclidean Spaces, Lecture Notes, Institute of Mathematics, University of Zurich.
I tried to find the paper on the ...
0
votes
0
answers
62
views
Asymptotic stochastic ordering for weighted sum of i.i.d. random variables
Are you aware of any literature focusing on the conditions such that for two i.i.d. sequences of discrete r.v.'s $\{X_n\}$ and $\{Y_n\}$,
\begin{equation}
a_1X_1+a_2X_2+\ldots+a_nX_n\geq_1 a_1Y_1+...
0
votes
1
answer
158
views
Construction of random tempered distributions
Let $(\xi_\phi)_{\phi \in L^2(\mathbb{R}_+ \times \mathbb{R}^d,\lambda_d)}$ be a collection of centered Gaussian processes on a probability space $(\Omega,\mathcal{F},P)$ such that $$\forall \phi \in ...
2
votes
1
answer
193
views
Decay estimate of moment of an SDE
We consider an SDE
$$
d X_t = b(t, X_t) \, dt + \sigma(t, X_t) \, d B_t,
$$
where $(B_t)$ is a $d$-dimensional Brownian motion on $\mathbb R^d$. We fix $p \in [1, \infty)$. Here $b, \sigma$ are ...
6
votes
0
answers
73
views
Error estimates for projection onto the Wiener chaos expansion for stochastic Sobolev spaces (stochastic Rellich–Kondrachov theorem)
Let $n$ be a positive integer, $s\in \mathbb{R}$, $(\Omega,\mathcal{F},(\mathcal{F}_t)_{t\ge 0},\mathbb{P})$ be a filtered probability space whose filtration supports and is generated by an $n$-...
3
votes
0
answers
76
views
A stochastic matrix $B = \lambda(\lambda I - A)^{-1}$ such that $B-B^2$ has a non-negative diagonal
I apologize if this is too elementary a question, but I have not been able to make much progress.
Consider a real matrix $A$ with $A_{ij} >0$ for $i \ne j$ and $\sum_{j} A_{ij} = 0$ for each $j$. ...
0
votes
1
answer
57
views
Does point process ordering ever imply conditional intensity ordering?
Let $N$ and $N'$ be regular/non-explosive point processes on $[0,\infty)$. I will take the view that these are collections of random arrival times: $N=(t_n)_{n\in\mathbb N}$ and $N'=(t_n')_{n\in\...
2
votes
1
answer
237
views
If Kolmogorov continuity criterion gives the optimal Hölder regularity then does the process have all moments?
Although very useful in the Gaussian (or other infinite moment) setting, Kolmogorov continuity criterion is non optimal in the finite moment setting. For example, let $X(t)=Zt$ where $Z$ is a random ...
3
votes
0
answers
69
views
Norm estimate for parabolic SPDE solution
When $X$ satisfies $${\rm d}X_t=\varphi_t{\rm d}t+\Phi_t{\rm d}W_t$$ on a Hilbert space $H$, where $W$ is a $Q$-Wiener process on a Hilbert space $U$, we know by the Ito formula that $$\|X_t\|_H^2-\|...
3
votes
0
answers
78
views
Finite dimensional distribution of a stochastic process Lipschitz on every relatively compact set
Let $X_t$ be a Markovian Itô diffusion process, defined by an SDE
\begin{equation}
dX_t = \mu(X_t)\,dt + \sigma(X_t)\,dW_t\,.
\end{equation}
Let $f(x,t|x_0,0)$ denote its transition density function. ...
3
votes
0
answers
88
views
Explicit example of drift $F$ so that the law of $F+B$ is not absolutely continuous with respect to $B$
Let $\mu_0$ be the law of Brownian motion on the space of continuous functions. If $\mu\sim\mu_0$ agrees on null sets then there is some progressively measurable $F\in W_0^{1,2}$ a.s. so that $\mu$ is ...
2
votes
0
answers
96
views
Brownian motion reflected at a trailing barrier
Let $X_t$ be a Brownian motion with positive drift starting at 0. The process with reflection at fixed barrier $b<0$ (sometimes called a "regulated Brownian motion") is:
\begin{equation}
\...
8
votes
2
answers
413
views
Optimally betting a beta-biased coin
This question is inspired by How to optimally bet on a biased coin? by Nate River but generalized slightly. I decided the generalization might be interesting enough to be its own question.
A number $p$...
0
votes
0
answers
72
views
Random walks on groups
I recently started reading Wolfgang Woess' book titled "Random Walks on Infinite Groups". In the section where he introduces Markov chains and random walks on a set $X$, he has defined a ...
2
votes
0
answers
159
views
Hunting an invisible target
An invisible target on the integer line starts at $0$. On each round it either stays put, moves to the left or moves to the right by $1$ with probability $\frac{1}{3}$ each. You are then asked to ...
20
votes
2
answers
3k
views
How to optimally bet on a biased coin?
A number $p$ is drawn uniformly at random from $[0, 1]$. You are then given a biased coin that turns up heads with probability $p$, but the number $p$ is not known to you.
You start with a total ...
2
votes
0
answers
103
views
Asymptotic Independence of random walks from increments?
Suppose we have two random walks $(S_n:n\geq 1)$ and $(T_n:n\geq 1)$ building from independent identically distributed increment vectors $\{(X_k,Y_k):k\geq 1\}$, i.e. $S_n=\sum_{k=1}^n X_k, T_n=\sum_{...
1
vote
0
answers
83
views
Gluing theorem for martingales
Let $M=(M_t)_{1\le t\le 2}$ be a continuous (resp. right-continuous) martingale. Denote $x:=\mathbb E[M_1]\in\mathbb R$. Can we construct on some probability space a continuous (resp. right-continuous)...
0
votes
1
answer
70
views
Why shocks are independent with weighted sum of normal process
I am doing a problem and got stuck by the definition of "normal process". The problem is stated as follows:
Suppose $e_t = \sum_{j}^{\infty}\theta^j Y_{t - j} $ and assume that $Y_t$ is a ...
2
votes
0
answers
57
views
SDE driven by Lévy processes
Consider a stochastic differential equation (SDE) on some filtered probability space $(\Omega, \mathcal F, \mathbb F, \mathbb P)$ : for all $t>0$
$$dX_t = u_tf(X_{t-})dt+ u_t g(X_{t-})dW_t + u_t\...
3
votes
1
answer
141
views
How many Uniform(L, H) RVs can be added up until their sum reaches a certain value?
I want to know how many consecutive i.i.d. RVs with:
$$X_{i} \sim\text{Uniform}(L, H)$$
can be added until the sum of them is greater than or equal to a certain value ($r$).
I'm calculating this for a ...
3
votes
1
answer
157
views
Simple linear asymptotics for leaving time of particle in open-boundary TASEP
EDIT: It appears the hypothesis may not be true - I am not sure. I therefore changed my question.
ORIGINAL QUESTION:
Consider a system $n$ linked discrete cells numbered $1 \ldots n$. Particles are ...
1
vote
1
answer
91
views
Interchange the deterministic and stochastic integrals
We fix $T >0$ and let $\mathbb T$ be the interval $[0, T]$. Let $(X_t, t \in \mathbb T)$ be a continuous adapted process on some filtered probability space $(\Omega, \mathcal A, (\mathcal F_t)_{t \...
2
votes
0
answers
89
views
Embedding a Markov chain in a Markov process
Let $X_{t\ge 0}$ be a Markov process with values in a metric space $(\mathcal{X},d)$ defined on a probabiltiy space $(\Omega,\mathcal{F},\mathbb{P})$ and let $(\tau_n)_{n=1}^{\infty}$ be a sequence of ...
2
votes
0
answers
70
views
Assumptions for uniform measure of SDE on manifolds
Suppose we're working on a compact, Riemannian manifold $M$. Suppose $dX_t = -b(X_t, t)\,dt + \sigma^2 \,dB_t$ is started at the uniform measure on $M$. What kind of assumptions on $b$ make it so that ...
3
votes
1
answer
185
views
Statistically stationary properties of expectations conditioned on the value of an Ornstein–Uhlenbeck process
Consider the modified Ornstein–Uhlenbeck process
$$\mathop{dx_t}=\theta(y_t-x_t)\, dt+{}\sigma\,dW_t$$
for a standard Brownian motion $W_t$ and $\theta,\sigma\in\mathbb{R}_{>0}$. Let's define the ...
0
votes
0
answers
80
views
Elliptic PDEs in BSDEs and in optimal control
This soft/reference question is related to this MO post of a similar nature.
What are some examples of elliptic PDEs appearing in control and BSDEs?
1
vote
0
answers
80
views
Regularity of Feynman-Kac formula for a simple diffusion
Let consider the diffusion process given by:
$$dX_t = \alpha(X_t) dW_t$$
where $\alpha(x) = \alpha_1\mathbf{1}_{x\geq 0} + \alpha_2\mathbf{1}_{x< 0}$ ($\alpha_1,\alpha_2>0$) and $W$ a Wiener ...