A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**2**

votes

**1**answer

45 views

### Concurrency related problems in $n$ independent, parallel $M/M/1$ queues

Queueing Model:
Consider $n$ independent, parallel $M/M/1$ queues with identical arrival rate $\lambda$ and service rate $\mu$. For each $M/M/1$ queue, we use the FCFS (First Come First Served) ...

**1**

vote

**1**answer

73 views

### Quantiles moments and Convergence

QUESTION:
Let $F$ be an absolutely continuous distribution function with density $f$, and $F_{n}$ be its nth empirical distribution. Suppose that $t\in (0,1)$ is constant. Is true the convergence
...

**7**

votes

**1**answer

281 views

### About the convergence rate for an approximation to the heat kernel

Let $G(t,x)$ be the heat kernel
$$
G(t,x)=\frac{1}{\sqrt{2\pi t}}e^{-\frac{x^2}{2t}}, \quad t>0, \:x\in\mathbb{R}.
$$
Here is one approximation to $G(t,x)$:
$$
G_\epsilon(t,x)=e^{-t/\epsilon} ...

**8**

votes

**3**answers

689 views

### Compactness of the set of densities of equivalent martingale measures

Consider an incomplete market $(\Omega,\mathcal F,\mathbb P)$ driven by a semimartingale $S=(S_t)_{t\in[0,T]}$. Under the no free lunch under vanishing risk (NFLVR) assumption, the set $\mathcal ...

**2**

votes

**0**answers

52 views

### Tail for the integral of a diffusion process

I would like to compute the following tail,
$$
\mathbb{P}\left(\int_{0}^{T} f(X_t)\mathrm{dt}>x\right),
$$
assuming
$$
\mathbb{P}[f(X_t)>x] = x^{-\alpha} \log(x),
$$
and $X$ is a diffusion ...

**0**

votes

**0**answers

40 views

### Restarting a Markov chain [migrated]

I'm reading an article and having difficulty understanding some basic stochastic processes (I'm new to the subject so please pardon my wording of the question). Let $S$ be a set of states and $Q$ be a ...

**4**

votes

**1**answer

71 views

### On the moments of Lévy processes

For a Brownian motion $B_t$, the evolution of the moments with $t$ obeys the simple rule:
$$\mathbb{E}[|B_t|^p] = \kappa_p |t|^{p/2},$$
with $\kappa_p<\infty$. The proof only requires to remark ...

**2**

votes

**1**answer

122 views

### Transition probabilities in coupled Markov chains

I know that for a continuous-time Markov chain, the probability of transition from time $0$ to $t$ is given by $P(t)=e^{Q(t)t}$. I have a system of $N$ interdependent continuous-time Markov chains ...

**1**

vote

**0**answers

82 views

### Fundamental theorem of calculus for iterated stochastic integrals

I'm trying to find the rate (or a bound for it) with which an iterated integral of the type
$$\int_{-h}^0 \int_{-h}^{t} A_s d B_s A_t d B_t$$
converges to zero (in probability/distribution) for $h ...

**6**

votes

**1**answer

151 views

### Properties of the time integral of Wiener process

Let $W_t$ be a Wiener process and consider the time integral
$$ X_T:= \int_0^T W_t dt $$
It is often mentionend in literature that $X_T$ is a Gaussian
with mean 0 and variance $T^3/6$.
I am ...

**1**

vote

**0**answers

39 views

### A counterpart of Karhunen theorem

According to the Karhunen theorem, if the correlation function of a process $X(t)$
can be represented as
$$
R(t,s)= \int_{\Lambda} f(t, \lambda) \overline{f(s, \lambda)}d\nu(\lambda)
$$
then the ...

**1**

vote

**2**answers

85 views

### Invariant measure of Euler-Maruyama Discretisation of an Ito diffusion

Let $(X_t)_{t \geq 0}$ be a diffusion process with dynamics governed by the stochastic differential equation
\begin{equation}
dX_t = b(X_t)dt + \sigma(X_t)dW_t, ~~ X_0 = x_0,
\end{equation}
where ...

**1**

vote

**1**answer

87 views

### M/M/1 Queue with probability of new customer leaving [closed]

I'm looking at a M/M/1 queue system and trying to show that $\{M_t\}_{t\geq}0$, the number of clients in the system, is a birth-death process. In the simplest of cases this is true if $\lambda_i = ...

**2**

votes

**0**answers

113 views

### Heat kernel and Wiener measure

A theorem by Barry Simon says that for arbitrary open sets $\Omega\subset \mathbb{R}^n$, we have $$[\exp(t\Delta_{\Omega}^D)](x,y) = \mu_{x,y,t}\lbrace \omega \text{ } \vert \text{ } \omega(s) \in ...

**1**

vote

**0**answers

77 views

### number of times Brownian motion hits boundaries

Any experts here please direct me to some appropriate keywords that I can search for. Consider a Brownian motion constrained to an upper and lower boundaries. Let's say I want to know that how many ...

**2**

votes

**3**answers

67 views

### a special filtration satisfying $0$-$1$ law

Let $\xi$ be a uniformly random variable on $[0,1]$ defined on some probability space $(\Omega,\mathcal{F})$. Define the process $\xi_t:=\min(\xi,t)$ for $0\le t\le 1$. And let ...

**2**

votes

**1**answer

76 views

### multiplication of two ergodic and stationary processes

If X and Y are stationary and ergodic processes, then, is XY a stationary and ergodic process?
I think the answer is true, but I do not know how to find the mean (we do not know Y and X are ...

**1**

vote

**1**answer

59 views

### A calculation involving a uniform random variable quantile

THE PROBLEM:
Let $U$ be a uniform distribution and $U_{n}$ be its nth empirical distribution. Suppose $t\in (0,1)$ and $n\in \mathbb{N}$ are constants. What's the explicit expression to
...

**1**

vote

**1**answer

68 views

### question about uniform continuity under Skorokhod Metric

Let $D=D([0,1], \mathbb{R})$ be the space of cadlag functions $x$ with $x(0)=0$ and $x$ is continuous on $1$. If we endow $D$ with Skorokhod Metric, see:
http://en.wikipedia.org/wiki/C%C3%A0dl%C3%A0g
...

**3**

votes

**1**answer

234 views

### simultaneous jumps of independent Levy processes

Suppose I have two independent Levy processes $X_t$ and $Y_t$, both not continuous.
Is anyone familiar and can refer me to a result(or a counterexample) which states that
${\displaystyle \sum_{0\leq ...

**0**

votes

**1**answer

55 views

### Running supremmum of a Levy process

Let X be a cadlag Lévy process with $X_0=0$ and let $p$ be a real number in $[1,\infty)$. Then, the following are equivalent.
1): $X$ is $L^p$-integrable.
2): $X^*_t= \mathop{\sup}_{0\leq s\leq t} ...

**5**

votes

**1**answer

919 views

### Gluing Markov processes

I am looking for a reference on the gluing together of strong Markov processes to get a new one.
Here is an example of what I have in mind. Let $B^1, B^2, \ldots $ be independent one-dimensional ...

**5**

votes

**1**answer

302 views

### On the pathwise uniqueness of solutions of SDEs(Stochastic Differential Equations)

Suppose that $(\Omega,\mathscr{F},P)$ is a complete probability space equipped a filtration $\{\mathscr{F}_t\}$ satisfying the usual conditions. $B_t$ is a 1-dimentional Brownian motion with respect ...

**0**

votes

**0**answers

26 views

### a question about Dambis, Dubins-Schwarz Theorem

Let $M=(M_t)_{0\le t\le 1}$ be a continous $\mathbb{F}=\{\mathcal{F}_t\}_{0\le t\le 1}$-martingale s.t. $M_0=0$. Now my question is whether there exists a Brownin motion $B$ s.t.
...

**9**

votes

**1**answer

315 views

### Fictitious density of paths of diffusion processes outside the Cameron--Martin space

Let $X_t$ be an $n$-dimensional diffusion process satisfying the following Itō SDE over $[0,1]$:
$$dX_t = f(X_t)\,dt + dW_t,$$
where $W_t$ is an $n$-dimensional Wiener process and $f$ is of class ...

**0**

votes

**0**answers

53 views

### Fredholm Integral Involving Stochastic Process

I wish to solve an integral equation of the form $$g(X) = c\int_0^1 K(X,t)f(t) \ dt $$ where $f\in L^1([0,1])$ and $g$ is some function on finite sequences of random variables. So, $X$ is a stochastic ...

**0**

votes

**0**answers

20 views

### what is the autocorrelation function for a continuous autoregressive model

Suppose the stochastic process h(t) follows the following dynamics:
$\dot{h}(t)=a h(t)+z(t)$
where $a<0$ and $z(t)$ is the standard complex Wiener process. What is the autocorrelation for ...

**0**

votes

**0**answers

20 views

### How to get expectation of function of an optimal stopping time

Let $P_t$ be the posterior probability, $p_0$ be the prior probability. The evolving process of $P_t$ is: $ dP_t=\frac{P_t}{P_t+(1-P_t)(1-\lambda^kdt)}-P_t$.
The optimal stopping time problem is ...

**1**

vote

**1**answer

54 views

### explicit characterization of the stochastic integrand

Let $V$ be a cadlag positive supermartingale with the following decomposition:
$$V_t=V_0+\int_0^tH_sdX_s-K_t$$
where $X$ is a cadlag local martingale and $K$ is an adapted increasing process with ...

**0**

votes

**0**answers

28 views

### a question about the modification of a supermartingale

Let $\mathbf{D}\subset\mathbf{D}([0,1],\mathbb{R}_+)$ denote the space of positive cadlag functions $\mathbf{x}$ defined on $[0,1]$ with $\mathbf{x}(0)=1$. Define the canonical process
...

**6**

votes

**3**answers

236 views

### Markov Processes with Given Marginals

Let $\mu_t, t \geq 0,$ be a family of probability measures on the real line. One can assume whatever one wishes about them, although typically they will be continuous in some topology (usually at ...

**2**

votes

**1**answer

72 views

### Convergence of iterated stochastic matrices

It is well-known that for a stochastic aperiodic matrix $M$,
the sequence $(M^n)_n$ converges.
Here I would like to a have a more precise analysis. Consider now a sequence of stochastic matrices ...

**5**

votes

**1**answer

215 views

### Convergence rate for product of stochastic matrices

Hi,
I have a system of the form $$x(t+1) = A(t + 1) x(t),$$ for $t \geq 1$, and some fixed initial condition $x(1)$. Here $A (t)$ is a time-varying $m \times m$ matrix that is stochastic at all ...

**2**

votes

**1**answer

85 views

### right-continuity of filtration

For a natural filtration of a stochastic process (possibaly multi-dimensional) to be right-continuous, what conditions should the process satisfy? Any references?

**3**

votes

**1**answer

142 views

### Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by:
$X_{i}= h(i) + \varepsilon_i $,
$h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$
where $\{\varepsilon_i\}$ are i.i.d. ${\cal ...

**-1**

votes

**0**answers

72 views

### a question about integration by parts

Let $X$ be a cadlag martingale et $Y$ be a process of bounded variation, do we have the integration by parts formulae?
$$\int_0^1Y_tdX_t=X_1Y_1-X_0Y_0-\int_0^1X_tdY_t,~ a.s.$$
Thanks for the reply!

**4**

votes

**2**answers

90 views

### Smoothness of $g(t,x)=\mathbb{E}[f(X_T)|\mathcal{F}_t]$

Assume a process with Itô dynamics of the generic form
$$dX_t=\mu(t,X_t)dt+\sigma(t,X_t)dW_t$$
and let $f:\mathbb{R}\to\mathbb{R}$ be borel-measurable. Is the following function smooth ?
...

**1**

vote

**0**answers

62 views

### question about Doob-Meyer decomposition

Given a filtered probability space and let $X$ be a cadlag local martingale defined on this space. Let $V$ be a cadlag supermartingale and assume we know the following decomposition:
...

**2**

votes

**0**answers

119 views

### Feynman-Kac theorem: probabilistic proof of existence of solution to parabolic PDE

Friedman (in his book: PDEs of Parabolic Type) shows how to construct a solution to the Cauchy problem
$$
\partial_t u(t,x) = b(x) \partial_x u(t,x) + \frac{1}{2} \sigma(x)^2 \partial_{x,x} u(t,x)
$$
...

**1**

vote

**1**answer

41 views

### Quasi-stationary distribution for a death process

In the paper, Survival in a quasi-death process by van Doorn and Pollett, the quasi-stationary distribution of a transient CTMC is discussed and QSD for a simple death process is derived.
Consider a ...

**1**

vote

**0**answers

84 views

### Arctic Circle Theorems and the Wave Equation

I've seen the following remark in a number of papers but don't know what to make of it. In this paper by Cohn, Elkies and Propp, it is mentioned that the normalized average Height function ...

**4**

votes

**2**answers

177 views

### Probability of winding number of 2D Brownian Motion

Let $B_t$ be a 2D Brownian Motion with $B_0 = (1,0)$. Now, express $B_t$ in polars, that is, $B_t = (r(t), \theta(t))$. Let $\tau = \inf\{t > 0 : \theta(t) \geq 2 \pi \}$. What is $\mathbb{P}[\tau ...

**3**

votes

**0**answers

74 views

### Ito Integral of a SDE [closed]

I would like to get help in solving the following It\^o stochastic equation:
$dY_t=-dW_t \, (Y_t^2+1)$
The process $W_t$ is the standard Brownian motion.
If possible I would like to get a path ...

**1**

vote

**1**answer

99 views

### Strong solutions on SDE (stochastic differential equations) with discontinuous drift and diffusion coefficients

I want to get some advice from you about the existence (and the uniqueness if possible) of a strong solution on my SDE. In fact, due to the structure of the problem that I consider, both the drift ...

**2**

votes

**0**answers

81 views

### Stationary Distribution for Markov-like system?

Let
\begin{equation}
A=
\begin{pmatrix}
0 & a_{1,2} & a_{1,3} \\
a_{2,1} & 0 & a_{2,3} \\
a_{3,1} & a_{3,2} & 0
\end{pmatrix},
\end{equation}
\begin{equation}
B=
...

**7**

votes

**3**answers

241 views

### Maximum of the expectation of maximum of Gaussian variables

Suppose $X=(X_1,\ldots,X_n)$ is a Gaussian vector with each entry $X_i$ marginally distributed as $\mathcal{N}(0,1)$. Want to find out the possible maximum of
$$\mathbb{E}\max_{1\le i\le n}|X_i|$$
and
...

**3**

votes

**1**answer

136 views

### log-likelihood of ito diffusion

Consider a diffusion process:
$ \text{d}X_t = f(X_t)\text{d}t + \text{d}W_t$
I've seen it given that the log-likelihood of the path is proportional to the Onsager-Machlup functional
$ \int_0^T ...

**2**

votes

**0**answers

66 views

### Learning resources for Probability Distributions/Models [closed]

I've a good background in basic probability. I need to learn and get a good grip on the probability distributions and stochastic processes, counting processes, and other related topics.
I am already ...

**3**

votes

**0**answers

74 views

### Nonlinear Markov process

Consider the following nonlinear $\mathbb{R}$-valued stochastic recursive sequence:
$ X_{n+1} = F(X_n) + W_{n+1}, \quad (W_n)_{n\ge1} \stackrel{ \scriptsize \mathrm{i.i.d.} }{ \sim } \phi. $
How can ...

**1**

vote

**0**answers

61 views

### asymptotic estimate of random walk involved hitting time and return time

Consider a reversible random walk on (say) $\mathbb{Z}$, are there any estimate for the following probability $\mathbb{P}(\tau_n=m<\tau_0^+)$ where $\tau_n$ is the first hitting time at site n and ...