A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**6**

votes

**1**answer

334 views

### Birkhoff Ergodic Theorem and Ergodic Decomposition Theorem for Continuous-Time Markov Processes

I have a couple of questions regarding ergodicity for Markov processes in continuous time. (In particular, the first question seems like it should be particularly basic, and yet I haven't managed to ...

**4**

votes

**1**answer

190 views

### Stability of convergence in distribution under randomization

Suppose you have a sequence of non-negative stochastic processes $(X^n)_{t \in \mathbb{R}}$, $n \geq 1$, with continuous paths and continuous in $t$ such that
$$\int_{-\infty}^{\infty} X^n_t \, ...

**3**

votes

**1**answer

165 views

### Can't figure out “standard application” of the Garsia-Rodemich-Rumsey Lemma

I'm currently reading the paper http://arxiv.org/abs/0908.2473 and can't figure out what they call a "standard application" of the Garsia-Rodemich-Rumsey lemma (see p.8). Summed up, they have a ...

**2**

votes

**0**answers

51 views

### Almost sure transversality of smooth random maps

I still am novice as far as probability is concerned and after fruitlessly Googling for an answer for a few days I thought I might have a better chance with MO.
Let me first formulate the ...

**4**

votes

**0**answers

93 views

### Reference request: Stochastic integration and martingale theory on the whole real line

I'm looking for a thorough treatment of stochastic integration and/or martingale theory on the whole real line, i.e. a way to construct a Brownian motion $(B_s)_{s \in \mathbb{R}}$ (if a two-sided BM ...

**0**

votes

**1**answer

97 views

### Measurable functions lifted onto a space of point measures are measurable

I've been reading [1] and attempting to prove statements given without proof. In the paper the authors construct a measurable space of measures over a base space, and as an aside show an elegant way ...

**1**

vote

**2**answers

328 views

### Brownian motion of every point in the plane

Suppose every point in the plane undergoes brownian motion for a time t. What is the probability n particles ended up at 0? For n finite, countable or uncountable?
What proportion of the plane does ...

**0**

votes

**2**answers

95 views

### When does a stochastic process have its sample paths a.s. in the reproducing kernel hilbert space (RKHS) induced by its covariance function?

Let $T$ be a compact metrizable space. Consider a centered second order measurable process $(X_t\colon t\in T)$ with continuous covariance function $c(t,s):= \mathbb{E}X_t X_s$.
Are there any known ...

**0**

votes

**0**answers

57 views

### Reference for “Newtonian capacity estimates probability that A is hit by a Brownian motion”

I am looking for the following statement
"In fact, the Newtonian (logarithmic) capacity gives an estimate, up to a constant factor, the probability that A is hit by a Brownian motion started, say, ...

**44**

votes

**5**answers

3k views

### Escape the zombie apocalypse

Consider zombies placed uniformly at random over $\mathbb{R}^2$ with asymptotic density $\mu$ zombies/area. You are placed at a random point and can move with speed $1$. Zombies move with speed $v\leq ...

**0**

votes

**0**answers

91 views

### Probability that d-Brownian Motion ,$d\geq 3$, avoids a fixed set A

In other words, the probability that Brownian motion stays within $A^{c}$.
What about for connected and fixed compact sets ? Would that involve solving a heat equation? How can I condition it, so ...

**2**

votes

**1**answer

91 views

### Mutual information staying constant under composition of channels

Consider the following scenario: one has 2 communication channels $C_1$ and $C_2$. Denote by $p(x)$ the input probability distribution.
The mutual information between the input and the output of ...

**3**

votes

**2**answers

93 views

### Is this generating family of a measurable space of point measures a pi-system?

I'm learning some probability and measure theory and working my way through the first few paragraphs of [1]. My question is perhaps too basic for Math Overflow, but I hope it is welcome here.
Point ...

**4**

votes

**0**answers

433 views

### Progressively measurable vs adapted

I often see in stochastic calculus books the terms 'adapted process' and 'progressively measurable process'. I know there is a small difference between them (every progressively measurable process is ...

**0**

votes

**0**answers

27 views

### Explicit construction of transition semigroup from generator for completely independent spin system (Feller process)

As an example of how to obtain the transition semigroup from the probability generator for a Feller process, I am looking at the easiest spin system, namely with all sites independent.
Notationwise, I ...

**1**

vote

**0**answers

56 views

### Jumps of jump diffusions

Let $W$ be a Brownian motion and $N$ a Poisson random measure defined on $\mathbb R_+ \times \mathbb R_0^n$ ($\mathbb R_0^n:=\mathbb R^n-\{0\}$) with compensator $\tilde N(dt,dz):= N(dt,dz) - dt ...

**3**

votes

**1**answer

125 views

### Wiener measure of hitting sets A,B but not C (or easier hitting A but not C)

I am trying to formulate the measure of event
$E=\{B[0\infty)\cap A,B \neq \varnothing$ and $B[0\infty)\cap C= \varnothing\}$,
where $B[0\infty)$ is a Brownian path and $A,B,C$ are pairwise ...

**3**

votes

**1**answer

170 views

### An efficient method to find the MLE of the combination of two point processes

I have a point process defined in two parts as follows. Consider first the main process which we call $A$ which is homogeneous Poisson process with conditional intensity
$$\lambda(t) = \mu$$
For ...

**2**

votes

**1**answer

216 views

### weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$.
$$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$
...

**0**

votes

**0**answers

38 views

### Variance Gamma Distribution and Process

I have read that a variance gamma process $X_t=\theta G_t+\sigma W_{G_t}$ is such that $X_1\sim Variance Gamma(\theta,\sigma,\nu)$ but the variance gamma distribution has 4 parameters: $\mu$, ...

**0**

votes

**1**answer

47 views

### DTMC random walk model [closed]

For a discrete Markov chain random walk with p < 0.5 with state space S= {0,1,2..}
What is the stationary distribution?
I could use any help.
Thank you

**1**

vote

**1**answer

107 views

### Intuition for the definition of a probability generator of a Feller process

I am working with the definition of a probability generator of a Feller process as stated in Liggett's book, "Continuous time Markov processes":
Let $S$ be a compact state space and denote by $C(S)$ ...

**3**

votes

**1**answer

143 views

### Approximating Markov chains by Brownian motion

I would like a result along the following lines to be true, but haven't been able to locate it in the literature; pointers would be welcome.
Let $X_t$ be a finite-state, irreducible, aperiodic Markov ...

**0**

votes

**1**answer

101 views

### Combine results with different veracity [closed]

I have 3 neural networks processing 3 different vectors of values. Each NN processes a sample of it's vector and gives binary result (y/n) that is correct with given probability. All 3 NNs give answer ...

**1**

vote

**1**answer

124 views

### Branching Brownian Motion and the KPP equation

I have troubles understanding the proof of the connection between BBM and KPP equation. I mean the proof of the next lemma from the lecture notes of Anton Bovier about BBM, link. This is almost whole ...

**0**

votes

**1**answer

217 views

### On the superior of generalized Ornstein-Uhlenbeck process

Let us consider a generalized O-U process $X_t \in L^2[0, 1]$ defined by the following spde:
$dX_t = \frac{1}{2}\partial_x^2X_t + dW_t, $
$\partial_x X_t(0) = \partial_x X_t(1) = 0, $
$X_0 = 0, $
...

**1**

vote

**0**answers

69 views

### Variance of continuous stochastic process

In the paper "Directed Information, Causal Estimation, and Communication in Continuous Time" the author show an example of continuous Gaussian Channel:
Let $\{B_t\}$ be a standard Brownian motion and ...

**1**

vote

**1**answer

74 views

### Numerical computation of Skorokhod integral

How can I numerically compute the Skorokhod integral of a non-adapted process? If it is adapted, that is easy since the integral is just an Ito integral.
I have found that computing the Malliavin ...

**1**

vote

**0**answers

211 views

### random walk with reflecting barriers [closed]

Consider a random walk on the line 1,...,d. You start at point 1. At each step you flip a coin: heads means go left, tails means go right. If you're at 1 and get a heads, just stay where you are (same ...

**1**

vote

**0**answers

232 views

### Inflated independent samples for Monte Carlo estimation

In my particular problem, running an MCMC is too expensive, so I'm looking for a simple MC estimator, which would partially inherit the correlated samples of MCMC, yet would not require computing ...

**4**

votes

**3**answers

531 views

### How to explain “Feller process” to an undergraduate student?

I had to explain in informal terms what a Feller process was, to undergraduate students who understand Markov property, Poisson processes and such. It was easy to define Levy process as generalisation ...

**7**

votes

**1**answer

387 views

### Strong Markov property for Poisson point process

The question is thoroughly contained in the title. I just say that I would only like to find a reference for this question. I have searched in some books, to no avail.
Here is what I mean exactly. ...

**2**

votes

**0**answers

36 views

### Markov decision processes: action set revealed at point of decision

I have a problem which looks like a finite horizon Markov decision process (MDP), except the action space at each time is revealed at the decision making point. There is no way to know before hand the ...

**6**

votes

**0**answers

303 views

### Do isonormal Gaussian processes have measurable sample paths?

Let $H$ be a real separable Hilbert space. Let $W=\{W(h):h\in H\}$ be a real-valued stochastic process defined on a complete probability space $(\Omega,\mathcal{F},P)$. Assume that $W$ is a centered ...

**6**

votes

**2**answers

544 views

### References for a physicist migrating to stochastic processes

I've studied "Markov Chains" - Norris and "Measure, Integral and Probability" - Capinski, Kopp. Now, I'm looking for a couple of books (or other references) that help me bridging these two topics. ...

**2**

votes

**1**answer

106 views

### Increasing stochastic process

I have the following, seemingly simple question:
Consider a stochastic process $(X_t)$ satisfying $X_t\le X_s$ a.s. for all $t\le s.$ My question is: Does there exist a modification $\tilde{X}$ of ...

**4**

votes

**1**answer

237 views

### “Average” Voronoi diagrams without probability?

A plane Poisson process with uniform intensity scatters "sites" about the plane. If I'm not mistaken, in a sense the "average" Voronoi diagram of that set of sites is a honeycomb. I know it's been ...

**2**

votes

**2**answers

243 views

### How to calculate $P(\sum_{i=1}^{m}(A_i+S_i)\le L)$ with $A_i,L\sim\text{exp}(\lambda),S_i\sim\text{exp}(\mu)$ and positive integers $\lambda\neq\mu$?

Recently I was stumped by the calculation of the probability
$$\mathbb{P} \big(\sum_{i=1}^{m} (A_i + S_i) \le L < \sum_{i=1}^{m+1} (A_i + S_i) \big)$$
where $A_i \sim \text{exp}(\lambda), S_i \sim ...

**0**

votes

**1**answer

169 views

### maximum of certain Gaussian processes

Let $\mathbf{a}_k\in\mathbb{C}^n$ for $k=1,2,\ldots,m$ be i.i.d. standard complex normal random vectors with distribution $c\mathcal{N}(0,\mathbf{I})$. I am interested in a tight upper bound on the ...

**0**

votes

**0**answers

23 views

### Examples of POMDPs where the actions impact the transitions of the underlying markov Chain

I am not sure if the following is a legitimate question for this board.
I am looking for examples of Partially observed Markov decision processes (preferably infinite horizon, Discrete time, Discrete ...

**5**

votes

**1**answer

287 views

### Properties of the algebraic self-difference set of Brownian motion zeros

As I was trying to exhibit new interesting(?) path transformations of Brownian motion, I became interested in
the (random) set of times $t$ such that $B(t)=B(t+1)=0$, where $B(t)$ denotes a standard ...

**2**

votes

**1**answer

233 views

### Equicontinuity and $L^2$ convergence imply uniform convergence

I'm currently working through an old Paper of Garsia, Rodemich and Rumsey (A Real Variable Lemma) and theres one thing i don't get. Suppose $(f_n)_{n\in\mathbb{N}}$ is a sequence of continuous real ...

**2**

votes

**1**answer

121 views

### What are the generalized Gaussian probability laws that are infinitely divisible?

We consider the probability density, often called a generalized Gaussian density, $$p_{\alpha}(t) \propto \exp (- |t|^\alpha),$$
with parameter $0<\alpha<\infty$. For $p = 2$, we recognize a ...

**2**

votes

**1**answer

30 views

### probabilistic distribution of given data

let us consider following model
$$y(t)=A_1 \sin(\omega_1 t+\phi_1) + A_2 \sin(\omega_2 t+\phi_2) + A_3 \sin(\omega_3 t+\phi_3)+ \ldots +A_p \sin(\omega_p t+\phi_p)+z(t)$$
we have three parameter ...

**1**

vote

**0**answers

61 views

### question related to Tanaka Formulae

Supposse $X=(X_t)$ is a cadlag martingale taking values in $\mathbb{R}$. If $f:\mathbb{R}\to\mathbb{R}$ is a convex function, then we have Tanaka Formulae. Now let $g: ...

**1**

vote

**0**answers

92 views

### Eigenvalues of matrix products [closed]

Hi my problem is with row stochastic matrices. Its known that if we keep multiplying this row stochastic matrices, we will get a rank one row stochastic matrix. Rank one means that all the rows has ...

**1**

vote

**1**answer

47 views

### question about the optimal decomposition of supermartingale

Given a filtered probability space $(\Omega, \mathbb{F}, \{\mathcal{F}_t\}_{0\le t\le 1}, \mathbb{P})$, let $X$ be a cadlag martingale and $V$ be cadlag supermartingale. Suppose $V$ has the following ...

**1**

vote

**1**answer

274 views

### Comparing the expected stopping times of two stochastically ordered random processes (Added:(14.05.2014))

Information:
a-) $X$ and $Y$ are two continuous random variables on $\mathbb{R}$ having continuous distribution functions $F$ and $G$ with $G(y)\geq F(y)$ for all $y$.
b-) $S^X_n=\sum_{i=1}^n X_i$, ...

**0**

votes

**0**answers

51 views

### Is Feller process time-homogeneous?

The first question is just the title. The second question is that can a Feller process which is not a Levy process has the same infinitesimal generators as Levy process? I am confused in the ...

**8**

votes

**3**answers

558 views

### A question on Cramer's theorem

Almost everybody is familiar with Cramer's theorem: a sum $X+Y$ of of independent random variables is normal if and only if both $X$ and $Y$ are normal. Are there any other classes of distributions ...