A stochastic process is a collection of random variables usually indexed by a totally ordered set.

learn more… | top users | synonyms

1
vote
2answers
173 views

On the existence and uniqueness of solution to SPDE with nonlinear growth coefficients

Consider the SPDE $$\frac{\partial}{\partial t}u_t(x) = \frac{\kappa}{2}\frac{\partial^2}{\partial x^2}u_t(x) + u_t(x)(K-u_t(x)) + \sigma u_t(x) \xi(t,x),$$ where $(t,x)\in {\mathbb R}_+\times ...
2
votes
1answer
160 views

Transition probabilities in coupled Markov chains

I know that for a continuous-time Markov chain, the probability of transition from time $0$ to $t$ is given by $P(t)=e^{Q(t)t}$. I have a system of $N$ interdependent continuous-time Markov chains ...
1
vote
0answers
275 views

What is the characteristic functional for Brownian motion on a sphere?

I'm a physicist, somewhat familiar with stochastic processes, but I'm a little unsure of what follows. What I basically have is a complicated quantity involving a vector that is equivalent to ...
3
votes
2answers
338 views

Any suggestions on a rigorous stochastic differential equations book?

I have been looking through some books and they are not very rigorous. Any suggestions would be great.
4
votes
1answer
73 views

Relative vulnerabilities in SIS epidemic model

Consider the SIS model of epidemic spreading. There is a finite graph $G(V,E)$, link infection rates $\lambda_{ij}$ and node recovery rates $\mu_i$. There are a few initial nodes which are infected at ...
2
votes
1answer
146 views

A question about stochastic kernels and invariant measures

Suppose that $E$ is a metric space, let $\mathcal{B}_E$ denote the set of its Borel subsets and suppose that $\mu$ is a probability measure on $(E,\mathcal{B}_E)$. In addition, suppose that $p:E\times ...
0
votes
0answers
85 views

An extension of first order stochastical dominance property

A random variable $X$ (distributed as $F$) is said to be stochastically larger than $Y$ (distributed as $G$), ($X>_{FSD}Y$) if their distribution functions satisfy $G(y)>F(y)$ for all $y$. It ...
5
votes
1answer
109 views

Deviation bound for the maximum of the norm of Wiener process

Let $W(t)$ be an $n$-dimensional Wiener process. Denote by $\chi_n^2$ a chi-squared random variable with $n$ degrees of freedom. I have recently found the following inequality given without proof: $$ ...
5
votes
1answer
109 views

A question about extensions of Markov semigroups

I'm cross-posting this question from MSE. It's the first time I do this so I'm unsure of etiquette regarding how to cross-post, if this irritates anyone please vote this down and I'll delete the post. ...
3
votes
1answer
126 views

Generalization of Lévy's continuity theorem for nuclear spaces

I am interested in a generalization of the following finite-dimensional results in infinite dimensional vector-space with nuclear structure, especially for the cases of the spaces of distributions ...
2
votes
0answers
117 views

On the infinitesimal generator of a 1-dimensional stochastic heat equation: core and explicit form

Denote $E = C([0, 1])$. I am consider a 1-dimentional stochastic heat equation on $h$: $\partial_tu(t, x) = \partial_x^2u(t, x) - V'(u(t, x)) + \dot{W}(t, x)$, for all $(t, x) \in (0, ...
4
votes
1answer
170 views

A queuing process where customers must be detected

Imagine a scenario where customers arrive in some queue according to a Poisson process with rate parameter $\lambda_{arr}$, and where the process of responding to the customers has a kind of ...
1
vote
0answers
69 views

Discreet customers at more or less discrete counters

A bank has $N$ counters in a row, and customers arrive irregularly at an average of 1 per minute (say, according to a normal distribution with variance $\sigma^2$ – but I don't think that is ...
0
votes
1answer
124 views

On the expected value of a random integral:

Is it possible to find the expected value of $u(t)$ in terms of the following information: $$u(t)=\int_{0}^{t}(t-s)(f(s)+(T-s)Y)X_sds$$ where: $X_s$ is a wide sense stationary process with known ...
4
votes
2answers
288 views

Wiener measure and Bochner Minlos

I am reading probability theory and I have a question. The Bochner-Minlos theorem roughly says that if we have $E \subset H \subset E^*$ where $H$ is a Hilbert space, then there is a unique measure ...
0
votes
1answer
232 views

Bounds on the eigenvalues of a random binary matrix

Consider $A$, a random binary matrix of zeros and ones in $\mathbb{R}^{{M\times N}}$, and $M>N$. We assume that $P(a_{i,j}=0)=P(a_{i,j}=1)=0.5$ (although I appreciate any advice on the case of ...
0
votes
0answers
79 views

Eigen value distribution of autocorrelated Wishart matrix

Suppose the matrix W is constructed as $W=XX^T$ where $X_i(t) = \phi_i X_i(t-1) + a_i(t)$, and $a_i(t)$ ~ $N(0,1)$. I am interested in knowing the eigen value distribution of W. My google search on ...
1
vote
2answers
160 views

A Claim on Typical Voronoi Cells

I am trying to prove the following claim (may be it has been proven). Claim: Consider a set of points $\phi=\{x_1,x_2,...,x_i,...\}$ generated by a homogeneous PPP with rate $\lambda$ in the 2-D ...
-1
votes
1answer
94 views

Multiplicative version of Novikov inequality for Ito integral

It is clear that Ito isometry $E(∫^t_0fdW)^2=E(∫^t_0f^2dt)$ can be written in the multiplicative form as $E(∫^t_0fdW\cdot∫^t_0gdW)=E(∫^t_0f⋅gdt).$ Is it possible to obtain the multiplicative version ...
3
votes
0answers
184 views

Modification of stochastic processes vs. generalized stochastic processes

Let $(\Omega, \mathcal{F}, \mathbb{P})$ be a probability space and $X = (X_t)_{t \in \mathbb{R}^d}$ a classical stochastic process defined on $\Omega$. One says that a process $Y$ defined on $\Omega$ ...
1
vote
0answers
59 views

Stochastic process inference from partial observations

Consider a set $U$. My signal is a piece-wise constant "function" $Sig: t \mapsto s$, i.e. the signal at time $t$ equals to some subset $s \subset U$. One can see $Sig(t)$ as a stochastic process. ...
1
vote
0answers
81 views

New conditions to ensure martingality of stochastic exponential?

I am currently doing a project with focus on the Girsanov theorem, and I want to include some of the conditions which would ensure that the stochastic exponential $\mathcal{E}(L)=\exp(L-\langle ...
4
votes
3answers
375 views

When is a continuous path stochastic process be representable as diffusion or Ito process?

When can a continuous path (Markovian) stochastic process in one dimension be represented as an Ito or a diffusion process? What are the examples when it can not be?
2
votes
1answer
301 views

Dynamics of Master Equation

I'm going to do research on dynamics of master equation of $n$ states $$\dot p_i=A_{ij}p_j\qquad i=1\ldots n$$ where $p_i$ is the $i$-th component of probability vector and $A_{ij}$ is transition rate ...
6
votes
1answer
240 views

Markov processes lacking the Feller property

Let $E$ be a LCH second countable topological space and let $\mathcal{E}$ be its Borel $\sigma$-algebra. Let $(P_t)_{t \geq 0}$ be a conservative transition function on $(E, \mathcal{E})$. This ...
0
votes
1answer
199 views

Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...
3
votes
4answers
350 views

Does the variance of a continuous time, time homogeneous, Markov process starting from one point necessarily not decrease?

Let $x_t$ be a zero mean, time homogeneous Markovian process (chiefly look at the case where the value is in $1$ dimension) over time $t$ starting from $x_0=0$. Is it necessary that, in continuous ...
3
votes
0answers
55 views

Using Crump-Mode-Jagers processes to get logarithmic bound on a random tree height

I am currently pursuing my PhD degree and in my research I came across a family of random trees. I need to prove a logarithmic asymptotic bound for the heights of such trees as their size grows. I ...
1
vote
0answers
103 views

On numerical approximation to stationary distribution of diffusion process

Suppose a vector-valued diffusion process X satisfies the stochastic differential equation $$dX_t = b(X_t)dt + \sigma(X_t) dW_t,$$ in which $W$ is a Brownian motion and $b,\sigma$ are such that strong ...
1
vote
1answer
208 views

dual space of the subspace of the space of probability measures [closed]

I have a question which maybe so naive but I want to know the result about it. Let $\mathcal{M}=\mathcal{M}(\mathbb{R})$ be the space of bounded measures. Then by some materiau such as ...
1
vote
0answers
72 views

Time change for non-homogeneous Markov processes

Background: Let $C$ be the space of continuous function on $[0,T]$, $f, \sigma \in C$ bounded with $\sigma^2 \geq \varepsilon > 0$ and let $X=(X_t)_{t\in [0,T]}$ be a diffusion process of ...
4
votes
2answers
315 views

Ruin time for a two-input “risk only” slot machine

Imagine a "risk only" slot machine that takes 'coins' corresponding to some real number fraction of a dollar $p$, returns the coin with probability $p$, and eats the coin with probability $(1-p)$. ...
0
votes
1answer
90 views

construction of a approximate martingale

everyone. Given a probabilistic space $(\Omega, \mathcal{F}_t, \mathbb{P})$ and a martingale $(M_t)_{t\leq 1}$ on it. Suppose $$M_1\stackrel{\mathbb{P}}{\sim}\mu$$ where $\mu$ is a probability ...
1
vote
0answers
134 views

The problem of the drunkard in a valley [closed]

We consider a Markov chain on a subset of positive integers S = {0, 1, 2, 3, .......N}, with transition probabilities defined as follows: The chain jumps only one unit to the left or right. p(i, j) ...
4
votes
0answers
121 views

compactness of a probability set

I have a question about the compactness of a set of martingale measures. Let $\Omega=\mathcal{C}[0,1]$ be the space of continuous functions on $[0,1]$ and $\mathcal{M}_{\Omega}$ be the family of ...
3
votes
0answers
45 views

Correspondence between viscosity supersolution and supermartingale

Suppose $b : \mathbb{R} \to \mathbb{R}$ and $\sigma: \mathbb{R}\to \mathbb{R}$ are Lipschitz and that $(X_t)_{t\ge0}$ is a diffusion with $X_0 = x_0$ and $dX_t = b(X_t)dt + \sigma(X_t)dW_t$ . ...
1
vote
1answer
106 views

Kalman filter with long term bias

I was reading about the Kalman filter and I do not understand how it should be used when our measurements have a long term offset like GPS location updates do. As I understand, the Kalman filter ...
2
votes
1answer
199 views

Stochastic integral with respect to discontinuous martingale

in my research, I need to deal with a stochastic integral with respect to a compensated poisson process, namely, $ \int_0^t f(X_t) dM_t,$ where $M(t) = N(t) - \int_0^t \lambda(s)ds$. The integrand ...
2
votes
0answers
98 views

Supremum of scaled Brownian motion shifted by bounded smooth function

I would like to ask the following question: Let $e$ be a nonnegative, bounded, smooth function from $\left[ 0,1\right] $ to $\left[ 0,1\right] $, such that $e\left( 0\right) =e\left( 1\right) ...
1
vote
0answers
115 views

Brownian particles in a box: the probability that a sphere (of some radius) centered on a particle only contains one particle for a duration of time

Imagine I have a set of $(s_1,...,s_N) \in S$ Brownian particles in a box of sidelength $L$, each with the same coefficient of diffusion $D$. We fix one particle at the center of the box, and draw a ...
4
votes
0answers
187 views

Generalized Markov Processes on CW complexes of dimension > 1

Markov processes have a large variety of applications to physics and chemistry (as well as many other fields). Such processes are formulated on graphs, i.e., CW complexes of dimension one. It is ...
1
vote
1answer
104 views

Billingsley Ch: $4$ Asymptotically Independent random elements

A NEW DOUBT arose in a previous question, so I am posting it again since the previous edits did not draw views. Let $X_n$ be random elements of $D$ (space of cad lag functions on $[0,1]$ as domain). ...
1
vote
1answer
168 views

Asymptotically independent increments random elements: Billingsley Ch:$4$

Let $X_n$ be random elements of $D$ (space of cad lag functions on $[0,1]$ as domain). $X_n$ has asymptotically independents if $0\leq s_1 \leq t_1 \leq s_2 \leq \ldots < s_r \leq t_r \leq 1$, then ...
4
votes
1answer
290 views

Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by: $X_{i}= h(i) + \varepsilon_i $, $h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$ where $\{\varepsilon_i\}$ are i.i.d. ${\cal ...
4
votes
1answer
291 views

Donsker Theorem Billingsley

Theorems $16.1$ and $16.3$ in Billingsley Convergence of measures. $16.1$ reads : Random variables $u_1,\ldots$ on $(\Omega,\mathcal{B},\mathbb P)$ and are i.i.d. with $0$ mean and finite variance ...
5
votes
2answers
551 views

On the pathwise uniqueness of solutions of SDEs(Stochastic Differential Equations)

Suppose that $(\Omega,\mathscr{F},P)$ is a complete probability space equipped a filtration $\{\mathscr{F}_t\}$ satisfying the usual conditions. $B_t$ is a 1-dimentional Brownian motion with respect ...
4
votes
2answers
209 views

Probability of winding number of 2D Brownian Motion

Let $B_t$ be a 2D Brownian Motion with $B_0 = (1,0)$. Now, express $B_t$ in polars, that is, $B_t = (r(t), \theta(t))$. Let $\tau = \inf\{t > 0 : \theta(t) \geq 2 \pi \}$. What is $\mathbb{P}[\tau ...
1
vote
1answer
214 views

Quadratic variation for discrete Martingale

Is there any analogue of continuous martingale quadratic variation for the discrete case? If so, are there any theorems which characterize simple random walk using quadratic variation - similar to ...
4
votes
1answer
332 views

Expectation of the time t standard brownian motion stopped at itself's square

I have a one dimensional standard brownian motion $W$ defined under a stochastic basis with probability $\mathbf{Q}$ and filtration $\left(\mathscr{F}\right)_{t\in{\mathbf{R}}_{+}}$, and I want to ...
0
votes
1answer
132 views

Continuity of caglad process

Consider a non increasing, caglad process $(X_t)_{t\geq0}$ such that, for each $t$, the distribution function $F_t(x):=P(X_t\leq x)$ is a continuous function of (real) $x$. Are there any sufficient ...