A stochastic process is a collection of random variables usually indexed by a totally ordered set.

learn more… | top users | synonyms

3
votes
1answer
290 views

Convergence of random variables with hypergeometric distribution

This is a very interesting conjecture of large scale property of hypergeometric distribution. Let $a>1$ be a integer constant, $N\in\mathbb{N_+}$, for any $x<N-1$, consider $N+(a-1)x$ balls in ...
4
votes
1answer
115 views

Optimisation of betting strategy

Consider integers $r \geq 1$ and $k \geq 1$ and consider the following game: We start with $r$ tokens and at each round we choose $i \in \{1,...,r\}$ tokens to bet (if we have $N<r$ tokens we ...
1
vote
0answers
19 views

Strong solution to an SDE with a discontinuous diffusion term

I am having an SDE for which I would be in trouble if there were no strong solution. The SDE is - $ dX = \mu(x) dt + \sigma_1 (x) db_{1t} + \sigma_2(x) db_{2t}$ where $b_1$ and $b_2$ are two ...
9
votes
1answer
1k views

Gluing Markov processes

I am looking for a reference on the gluing together of strong Markov processes to get a new one. Here is an example of what I have in mind. Let $B^1, B^2, \ldots $ be independent one-dimensional ...
7
votes
1answer
551 views

Strong Markov property for Poisson point process

The question is thoroughly contained in the title. I just say that I would only like to find a reference for this question. I have searched in some books, to no avail. Here is what I mean exactly. ...
0
votes
1answer
299 views

Supremum in a Markov chain model

A Markov chain $X$ with finite state space $\{1,2,\cdots,N\}$ is defined on a probability space $(\Omega, P, \mathcal{F})$ equiped with filtration $\{\mathcal{F}_t\}$. And we assume that we can reach ...
4
votes
1answer
88 views

Time for brownian motion to cross a coordinate plane

Can I get a reference or some insight into the following? Suppose a particle moves by Brownian motion, starting from a point $P$ in $\mathbf{R}^{n}$. What can we say about the distribution of the ...
2
votes
1answer
88 views

Sum of two parts of a continuous stochastic process

Let $X$ be a centered continuous stochastic process which is square integrable on $[0,2]\times \Omega$ and the basis of $L^2(0,2)$ is $\{e_i\}$. By using Karhunen-Leove Theorem one can write for all ...
3
votes
1answer
191 views

explicit characterization of the stochastic integrand

Let $V$ be a cadlag positive supermartingale with the following decomposition: $$V_t=V_0+\int_0^tH_sdX_s-K_t$$ where $X$ is a cadlag local martingale and $K$ is an adapted increasing process with ...
1
vote
0answers
171 views

Density of subspace with nonlocal/Wentzell boundary condition

Given the space $F$ defined by: $$F=\left\{f\in C^2(\mathbb{R}_+^2;\mathbb{R}):f(x,0)=\int_\mathbb{R} f(z,x)g(z)dz, x>0\right\},$$ I want to prove that the subspace $E$ of $F$ defined by ...
-1
votes
0answers
20 views

Statistics, the deviation and expection of a number sequence [closed]

There is a sequence of number $a_{0},a_{1},...,a_{n}$, $(0 < a_{i} < 1)$ Define $b_{t} = \frac{ \sum_{i=0}^{t}{w^{t-i}a_{i}} }{ \sum_{i=0}^{t}{w^{t-i}} }$ where $w \in (0, 1)$. Can we proof ...
0
votes
0answers
63 views

Tail bound for a martingale

The setup is as follows. We are given a martingale $X_0,X_1,...,X_k$. The difference $X_i-X_{i-1}$ is always between $[-1,1]$. Variance $D^2(X_i-X_{i-1}| X_{i-1})$ is something, but we can show that ...
0
votes
1answer
88 views

Can I use Birkhoff's Ergodic Theorem for Vector Valued Process?

I have a stationary process $\{u_n\}$ and I have a function $f:\mathbb{R}^L\to \mathbb{R}^+$. I want to evaluate the following limit $$\lim_{n\to \infty}\frac{1}{n}\sum_{k=1}^n g(f(\mathbf{u}_{k}))$$ ...
5
votes
1answer
431 views

Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by: $X_{i}= h(i) + \varepsilon_i $, $h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$ where $\{\varepsilon_i\}$ are i.i.d. ${\cal ...
10
votes
1answer
816 views

Hardy spaces: analysis <---> martingales

Let $H^p$ be the Hardy space of analytic functions on the open unit disk $\mathbb{D}$: $f \in H^p$ if $f$ is analytic on $\mathbb{D}$ and $\sup_{r < 1} \int_0^{2\pi} |f(re^{i\theta})|^p d\theta ...
4
votes
1answer
278 views

Quasi-stationary distribution for a death process

In the paper, Survival in a quasi-death process by van Doorn and Pollett, the quasi-stationary distribution of a transient CTMC is discussed and QSD for a simple death process is derived. Consider a ...
0
votes
0answers
39 views

Convergence of approximate quadratic variation in $L^p$

For a semimartingale $X_t$, I can set $$[X]^N_t = \sum_{j=1}^N \bigl(X_{t\frac{j}{N}}-X_{t\frac{j-1}{N}}\bigr)^2$$ Then it is well-known that the process $[X]^N_t$ tends to the quadratic variation ...
0
votes
0answers
47 views

Compute the Gibbs energy

I have a question about Gibbs distribution in Stochastic theory. In which, it defined a clique as a a subset $C$ in the whole image $\Omega$ if two different element of $C$ are neighbors. Figure 2 ...
5
votes
1answer
317 views

Stochastic process describing long-term fluctuations

I need to model a process that has large, smooth and mean-reverting long-term fluctuations and some small short term wiggles, a sample path looks like this: My first idea was to model it as an ...
3
votes
1answer
337 views

weak convergence of the solutions to stochastic heat equation

$W(t,x)=\sum_ic_ie_i(x)B^i_t$ is a Brownian motion in $L^2(R^d)$, where $\{e_i\}$ is the standard orthogonal basis and $\sum_ic_i^2<\infty$. $$\partial_t u(t,x)=\Delta u(t,x)+u(t,x)\dot{W}(t,x)$$ ...
0
votes
0answers
28 views

kernel and operator of determinantal point process

is it true that that when the space is discrete & finite ($X=\{1,2,\ldots,n\}$) the kernel of determinantal point process and operator of it are the same?
2
votes
1answer
72 views

Is there any parameter space of Cramér–Rao_bound

It is known that Cramér–Rao_bound is the lower bound of variance of a parameter. A useful link is https://en.wikipedia.org/wiki/Cram%C3%A9r%E2%80%93Rao_bound There is also a term called ...
1
vote
2answers
82 views

Is zero a regular point for a drifted $\alpha$-stable process?

We consider 1-d process of the form $Y_{t} = bt + M_{t}^{\alpha}$, where $M_{t}^{\alpha}$ is $\alpha$-stable process for some $\alpha \in (0,2)$ with its levy symbol $\eta(u) = - |u|^{\alpha}.$, and ...
2
votes
0answers
28 views

Continuity of expected hitting value of diffusion

Let $W$ be a $d$-dimensional Brownian motion and $X$ the strong solution to $$\mathrm{d} X = \mu(X)\mathrm{d} t + \sigma(X)\mathrm{d} W,$$ starting from some $x$, where $\mu$ and $\sigma$ are ...
0
votes
0answers
15 views

Strong solution and measurability on Ikeda and Watanabe context

This question is from Chap 4 of Ikeda and Watanabe - Stochastic differential equations and Diffusion processes pg 149 and on page 152 I believe that in the context of the last paragraph ...
0
votes
0answers
32 views

Validating a probability density distribution forecast model for a Markov process

Let's say we have a Markov process $X_t$, and we come up with a forecast model that takes some information from outside world and says: "value $X_{t+1}$ has probability density distribution $P_t(x)$". ...
0
votes
2answers
116 views

Numerical solution of SDEs with colored noise

I am trying to numerically solve an SDE with both white and colored noise that models a non-linear circuit: $$ dX_t = f(X_t) dt + \sigma_w dW + \sigma_c dC $$ where $W$ is a standard Brownian motion ...
5
votes
2answers
200 views

Infimum of Gaussian process

Consider a Gaussian Process $g\sim GP(\mu,k)$ with mean zero $\mu\equiv0$ and continues covariance $k(t_1,t_2)=k(|t_1-t_2|)$ defined on the interval $A=[0,T]$. I'd like to make no assumptions about ...
2
votes
1answer
224 views

Diffusion processes with different diffusion coefficients and absolute continuity

I would first of all like to say that I am an analyst, and so I am familiar with probabilistic methods only on a basic level. My initial situation is the following. Consider two stochastic ...
-1
votes
0answers
37 views

Markov operator with unique invariant measure

If a Markov operator has unique nontrival invariant measure in $L_{1}$ norm, and then I constructing a iteration series from this Markov operator and obtain a function series. Can I assert that this ...
1
vote
2answers
319 views

Quadratic variation for discrete Martingale

Is there any analogue of continuous martingale quadratic variation for the discrete case? If so, are there any theorems which characterize simple random walk using quadratic variation - similar to ...
0
votes
0answers
28 views

Uniform convergence problem of the iterative function series

A process $\{\theta_{t}\}_{t=1}^{\infty}$ with finitely continuous state space $\mathcal{S}=[\underline{\theta},\bar{\theta}]$.The transition density is $\phi(\theta_{t},\theta_{t+1})$.I have known ...
1
vote
0answers
34 views

Basic results for chi square processes

I could not find any introductory material with basic results regarding chi-square processes. Their definition from The Supremum of Chi-Square Processes is as a sum of $d$ squares of independent ...
2
votes
2answers
273 views

Time integral of a diffusion

Define $\bar\sigma^2_t=\frac{1}{t}\int_0^t\sigma^2(X_s)ds$ where $\sigma(x)\geq0$ is a measurable function and $X_t$ a diffusion process defined by \begin{equation} ...
3
votes
1answer
53 views

Number of samples needed as input to Bernoulli factory

Let $\{X_i\}$ denote an i.i.d. sequence of Bernoulli variables with parameter $p$. A Bernoulli factory is a procedure that generates events with probability $f(p)$ using the observations $\{X_i\}$, ...
2
votes
0answers
40 views

integrability of Brownian motion stopped at some stopping time

Let $B=(B_t)_{t\ge 0}$ be a standard Brownian motion starting at zero and denote by $S=(S_t)_{t\ge 0}$ its running maximum, i.e. $S_t=\sup_{0\le s\le t}B_s$. Given a fixed number $p>1$, define the ...
0
votes
0answers
20 views

Markov chain matching local time

Let $\left(X_{t}\right)_{t\geq0}$ be a Markov process taking values in a finite state space $E$. Its local time at $y\in E$ started at $x\in E$ is defined as $$ ...
1
vote
0answers
49 views

Stationary distribution of two-dimensional Markov Process?

A two-dimensinal Markov process $\{\theta_{t},S_{t}\}_{t=1}^{\infty}$ where $\theta_{t} \in \Theta$ and $S_{t} \in S$.$\Theta$ is a continuous state space and $S$ is a discrete state space. Suppose I ...
30
votes
6answers
2k views

Deep Learning / Deep neural nets for mathematician

I am interested in finding out the math ideas behind the technologies that are under the umbrella of "Deep Learning" or "Deep neural nets". Most of the papers/books that are often quoted in ...
0
votes
0answers
21 views

Systems of stochastic differential equations with non-Lipschitz coefficients

I am looking for references to any literature which might consider the existence / behavior / regularity of solutions to systems of stochastic differential equations with non-Lipschitz coefficients. ...
1
vote
1answer
148 views

Arc Sine law for Random Walk conditioned to non-absorption or not?

Let $S_n$ be simple symmetric Random walk on the integers in $[-N,N]$ with states $N$ and $-N$ absorbing. Let $\tau$ be the time to absorption when $S_0 = 0$. Is the $E(S^{2}_{n}| \tau \geq n)$ ...
3
votes
0answers
37 views

Existence of martingales given some constraint on laws

Let $X=(X)_{0\le t\le 1}$ be a continuous martingale starting at $0$, then denote by $\mu$ and $\nu$ the probability laws of $\int_0^1X_t \mathrm{d}t$ and $X_1$. Then it is easy to see that the couple ...
-2
votes
1answer
43 views

expected value of cosine wirh Gaussian phase

Is there a solution to the expected value/variance for a Gaussian with random phase: $$\cos(\omega_0 t + \phi), \qquad \phi \sim \cal{N}(0,\sigma^2) $$ ? For $t=0$, the solution is for example ...
0
votes
0answers
19 views

Proof of Linear Stochastic Sate-Space Model is Gaussian Process

I want to proof that the vector linear stochastic state space model $$\dot{x}(t)=A(t)x(t)+B(t)u(t)+G(t)q(t) \\ y(t)=C(t)x(t)+D(t)u(t)+F(t)r(t) $$ corresponds to a particular multi output gaussian ...
2
votes
0answers
75 views

The existence of stationary measures for certain Markov process

My question is that:For a discrete-time random process $\{x_{t}\}_{t=1}^{\infty}$ and $x_{t} \in \Omega$ where $\Omega$ is a general state space(If $\Omega$ is a discrete space, it is a discrete-time ...
9
votes
2answers
4k views

Coin Pusher Game

While doing laundry at my local laundromat, I saw a coin pusher game. Below is a picture, and here is a video depicting how it works (disregard non-coins). Essentially, one has a distribution of ...
3
votes
2answers
468 views

An Upper Bound for the Average of Top Order Statistics

The following problem arises when we try to bound the expected offline optimal value of a simple online assignment problem with random values and unit weights, by its deterministic approximation. The ...
1
vote
0answers
67 views

Spectral densities of stationary Feller processes with no diffusion, constant positive drift and negative jumps

For a (real valued, finite variance) stationary process $X_t$ on $\mathbb R$ with $\mathbb EX_t=m$, the auto-correlation function $k(\tau) = \mathbb E[(X_{t+\tau}-m)(X_t-m)]$ and its inverse Fourier ...
3
votes
2answers
274 views

Analytic Solution to SDEs

Are there any example of SDEs with constant diffusion terms, other than the Ornstein Uhlenbeck process, which have exact solutions? I'm thinking of something of the form: \begin{equation} dX_t = ...
0
votes
1answer
66 views

Stationary distribution with exponential transition density function

A Markov chain with continuous state space has a transition exponential density function: $$p(x_{t},x_{t+1})=\frac{1}{x_{t}}exp(-\frac{x_{t+1}}{x_{t}})$$ i.e. the realized value in period t is the ...