# Tagged Questions

A stochastic process is a collection of random variables usually indexed by a totally ordered set.

**3**

votes

**2**answers

125 views

### A question about intuition of fluid limit in queuing system

This is a question about intuition in understanding the fluid limit queuing system.
Assume we have a sequence of queuing systems $\{S^N\}_{N=1}^{\infty}$ with N servers and each server has unit ...

**-3**

votes

**0**answers

44 views

### Find function $h$ so that $h(U,V)$ equals density of $f(a)da$ for $f(a)=\frac{1}{2}e^{-\small|a|} ,a \in \mathbb R$ [on hold]

Let $f(a)=\frac{1}{2}e^{-\small|a|}$, $a \in \mathbb R$
and let $U,V$ be two independently uniformly distributed random variables on $[0,1]$.
Now I want to find a function $h$ so that $h(U,V)$ is ...

**3**

votes

**0**answers

79 views

+50

### Transition semigroup of Ito diffusion on $L^2(\mathbb{R})$

I am considering the transition semigroup $P_t$ associated with the Ito diffusion process
$$dX_t=b(X_t)dt+\sigma(X_t)dB_t,$$
where the coefficients are assumed to be Lipschitz continuous.
I hope to ...

**1**

vote

**0**answers

65 views

### Diagonal of Green's Function

I am looking to numerically calulate the diagonal of Green's function. I am interested in Green's functions of elliptic PDEs and in those that arise from stochastic processes (discrete and ...

**0**

votes

**0**answers

10 views

### Residual life distribution for renewal process after time T

Suppose we have a renewal process with inter-arrival times $\boldsymbol X=\{X_1, X_2, ...\}$, where $X_i$ are i.i.d variables. Assume that the CDF and PDF for $X_i$ are $F(x)$ and $f(x)$.
1) Let ...

**0**

votes

**0**answers

19 views

### Explicit u-excessive function

Let $E$ be $\mathbb{R}^d$ for $d\geq 1$.
Let $A \subset E$.
Let $X$ be a Feller process en $E$, and let $L$ be its infinitesimal generator.
I want to prove that $A$ is absorbing.
I know that it is ...

**4**

votes

**0**answers

129 views

### Derivation of a stochastic Navier-Stokes equation under the assumption of perturbed particle trajectories

Let
$d\in\left\{2,3\right\}$
$\mathcal V_t\subseteq\mathbb R^d$ be the bounded domain occupied by an incompressible Newtonian fluid at time $t\ge 0$
$\Phi_t:\mathcal V_0\to\mathcal V_t$ such that ...

**0**

votes

**0**answers

129 views

### Hadamard product (Schur product) in $L^2[0,1]$

Let's consider the separable Hilbert space $\mathcal{H} = L^2[0,1]$ of square-integrable functions on the interval $[0,1]$ with orthonormal basis $(e_j)$. For $x,y \in \mathcal{H}$, the Hadamard ...

**0**

votes

**1**answer

25 views

### Analyzing a multiple-queue single-server model

Consider the following multiple-queue single-server model of a packet network problem. At each discrete time $t=0,1,\ldots,n$, a packet may arrive at the server R with probability $1-\epsilon_1$. The ...

**0**

votes

**0**answers

26 views

### Feller property for Ito diffusion with Lipschitz coefficients

Consider the following Ito diffusion $X_t$ satisfying
$$dX_t=b(X_t)dt+\sigma(X_t)dB_t,\quad X_0=x\in \mathbb{R}^n,$$
with Lipschitz coefficients $b,\sigma$.
It can be shown that if $g$ is bounded ...

**2**

votes

**0**answers

103 views

### markov processes and ergodic theory

For an ergodic Markov Chain
$$
\frac{1}{N}\sum_{i=1}^n f(X_i) \rightarrow E_\pi[f]
$$
where $\pi$ is the invariant distribution. I am also dealing with a Markovian process (a state space model to ...

**1**

vote

**0**answers

65 views

### formula for density of maximal Poisson disk sampling of radius 1?

Maximal Poisson disk sampling of radius r, applied to a finite planar region, is defined by successively choosing sample points uniformly randomly from the part of the region that is not within ...

**2**

votes

**0**answers

160 views

### Expected value and variance of a stochastic process

I would like to ask if there is a way to find the expected value and the variance of the following process
$$
dv_t=(a-be^{\alpha v_t})dt+\sigma dW_t, \quad v_t=v_0
$$
where $a\in (-\infty,+\infty), ...

**0**

votes

**0**answers

37 views

### Quadratic characteristic and constancy

Consider a change of measure on $\mathcal{F}_{t}$ defined by the restriction of two probability measures of the form
\begin{align}
\frac{dQ_{t}(\theta)}{dP_{t}}=\exp^{ \theta A_{t}-\kappa(\theta) ...

**2**

votes

**0**answers

100 views

### Question about continuity in the “complete Skorohod Topology”?

I am reading the book in progress of Timo Seppäläinen about the "Translation Invariant Exclusion Process"
https://www.math.wisc.edu/~seppalai/excl-book/ajo.pdf
In one of the exercises, exercise 8.9 ...

**0**

votes

**1**answer

89 views

### Predictable quadratic Variation <.> has same intervals of constancy as the process

From
Revuz and Yor - Continuous Martingales and Brownian Motion 1999
Chapter IV Proposition 1.13
it is proven, that for a continuous local martingale $M_t$ the intervals of ...

**1**

vote

**0**answers

75 views

### Construction of a random variable

I'm reading Dirichlet Forms and Symmetric Markov Processes by M. Fukushima, Y. Oshima, and M. Takeda. In Appendix A.2, where they discuss the construction of a random variable, there is the ...

**3**

votes

**0**answers

56 views

### “Local” functional central limit theorem for the empirical distribution function

This question is a repost from Mathematics Stack Exchange, where it did not receive any answer.
Assume $(X_i)_{i=1}^{\infty}$ is a sequence of i.i.d. real-valued random variables such that $\mathbb ...

**3**

votes

**0**answers

41 views

### Feynman-Kac formula and time-ordering for vector bundles

Let $M$ be a compact Riemannian manifold and let $\mathrm{d}\mathbb{W}^{yx;T}(\gamma)$ denote the Brownian Bridge measure, i.e. the Wiener measure on the paths that travel from $x$ to $y$ in time $T$ ...

**2**

votes

**0**answers

134 views

### Infinitesimal generator and stationarity

The following question is bothering me. I think it is probably known but I cannot find any reference...
Let $(X_t)$, $(Y_t)$, $(Z_t)$ denote 3 Feller processes with respective infinitesimal ...

**1**

vote

**0**answers

52 views

### A problem on Markov chains and Dirichlet forms

Let $X$ be a countable set. Let $c:X\times X\to[0,+\infty)$ satisfy
$$c(x,y)=c(y,x)\text{ for all }x,y\in X,$$
$$m(x)=\sum_{y\in X}c(x,y)\in (0,+\infty)\text{ for all }x\in X,$$
$$c(x,x)=0\text{ for ...

**2**

votes

**0**answers

47 views

### Modify Process to a Semimartingale

The original post is from mathstackexchange
According to some difficulties, i decided to ask here again.
Given a filtered space $(\Omega, F,\mathcal{F}_{t})$ with rightcontinous filtration. We have a ...

**3**

votes

**0**answers

145 views

### Self-adjusting random walk

Let $X_t$ be a random process such that
\begin{eqnarray}
X_1 &=& 0\\
X_t &=& X_{t-1} + \left\{\begin{array}{ll}
A_t, & X_{t-1} \geq 0\\
B_t, & X_{t-1} < 0
...

**1**

vote

**1**answer

51 views

### A diagonalisation argument applied to density functions

There is a claim from a paper which I do not understand:
Let $D$ be a domain in $\mathbb{R}^d$. Let $(p^{\eta})_{\eta >0}$ be a family of densities for random variables on $(C[0,T], ...

**1**

vote

**0**answers

101 views

### Limit theorem : reproduce a proof with an adaption from discrete to continuous time

Im considering Theorem 5.2.2 in M. Sørensen "Exponential Families of stochastic processes".
The setup is as follows:
We have a Levy-Process $X_t$ fullfilling the CLT
\begin{align}
...

**3**

votes

**1**answer

129 views

### How to calculate the PSD of a stochastic process

This question was asked on math.stackexchange about 2 months ago, but it hasn't been very successful in attracting answers yet, so I'm posting it here.
Say we have a stochastic process described by a ...

**1**

vote

**1**answer

91 views

### Find a square, stochastic matrix (w/ non-neg entries) of odd size, not a permutation matrix, with an eigenvalue other than 1 on the unit circle

...or prove that none exists.
Note that such a matrix M couldn't be primitive, so there would be at least one entry equal to zero in every power M^k (Perron-Frobenius theory).
Preferably the ...

**2**

votes

**0**answers

41 views

### A question about probabilistic graphical models

Say one is given a probabilistic graphical model and a cut of the underlying graph. Do we know any statements about when and how can one or many of the marginals (of the sources) or the conditionals ...

**2**

votes

**2**answers

143 views

### The necessary sufficient condition for recurrence of a Markovian random walk

Suppose $\sigma_{1},\sigma_{2},...$are i.i.d random variables.$S_{0}=0$. Define $S_{n}=S_{0}+\sum_{i=1}^{n}\sigma_{i}$, then ${S_{n}}$ is a Markovian random walk.
I want to figure out the necessary ...

**1**

vote

**0**answers

37 views

### Alternative to generic chaining bounds for a particular family of stochastic processes

Generic chaining provides a general but rather abstract framework to bound suprema of stochastic processes. In many applications, however, we know more about the expression of the stochastic process. ...

**1**

vote

**1**answer

96 views

### Limit (Convergence) of stopping times

Let $B=(B_t)_{0\le t\le T}$ be a continuous semi-martingale and $\mathbb F=(\mathcal F_t)_{0\le t\le T}$ be its natural filtration. Denote by $\mathcal C_b(\Omega\times \mathbb R_+)$ the space of ...

**1**

vote

**0**answers

38 views

### What is meant by local time of BM on the boundary $\partial D$?

I'm familiar with local time $L_t^a$ at level $a$ for a 1-D Brownian motion $B$. I'm reading this paper which talks about a 2D Brownian motion $B$ in a bounded domain $D$ that gets reflected when it ...

**0**

votes

**0**answers

41 views

### Brunett Derrida behaviour for the branching brownian motion with selection

In this paper Berard and Gouéré proved that for a binary branching random walk with selection of the N rightmost particles the cloud of particles moves asymptotically at a deterministic velocity ...

**0**

votes

**0**answers

38 views

### regularity of the conditional expectation: from Markov to Non-Markov

Let $B=(B_t)_{0\le t\le T}$ be a standard Brownian motion and $\mathbb F=(\mathcal F_t)_{0\le t\le T}$ be its natural filtration. Let $\xi=\xi(B)$ be a bounded measurable functional. Now let's ...

**2**

votes

**2**answers

161 views

### Do we have Karhunen–Loève expansion for White Noise?

Let $W$ be a random process (my White Noise) on $[-1,1]$ such that:
$W(t)$ is a normal random variable with mean $0$ and standard deviation $1$ for all $t \in [-1,1]$
$E(W(t)W(s)) = 0$ for all $t, s ...

**1**

vote

**1**answer

45 views

### Is there an easy way to convert a non-deterministic optimal policy to a deterministic optimal policy for a given MDP?

For a MDP (Markov Decision Process) is there an easy way to convert a non-deterministic optimal policy into a deterministic optimal policy?
The trivial way will take ...

**2**

votes

**0**answers

151 views

### Must rows of a transition matrix be distinct?

Is it true that for all continuous time Markov processes on a countable state space $S$, we have
all rows of the transition matrix $\mathbf{P}_t$ are distinct for all time $t\in[0,\infty)$ ?
This ...

**3**

votes

**0**answers

64 views

### Most visited vertex in a random walk with place dependent drift

Consider the following Markov chain on $\mathbb{Z}$:
$$
P(x,x+1)=1-P(x,x-1)=\frac{1}{2}+e^{-|x|}\cdot \mathbf{1}_{\{x\neq 0\}}
$$
Do there exist constants $c,C>0$ such that
$$
c\cdot P^t(z,z) ...

**1**

vote

**0**answers

35 views

### Are the elementary predictable processes dense in $L^2([M])$ for $M$ a local martingale?

The question is the one from the title. I know this is true when $M$ is an $L^2$ bounded martingale (which is often used in the classical approach to the construction of the stochastic integral) but ...

**2**

votes

**1**answer

150 views

### Functional limit theorem under random change of time

Given a Levy-Process $U_t$ (cadlag-paths) with $E(|U_t|)<\infty$ and finite variance and $Var(X_1)=\sigma^{2}$ for which the limit theorem holds:
\begin{align}
...

**1**

vote

**1**answer

102 views

### A problem about the quotient space of an extended Dirichlet space

Let $(\mathscr{E},\mathscr{F})$ be a recurrent Dirichlet form on $L^2(X;m)$ and $\mathscr{F}_e$ the corresponding extended Dirichlet space, then $1\in\mathscr{F}_e$ and $\mathscr{E}(1,1)=0$. Let ...

**3**

votes

**1**answer

172 views

### Expected visits to the origin by a symmetric random walk on the integers

Consider the first $2n$ steps of a simple random walk on the integers, starting at the origin. A simple binomial argument shows that regardless of $n$, the origin gets visited the most (in ...

**3**

votes

**2**answers

117 views

### Extreme couplings

Let $X,Y$ be Polish spaces, and $\mu$ and $\nu$ are probability measures on $X$ and $Y$ respectively. We say that $M$ is a coupling of $\mu$ and $\nu$ if it is a probability measure on $X\times Y$, ...

**0**

votes

**0**answers

33 views

### Strong Markov vector-valued process from component strong Markov process and independence

I want to prove that if $X$ and $Y$ are (continuous time) independent strong markov $\mathbb{R}$-valued processes w.r.t. their natural filtrations $\mathcal{F}^X_t$ and $\mathcal{F}^Y_t$, that the ...

**0**

votes

**0**answers

88 views

### Bounds on Wasserstein (Kantorovich) distance

Let $X$ be a Polish space endowed with a bounded metric $\rho_X$. Let $\mu, \mu'$ be two probability measures, and $\kappa, \kappa'$ be two stochastic kernels on $X$. Assume that $\kappa, \kappa'$ are ...

**8**

votes

**1**answer

278 views

### Berry-Esseen bound for martingale sequence with varying and dependent variances

Let $(X_{1},\ldots,X_{k},\ldots)$ be a martingale difference sequence, i.e.
$$
E[X_{k}|\mathcal{F}_{k-1}] = 0
$$
where $\mathcal{F}_{k-1}$ is the $\sigma$-algebra filtration at $k-1$.
Let ...

**0**

votes

**1**answer

64 views

### Brownian motion increments

We know that if $W_t$ is a Brownian motion, $W_{t+t_0}-W_{t_0}$ is one too.
Does the "converse" holds : Let $t_0$ be a positive number. I have a Brownian motion $W_t$
and I seek another Brownian ...

**2**

votes

**1**answer

99 views

### Random Walk 2D with dependent weights [closed]

I have spent a lot of time trying to solve this problem but have had no luck so far! Any help would be highly appreciated!
Suppose I have a 3x3 grid as shown below.
(3,1) (3,2) (3,3)
(2,1) (2,2) ...

**3**

votes

**1**answer

167 views

### What's the best betting strategy to double money if we have $\delta$ advantage?

Suppose that I am very skilled in a gambling game, and any day that I bet $x$, I get back $2x$ with probability $\frac 12+\delta$ (and nothing with probability $\frac 12-\delta$). My goal is to double ...

**1**

vote

**0**answers

107 views

### Does the martingale property holds after changing filtration?

Let $\Omega$ be the space of continuous real-valued functions $\omega=(\omega_t)_{t\ge 0}$ starting at zero, i.e. $\omega_0=0$. Let $\Lambda=\Omega\times \mathbb R_+$ and denote by ...