All Questions
16 questions
4
votes
0
answers
116
views
Convergence in probability results with still open point-wise versions
In ergodic theory and more generally in stochastic processes, often convergence in probability results precede convergence almost-surely results in quite a few years. Classical examples include the ...
3
votes
1
answer
194
views
Dynamics of a random stretch map
Notation: Here $S^1$ denotes the circle, which we view as the unit sphere in $\mathbb C$. We equip the circle with its natural length metric.
Let $\{\epsilon_n\}_{n \geq 1}$ be iid uniformly ...
2
votes
1
answer
266
views
Ergodicity of linear dynamical systems and convergence of covariance matrices
Let $z(n+1)=Bz(n)+\xi(n+1)$ be an $N$-dimensional linear dynamical system with $\left(\xi(n)\right)_{n\in\mathbb{N}}$ being i.i.d. with $\xi(n)\sim\mathcal{N}(0,\Sigma_{\xi})$.
Assumptions: a) The ...
3
votes
1
answer
307
views
"Ergodic theorem" for Markov kernels
Consider a discrete time Markov chain $(X_t)$ on a finite state space $\mathcal{S}$, with transition matrix $P$. Assume that the chain admits a stationary distribution $\pi$, which I will identify ...
1
vote
1
answer
210
views
Shift-ergodic stochastic processes in continuous time
Let $\mathscr{C}:=\{\gamma : \mathbb{R}_+\rightarrow\mathbb{R}^n \mid \gamma \ \text{ continuous}\}$ be the set of all $\mathbb{R}^n$-valued paths over $[0,\infty)$. Endow $\mathscr{C}$ with the $\...
2
votes
0
answers
143
views
inverse of moment-generating function in terms of moments
Let $\{h_i\}$ be decreasing sequence of $n$ positive reals. Define distribution $p(X=h_i)\propto h_i$ and let $g(s)=E_X[e^{sX}]$ be the moment generating function. For instance, for $h=\{1,\frac{1}{4},...
0
votes
1
answer
138
views
Do measure-valued dynamical systems correspond to marginals of Markov processes?
Let $(\mu_n)_{n=1}^{\infty}$ be a sequence in $\mathcal{P}_1(X)$ for some compact metric space $(X,d)$. Suppose that there is a weakly-continuous function $F:\mathcal{P}_1(X)\rightarrow \mathcal{P}_1(...
1
vote
0
answers
72
views
Distance between value function of deterministic and stochastic control problems
Suppose that one wants to control a diffusion process
$$
dX_t^u = \mu(X_t^u,u)dt + \sigma dW_t; \qquad X_0^u=x
$$
in order to optimize a stochastic control problem with value function
$$
V_T(u)=\...
1
vote
1
answer
170
views
Stationary distribution of Markov Chain with departure
I have a Markov Chain of $N$ states. Such states represent the energy levels in a molecule.
The states' connectivity is as follows:
States $j\in\{0,\ldots,N\}$ transition to $k\in\{\max(j-M,0),...,\...
0
votes
0
answers
48
views
Characterization of Time-homogeneous flows for conditional expectation
Let $X_t,Y_t$ be $\mathbb{R}^d$-valued processes. It is well known that for every $t\geq 0$, and every bounded function $\phi:\mathbb{R}^d\rightarrow \mathbb{R}$, there exists a Borel function $f_t:\...
1
vote
1
answer
94
views
Does the following percolation model have a name?
Consider the following model for percolation in an infinite graph: each vertex has a certain region (set of vertices) associated with it, which at the beginning contains only the vertex itself, and ...
3
votes
2
answers
194
views
A Really Simple Stochastic Dynamic Billiard
Consider the following stochastic dynamical system.
Fix $a > 0$, $b > 0$, $c>0$ and $v > 0$, and let $\mathbf{r}(t)=(x(t),y(t),z(t))$ be the position at time $t$ of a point which moves ...
3
votes
1
answer
127
views
A Simple Stochastic Dynamic Billiard
Consider the following stochastic dynamical system.
Fix $a > 0$, $b > 0$, and $v > 0$, and let $\mathbf{r}(t)=(x(t),y(t))$ be the position at time $t$ of a point which moves in the ...
4
votes
0
answers
56
views
Is there an equivalent line time-invariant system for a linear time-varying system with specific properties? [closed]
Given a discrete-time linear time-varying system (LTV)
$$x(k+1) = A(k) x(k) + B(k) u(k)$$
where $A(k)$ and $B(k)$ are generated by a stationary random process. Is there an equivalent linear time-...
2
votes
2
answers
492
views
Can I use Birkhoff's Ergodic Theorem for Vector Valued Process?
I have a stationary process $\{u_n\}$ and I have a function $f:\mathbb{R}^L\to \mathbb{R}^+$. I want to evaluate the following limit $$\lim_{n\to \infty}\frac{1}{n}\sum_{k=1}^n g(f(\mathbf{u}_{k}))$$ ...
3
votes
0
answers
209
views
On the decay of correlations of an ergodic sequence over the set $X_{0}=0$
The following question arose while I was trying to explore possible further extensions of a CLT by Liverani which I mentioned here already (see this link, I can tell you more details upon request). It ...