All Questions
Tagged with random-walks stochastic-processes
124 questions
1
vote
0
answers
289
views
Growth rate of exponential sum of $S_j$
Let $X_j$, $1 \leq j \leq n$ be chosen i.i.d. uniform over $[0,2\pi)$. Denote $S_j \triangleq X_1 +X_2+\cdots+X_j$ and suppose that $c_j$, $1 \leq j \leq n$ are some constants such that $|c_j|=1$.
I'...
- 85
1
vote
1
answer
90
views
A scaled random walk on the number line
An agent $A$ is performing a random walk on the number line. Let $X_t$ be his position at time $t$. $X_{t+1}$ is calculated according to the following rules:-
$ X_{t+1} =$
\begin{cases}
...
3
votes
0
answers
81
views
Random walk in a switching scenery
For each $x \in \mathbf{Z}$ let $(\eta_t(x))_{t\geq0}$ denote independent copies of a process $(\eta_t(0))_{t\geq0}$ defined as follows. The process $\eta_t(0)$ takes values in $\{-1,1\}$, where $-1$ ...
- 91
4
votes
1
answer
187
views
Asymptotics of a quotient related to a simple random walk
Let $\lambda_0 < \lambda_1$ and $\lambda_0 \lambda_1 > 1$ (i.e. at least $\lambda_1 > 1$). Further, let $S_n$ denote a simple random walk with increment distribution $$ P(X = 0)= P(X= 1) = 1/...
- 121
1
vote
2
answers
356
views
Asymptotic behavior of a random geometric sum
Let $S_n$ denote a simple random walk with i.i.d. increments $X_i$ such that $P(X_1 = 0) = P(X_1=1) = 1/2$, i.e. $$S_0 = 0, \ S_n = X_1 + \dots + X_n.$$
The behavior of $S_n$ as $n \to \infty$ is ...
- 121
1
vote
0
answers
76
views
Spitzer's condition, a slowly varying function and its behavior
Let $S$ denote a random walk that satisfies Spitzer's condition $$ \frac{1}{n} \sum _{k=1}^n P (S_k > 0 ) \to \rho$$ for some $\rho \in (0,1)$. From the book Regular Variation (Bingham, Goldie, ...
- 121
1
vote
0
answers
96
views
Minima of a random walk and an equality for a fraction
Let $S_n := X_1 + \dots + X_n$ denote a random walk with zero mean and finite variance and write $L_n := \min \{ 0, S_1, \dots, S_n\}$. The tail distribution of $L_n$ are well-known and in particular,
...
- 123
2
votes
0
answers
63
views
hitting probabilities of oriented random walk
Consider a random walk on $\mathbb{Z}^2$, starting at $(0,0)$. Each step it moves rightwards with probability $p$ and upwards with probability $q=1-p$. The random walk terminates when it hits the ...
- 640
3
votes
1
answer
884
views
Quadratic variation of sum of random variables
Let $N = (N_t)_{t\geq 0}$ be a Poisson process and consider random variables $Z_n$, $n\in N$. Compute the quadratic variations $[X]_t$ where $X_t = \sum_{n=1}^{N_t}Z_n$.
What I did was plugging $X_t$ ...
- 135
7
votes
0
answers
144
views
Random walk on $\mathbf{Z}_d$ with Jacobi $\theta$ transition probabilities
In the context of a finite-dimensional quantum mechanical problem, I was led to study the random walk on $\mathbf{Z}_d$ (i.e the integers modulo $d$), $d$ odd with transition probabilities given by:
$...
3
votes
2
answers
229
views
Expectation of the exitpoint distance for the symmetric random walk
Let $\nu(x)$ be a symmetric probability measure with respect to the origin on $x\in[-1,1]$ such that $\nu(\{0\})\neq 1$.
Consider a random walk started at $S_0=0$, denoted $S_n=X_1+\dotsb+X_n$, ...
- 31
2
votes
1
answer
460
views
Large deviation of random walk
1) Let $\{X_i\}_{i=1}^n$ be i.i.d. such that $\Pr(X_i=1 )=1-\Pr(X_i=-1)=p$. Define the random walk
$$
S_i = \sum_{j=1}^iX_j
$$
for $i=1,2,\ldots,n$.
I am looking for "good" exponential upper bounds ...
- 31
3
votes
0
answers
330
views
Random walk on $\mathbb{R}$ with "sticky" origin
Let $P_i$, $N_i$, and $Z_i$, $i\in\mathbb{N}$ be r.v.'s with the $P_i$, $N_i$, and $Z_i$ being identically distributed with known pdf's $f_P$, $f_N$, and $f_Z$, respectively; and with no dependence ...
- 313
2
votes
1
answer
105
views
Convergence of a stochastic sequence?
I am reading this paper related to an algorithm for nonsmooth optimization problems. After many simplifications, I was able to formalize the method as follows: let $\Bbb B $ denote the unit ball in $\...
- 185
1
vote
2
answers
302
views
how to derive stationary distribution of maximal entropy random walk
I was reading the paper 0810.4113v2, burda, which analyzed the stationary distribution maximal entropy random walk on the irregular lattice. I am confused on some of the steps.
Description:
The ...
- 211
5
votes
1
answer
111
views
Expected time of distinguishability of a series of Poisson processes bounded by each other
Consider a system of $n$ "bounded" Poisson processes over the integers, $X_1, \ldots X_n$, all incrementing at rate $\lambda$. Initially all the processes begin at $0$. The process $X_i$ is inactive ...
- 133
2
votes
1
answer
280
views
Walker whose Velocity is a Brownian Bridge
Consider a continuous random walk $x (t) $, in which the velocity $v (t) = \mathrm dx/\mathrm dt $ rather than the position is described by Brownian motion, so that $v (t) = B_t $ where $B_{t+\epsilon}...
- 1,444
7
votes
2
answers
468
views
One dimension random walk. Is hitting time Lipschitz with respect to target?
Consider a random walk $S_t = \sum_{i=1}^{t} X_i$, with $X_i$ i.i.d.. Assume that $X_i \in [0,1]$. Define $\tau(y) := \inf\{t: S_t\geq y\}$, i.e., $\tau(y)$ is the hitting time of $[y,\infty)$. Is ...
- 103
4
votes
1
answer
176
views
Random Walk with "Forward Dependency"
Let $\{X_t\}_{t=-\infty}^{\infty}$ be a sequence of random variables. We are interested in a "random walk" (or more generally, a random field) that can be characterized by
$$
X_t ~|~ X_{t-k}, \ldots, ...
- 1,127
11
votes
2
answers
1k
views
Is there a differentiable random walk?
Is there a random walk which is differentiable or smooth? Like brownian motion except smoothed out on small distances. I was wondering if there is a "natural" or "canonical" analogue of brownian ...
- 111
3
votes
1
answer
281
views
Stein's Equation for Gaussian Mixtures
In the paper "Spin glasses and Stein's method" (https://arxiv.org/pdf/0706.3500.pdf), Sourav Chatterjee established Stein's equation for mixtures of two Gaussian densities in $\mathbb{R}$, which takes ...
- 1,127
1
vote
1
answer
456
views
Random walk with gaussian increments - Probability that it falls below 0
Suppose $\{Z_{i}\}_{i=1,2,\ldots}$ are normally distributed (identically and independent) random variables with mean $\mu>0$ and positive variance $\sigma^{2}$. Suppose we want to calculate the ...
- 13
0
votes
1
answer
635
views
Mean square displacement for a random walker in a finite system
It is well known that for a simple random walk on a 2D square lattice extending to infinity the mean square displacement of the walk $\langle \mathbf r^2\rangle \propto N \, :(*)$ with $N$ the number ...
user88381
3
votes
1
answer
196
views
Minimizer of two random walks
Consider the following two random walks:
The first random walk $\{S_n\}$ has i.i.d. step size
$$
X_i\sim\mathcal{N}(1,1)
$$
The second random walk $\{S'_n\}$ has i.i.d. step size
$$
Y_i\sim\mathcal{...
- 103
2
votes
1
answer
528
views
Any modern/recent version of Ito & McKean?
This's a wonderful book[1] but the latest edition I have is dated 1973. Is there recent book(s)/rewrite(s) that covers the same subjects and elucidate with more explicit arguments and details of their ...
- 163
1
vote
1
answer
276
views
Number of deaths in birth-death process conditioned on start and end points
Say I have a simple linear continuous time birth-death process with state space the non-negative integers, where there are parameters $b$ and $d$, with the rate (as you'd see in a $Q$ matrix) of going ...
- 11
1
vote
1
answer
4k
views
First passage time of a 1D simple random walk in a discrete time infinite markov chain [closed]
If we consider a simple Random Walk on the positive integers (discrete Markov chain), with symmetric transition probabilities. We start at time $0$ at the integer $i_0 = m$ and at each time step $P(...
- 53
0
votes
1
answer
613
views
2 Random Walkers on 2d square lattice, Torus
I am looking for the probability that two random walkers initially at different sites, meet at step t if they are moving on a 2-dimensional torus(Square Lattice)
Any help would be appreciated.
- 53
5
votes
0
answers
485
views
Hierarchical Random Walk (also known as Hierarchical Hidden Markov Model)
Let us consider the following hierarchical (recursive) random walk model, which is also known as the hierarchical hidden Markov model in computer science (https://en.wikipedia.org/wiki/...
- 1,127
1
vote
0
answers
60
views
Probability for a SRW to be at some place in an even number of steps
I am looking for some references for the following problem.
Consider a graph $G$ and a simple continuous time random walk $(X_t)_{t\geqslant 0}$ on this graph. Consider the family of events $(e_t)_{t\...
- 166
2
votes
1
answer
412
views
Does random walk have more concentration surrounding the origin?
Consider a simple random walk $S_n$ on one dimension, starting at $0$. In this case, $S_n$ fluctuates between $-\infty$ and $\infty$, but intuition says that it might stay more often in an interval ...
- 502
6
votes
0
answers
183
views
Distribution of the stopping time of an autoregressive sequence
Consider $e_t$ being i.i.d. uniformly chosen from $\pm 1$. Let $\eta$ be a small positive constant. What is the distribution of $T$ such that $\eta^{0.5} (1+\eta)^T W_T$ first hits $\pm 1$, in which
$$...
- 1,127
6
votes
2
answers
2k
views
Random walk to stay in an interval forever
Consider a random walk on the real time, starting from $0$. But this time assume that we can decide, for each step $i$, a step size $t_i>0$ to the left or the right with equal probabilities.
To ...
- 502
6
votes
1
answer
170
views
Basic Definition and Notations in RWRE
From the definition of Zeitouni's lecture notes on RWRE: $(V, E)$ is a special graph, and $N_v:= \{k \in V: (v,k) \in E\}$ is the neighborhood of $v \in V$. $\Omega = \prod_{v \in V} M_1(N_v)$ ...
- 61
1
vote
0
answers
365
views
Diagonal of Green's Function
I am looking to numerically calulate the diagonal of Green's function. I am interested in Green's functions of elliptic PDEs and in those that arise from stochastic processes (discrete and continuous)....
- 185
4
votes
0
answers
229
views
Self-adjusting random walk
Let $X_t$ be a random process such that
\begin{eqnarray}
X_1 &=& 0\\
X_t &=& X_{t-1} + \left\{\begin{array}{ll}
A_t, & X_{t-1} \geq 0\\
B_t, & X_{t-1} < 0
\end{array}\...
- 93
4
votes
2
answers
255
views
The necessary sufficient condition for recurrence of a Markovian random walk
Suppose $\sigma_{1},\sigma_{2},...$are i.i.d random variables.$S_{0}=0$. Define $S_{n}=S_{0}+\sum_{i=1}^{n}\sigma_{i}$, then ${S_{n}}$ is a Markovian random walk.
I want to figure out the necessary ...
- 41
5
votes
0
answers
95
views
Most visited vertex in a random walk with place dependent drift
Consider the following Markov chain on $\mathbb{Z}$:
$$
P(x,x+1)=1-P(x,x-1)=\frac{1}{2}+e^{-|x|}\cdot \mathbf{1}_{\{x\neq 0\}}
$$
Do there exist constants $c,C>0$ such that
$$
c\cdot P^t(z,z) \...
- 527
3
votes
1
answer
968
views
Expected visits to the origin by a symmetric random walk on the integers
Consider the first $2n$ steps of a simple random walk on the integers, starting at the origin. A simple binomial argument shows that regardless of $n$, the origin gets visited the most (in expectation)...
- 527
2
votes
1
answer
168
views
Random Walk 2D with dependent weights [closed]
I have spent a lot of time trying to solve this problem but have had no luck so far! Any help would be highly appreciated!
Suppose I have a 3x3 grid as shown below.
(3,1) (3,2) (3,3)
(2,1) (2,2) (...
- 23
0
votes
1
answer
239
views
Transition probabilities for the symmetric random walk on the integers
I found that most references for the symmetric random walk on the integers are for the discrete time case, i.e. the ones that gives us explicit transition probabilities. Now, I am looking at a random ...
- 243
0
votes
1
answer
150
views
Weak convergence of process
Background:
I am trying to compute the weak limit of the following model from mathematical biology that is supposed to exist:
Let $$L(f)(\eta)= \sum_{x \in \mathbb{Z}}\frac{1}{2}\left(1_{\eta(x+1) \...
- 243
5
votes
1
answer
297
views
Random walk with continuously distributed steps on [-1,1]
A simple random walk $S_n = X_1 +\cdots +X_n$, where $P(X_i = 1) = p \not = 0.5$ and $P(X_i=-1)= q \triangleq 1-p$, admits the following probability
$$P(S_n \textrm{ reaches } a \textrm{ before} -b) =...
- 108
6
votes
2
answers
241
views
Recurrence of Poisson binomial distributed random walk
Let $X_n$ be the outcome of a Bernoulli trial where the probability of getting 1 is $p_n$ and the probability of getting 0 is $1-p_n$, and let $S_n = \sum_{i=1}^n \left(X_i - \textrm{E} X_i \right)$. ...
- 965
0
votes
0
answers
111
views
Markov chains on a polyhedron
A modification of a question from Gerard Letac (1976): A m-sided q-adjacent-faced polyhedron has one of its faces "up." Each round, the polyhedron rolls so that any of the adjacent faces is now up. ...
1
vote
1
answer
247
views
Arc Sine law for Random Walk conditioned to non-absorption or not?
Let $S_n$ be simple symmetric Random walk on the integers in $[-N,N]$ with states $N$ and $-N$ absorbing. Let $\tau$ be the time to absorption when $S_0 = 0$.
Is the $E(S^{2}_{n}| \tau \geq n)$ known?...
- 61
5
votes
1
answer
523
views
Scaling of First-passage times for Random Walk on integer lattices
Consider simple symmetric random walk $S_{n} = (S_{n}^{(1)},\dots,
S_{n}^{(d)})$ on the d-dimensional integer lattice with starting point the origin.
Let $\tau_{N}$ be the first time $S_{n}$ exits ...
- 61
1
vote
0
answers
309
views
Horizontal vs Vertical sides Exit from a Rectangle for simple symmetric Random Walk on $\textbf{Z}^{2}$
Consider simple symmetric random walk, $X_{n} = (X_{n}^{(1)}, X_{n}^{(2)})$ with $X_0= (0,0)$, on the 2 dimensional integer lattice, $\textbf{Z}^{2}$.
Let $T_{M}, T_{N}$ be the smallest $n$ such ...
user71202
1
vote
1
answer
971
views
Integration of independent Brownian motions
I am wondering if the following integral of stochastic Brownian motions has an analytical solution?
$$
\int_{0}^{t}e^{\nu \tilde{V}_{\tau} - \frac{1}{2}\nu^{2}\tau}d\tilde{W}_{\tau}
$$
where $\tilde{...
- 11
10
votes
1
answer
351
views
Trapping a particle
A particle starts a brownian walk in the middle of a long tunnel in the plane, at one end of the tunnel is a region Y of given area A.
Does the shape of region Y affect average time for the particle ...
- 101