2
$\begingroup$

I have a question concerning the stability analysis for a kind of differential equation taking the form $$\dot x=Ax+Bw,$$ where $A\in \mathbb{R}^{n \times n}$, $B\in \mathbb{R}^{n \times m}$ are constant matrices and $w \in \mathbb{R}^m$ is a normal random variable, i.e., $w\sim \mathcal{N}(0,W)$ with $W$ be a symmetric and positive definite matrix.

Since the zero is not an equilibrium of the system, the Lyapunov analysis does not make sense. When the input-to-state stability analysis is considered, the robust control theory does not apply due to the unboundness of $w$. By resorting to stochastic stability in the sense of mean square or almost surely, the Ito formula seems to be invalid.

HOW to carry out the stability analysis of this kind of systems? Any pointer will be helpful. Thanks!

Improve this question
$\endgroup$
2
  • $\begingroup$ It seems to me that both Lyapunov analysis and control theory make perfect sense in this application. What you cannot hope to achieve is convergence to a fixed equilibrium point. Concepts such as input-to-state stability were formulated precisely to study systems of this kind. $\endgroup$
    – Pait
    Aug 11, 2013 at 21:13
  • $\begingroup$ As mentioned in an answer, the randomness is mostly irrelevant since $w$ is a random variable, not a random process. You are reduced to studying the systems $\dot x = Ax +v$ with $v$ a fixed vector, this is standard and seems not suitable for MO. $\endgroup$
    – Benoît Kloeckner
    Nov 3, 2013 at 9:55

2 Answers 2

Reset to default
1
$\begingroup$

This is a stochastic differential system of equations. I think this can help. You can also check the full syllabus of the course here with the proper references and other material to download.

Improve this answer
$\endgroup$
1
  • $\begingroup$ Thank you for your valuable references. Since $w$ is just a random variable rather than a random process, I am not sure wether or not the standard stochastic analyis could be used here. $\endgroup$
    – W. Nyway
    Jul 13, 2013 at 2:47
1
$\begingroup$

Randomness is irrelevant here. For any value of $w$, the change of variables $x=y-A^{-1}Bw$ reduces your system to $\dot y=Ay$ that you know how to treat.

Improve this answer
$\endgroup$
4
  • $\begingroup$ Thanks to Bakhtin. The matrix $A$ is not necessarily invertable. $\endgroup$
    – W. Nyway
    Jul 13, 2013 at 2:41
  • $\begingroup$ In the general situation, take the Jordan decomposition of $A$ and project the dynamics onto generalized eigenspaces corresponding to zero and nonzero eigenvalues. The randomness is still only mildly relevant and boils down to how a typical value of $Bw$ projects. $\endgroup$
    – Yuri Bakhtin
    Jul 13, 2013 at 20:37
  • $\begingroup$ Let me try as your suggestion. Anyway, thank you again. $\endgroup$
    – W. Nyway
    Jul 15, 2013 at 0:43
  • $\begingroup$ This change of variables puts in play the derivative of $w$, which may be problematic when $w$ is a random variable. $\endgroup$
    – Pait
    Aug 11, 2013 at 21:09

Not the answer you're looking for? Browse other questions tagged .