Almost sure stabilization of hybrid systems by feedback controlbased on discrete-time observations of mode and state

1.
Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, School of Information and Control,Nanjing University of Information Science and Technology, Nanjing 210044, China

2.
School of Electronic and Information Engineering,Nanjing University of Information Science and Technology, Nanjing 210044, China

Abstract

Although the mean square stabilization of hybrid systems byfeedback control based on discrete-time observations of state and mode has been studied by severalauthors since 2013,the corresponding almost sure stabilization problemhas received little attention. Recently, Mao was the first to study the almost sure stabilization of a given unstable system$\dot~x(t)=f(x(t))$ by a linear discrete-time stochastic feedback control $Ax([t/\T]\T){\rm~d}B(t)$ (namely the stochastically controlled systemhas the form ${\rm~d}x(t)=f(x(t)){\rm~d}t~+~Ax([t/\T]\T){\rm~d}B(t)$), where $B(t)$ is a scalar Brownian, $\T~>0$, and $[t/\T]$ is the integer part of $t/\T$. In this paper, we consider a much more general problem. That is, we study the almost sure stabilization of a given unstable hybrid system$\dot~x(t)=f(x(t),r(t))$ by nonlinear discrete-time stochastic feedback control $u(x([t/\T]\T),r([t/\T]\T)){\rm~d}B(t)$ (so the stochastically controlled system is a hybrid stochastic system of the form ${\rm~d}x(t)=f(x(t),r(t)){\rm~d}t~+~u(x([t/\T]\T),r([t/\T]\T)){\rm~d}B(t)$), where $B(t)$ is a multi-dimensional Brownian motion and $r(t)$ is a Markov chain.

Update

Abstract

English

Chinese

Acknowledgment

The authors would like to thank Leverhulme Trust (Grant No. RF-2015-385), Royal Society (Grant No. WM160014, Royal Society Wolfson Research Merit Award), Royal Society and Newton Fund (Grant No. NA160317, Royal Society–Newton Advanced Fellowship), Engineering and Physics Sciences Research Council (Grant No. EP/K503174/1), National Natural Science Foundation of China (Grant Nos. 61503190, 61473334, 61403207), Natural Science Foundation of Jiangsu Province (Grant Nos. BK20150927, BK20131000), and Ministry of Education (MOE) of China (Grant No. MS2014DHDX020) for their financial support. The first author would like to thank Chinese Scholarship Council for awarding him the scholarship to visit the University of Strathclyde for one year.

Supplement

Appendix

Once Assumption A3.1 holds, the verification of Assumption A3.2 depends very much on the choice of $p\in~(0,1)$. In this appendix, we give some easier qualifications that guarantee the existence of such a $p$ and, hence, for Assumption A3.2 to hold. For this purpose, we need the theory of $M$-matrices (see [2,27]). For a vector or matrix $A$, $A>~0$ means that all elements of $A$ are positive. Moreover, a square matrix $A=[a_{ij}]_{N\K~N}$ is called a $Z$-matrix if it has nonpositive off-diagonal entries, namely

$$ a_{ij}\le 0 \hbox{ for all } i\not =j. $$

Here, we cite a useful lemma on $M$-matrices.

Lemma A1 ( [20]) .LMatrixIf $A=[a_{ij}]_{N\K~N}$ is a $Z$-matrix, the following statements are equivalent:

(1) $A$ is a nonsingular $M$-matrix.

(2) $A$ is semi-positive; that is, there exists $x~>~0$ in $\RR^N$ such that $Ax~>~0$.

If not, by switching state $u$ with $N$, we need to reorder the states of the Markov chain $r(t)$ that is, rename state $u$ as $N$ and $N$ as $u$. Consequently, the determinant in the left-hand side of (50) will switch the $u$th row with the $N$th row and then switch the $u$th column with the $N$th column, but these do not change the value of the determinant, namely the determinant remains positive. Moreover, given a nonsingular $M$-matrix, it is easy to show that the new matrix remains a nonsingular $M$-matrix by switching the $u$th column with the $N$th column and then switching the $u$th row with the $N$th row.

By [27], the derivative ${\rm~d}{\cal~A}(0)/{\rm~d}p~$ is equal to the determinant on the left-hand side of (50), whence ${\rm~d}{\cal~A}(0)/{\rm~d}p~>~0$. It is also easy to see ${\cal~A}(0)=0$. Consequently, for all $p\in~(0,~1)$ sufficiently small, we have

\begin{align} \hbox{\rm det} {\cal A}(p) > 0. \tag{55} \end{align}

On the other hand, for each $i=1,2,\ldots,~N-1$, either $\g_{iN}~>~0$ or $\g_{iN}=0$. In the case when $\g_{iN}~>~0$, we clearly have

by (56). By Lemma A2, det${\cal~A}_k(p)~>0$. Thus, we should point out that all the deriving principal minors of ${\cal~A}(p)$ are positive. By applying Lemma A1, we can obtain that ${\cal~A}(p)$ is a nonsingular $M$-matrix. This completes the proof.

[32]
You
S,
Liu
W,
Lu
J.
Stabilization of hybrid systems by feedback control based on discrete-time state observations.
SIAM J Control Optim,
2015, 53: 905-925
CrossRefGoogle Scholarhttp://scholar.google.com/scholar_lookup?title=Stabilization of hybrid systems by feedback control based on discrete-time state observations&author=You S&author=Liu W&author=Lu J&publication_year=2015&journal=SIAM J Control Optim&volume=53&pages=905-925

[33]
Song
G,
Zheng
B C,
Luo
Q.
Stabilisation of hybrid stochastic differential equations by feedback control based on discrete-time observations of state and mode.
IET Control Theor Appl,
2017, 11: 301-307
CrossRefGoogle Scholarhttp://scholar.google.com/scholar_lookup?title=Stabilisation of hybrid stochastic differential equations by feedback control based on discrete-time observations of state and mode&author=Song G&author=Zheng B C&author=Luo Q&publication_year=2017&journal=IET Control Theor Appl&volume=11&pages=301-307