“…The Markov jump linear systems (MJLSs) are dynamical systems subject to abrupt variations in their structures. It is known that the MJLS is ideal to represent dynamical systems that are often inherently vulnerable to component failures, sudden disturbances, change of internal interconnections, and abrupt variations in operating conditions ( [1][2][3][4][5][6][7][8][9][10][11], and references therein). On the other hand, discrete-time stochastic processes is found in wide variety of applications, particularly in modeling of engineering, biological, medical and physical systems which are subject to random perturbations [12,13].…”