In this paper we consider a new class of random dynamical systems which contains in particular neural networks and complicated circuits. For these systems we consider the viability problem: we suppose that the system survives only if the system state is in a prescribed domain Π of a phase space. The approach developed here is based on some fundamental ideas proposed by A. Kolmogorov, R.Thom, M. Gromov, L.Valiant, L. Van Valen and others.Under some conditions it is shown that almost all systems from this class with fixed parameters are unstable in the following sense: the probability P t to leave Π within time interval [0, t] tends to 1 as t → ∞. However, if it is allowed to change these parameters sometimes ("evolutionary" case), then possibly that P t < 1 − δ < 1 for all t. ("stable ebolution"). Furthermore we study the properties of such stable evolution assuming that the system parameters are coded by a dicsrete code. This allows us to apply the complexity theory, coding, algorithms etc. Evolution is a Markov process of this code modification.Under some conditions we show that the stable evolution of unstable systems possesses such general fundamental property: the relative Kolmogorov complexity of the code cannot be bounded by a constant as time t → ∞.For circuit models we define complexity characteristics of these circuits. We find that these complexities also have a tendency to increase during stable evolution. We give concrete examples of stable evolution.