This paper describes a class of dynamical stochastic systems that represents an extension of classical Markov decision processes. The Markov stochastic systems with given final sequence of states and unitary transition ...