Definition

State space which has only one Communication Class. where is a HMC defined on the state space and the is a Transition Matrix of

where and is the probability of departing from and reaching after

Facts

If HMC has finite state space and is irreducible, then the unique Stationary Distribution of exists, and the probability of every state is positive.

Since Communication is a Equivalence Class, the reducible Markov chain can be partitioned into the irreducible Markov chains.