Definition

where is the distribution of states and is Transition Matrix