wolffd@0: function pi = mc_stat_distrib(P) wolffd@0: % MC_STAT_DISTRIB Compute stationary distribution of a Markov chain wolffd@0: % function pi = mc_stat_distrib(P) wolffd@0: % wolffd@0: % Each row of P should sum to one; pi is a column vector wolffd@0: wolffd@0: % Kevin Murphy, 16 Feb 2003 wolffd@0: wolffd@0: % The stationary distribution pi satisfies pi P = pi wolffd@0: % subject to sum_i pi(i) = 1, 0 <= pi(i) <= 1 wolffd@0: % Hence wolffd@0: % (P' 0n (pi = (pi wolffd@0: % 1n 0) 1) 1) wolffd@0: % or P2 pi2 = pi2. wolffd@0: % Naively we can solve this using (P2 - I(n+1)) pi2 = 0(n+1) wolffd@0: % or P3 pi2 = 0(n+1), i.e., pi2 = P3 \ zeros(n+1,1) wolffd@0: % but this is singular (because of the sum-to-one constraint). wolffd@0: % Hence we replace the last row of P' with 1s instead of appending ones to create P2, wolffd@0: % and similarly for pi. wolffd@0: wolffd@0: n = length(P); wolffd@0: P4 = P'-eye(n); wolffd@0: P4(end,:) = 1; wolffd@0: pi = P4 \ [zeros(n-1,1);1]; wolffd@0: wolffd@0: