comparison toolboxes/FullBNT-1.0.7/HMM/mdp_sample.m @ 0:e9a9cd732c1e tip

first hg version after svn
author wolffd
date Tue, 10 Feb 2015 15:05:51 +0000
parents
children
comparison
equal deleted inserted replaced
-1:000000000000 0:e9a9cd732c1e
1 function state = sample_mdp(prior, trans, act)
2 % SAMPLE_MDP Sample a sequence of states from a Markov Decision Process.
3 % state = sample_mdp(prior, trans, act)
4 %
5 % Inputs:
6 % prior(i) = Pr(Q(1)=i)
7 % trans{a}(i,j) = Pr(Q(t)=j | Q(t-1)=i, A(t)=a)
8 % act(a) = A(t), so act(1) is ignored
9 %
10 % Output:
11 % state is a vector of length T=length(act)
12
13 len = length(act);
14 state = zeros(1,len);
15 state(1) = sample_discrete(prior);
16 for t=2:len
17 state(t) = sample_discrete(trans{act(t)}(state(t-1),:));
18 end