Mercurial > hg > camir-ismir2012
annotate toolboxes/FullBNT-1.0.7/HMM/pomdp_sample.m @ 0:cc4b1211e677 tip
initial commit to HG from
Changeset:
646 (e263d8a21543) added further path and more save "camirversion.m"
author | Daniel Wolff |
---|---|
date | Fri, 19 Aug 2016 13:07:06 +0200 |
parents | |
children |
rev | line source |
---|---|
Daniel@0 | 1 function [obs, hidden] = pomdp_sample(initial_prob, transmat, obsmat, act) |
Daniel@0 | 2 % SAMPLE_POMDP Generate a random sequence from a Partially Observed Markov Decision Process. |
Daniel@0 | 3 % [obs, hidden] = sample_pomdp(prior, transmat, obsmat, act) |
Daniel@0 | 4 % |
Daniel@0 | 5 % Inputs: |
Daniel@0 | 6 % prior(i) = Pr(Q(1)=i) |
Daniel@0 | 7 % transmat{a}(i,j) = Pr(Q(t)=j | Q(t-1)=i, A(t)=a) |
Daniel@0 | 8 % obsmat(i,k) = Pr(Y(t)=k | Q(t)=i) |
Daniel@0 | 9 % act(a) = A(t), so act(1) is ignored |
Daniel@0 | 10 % |
Daniel@0 | 11 % Output: |
Daniel@0 | 12 % obs and hidden are vectors of length T=length(act) |
Daniel@0 | 13 |
Daniel@0 | 14 |
Daniel@0 | 15 len = length(act); |
Daniel@0 | 16 hidden = mdp_sample(initial_prob, transmat, act); |
Daniel@0 | 17 obs = zeros(1, len); |
Daniel@0 | 18 for t=1:len |
Daniel@0 | 19 obs(t) = sample_discrete(obsmat(hidden(t),:)); |
Daniel@0 | 20 end |