annotate toolboxes/FullBNT-1.0.7/netlab3.3/hbayes.m @ 0:cc4b1211e677 tip

initial commit to HG from Changeset: 646 (e263d8a21543) added further path and more save "camirversion.m"
author Daniel Wolff
date Fri, 19 Aug 2016 13:07:06 +0200
parents
children
rev   line source
Daniel@0 1 function [h, hdata] = hbayes(net, hdata)
Daniel@0 2 %HBAYES Evaluate Hessian of Bayesian error function for network.
Daniel@0 3 %
Daniel@0 4 % Description
Daniel@0 5 % H = HBAYES(NET, HDATA) takes a network data structure NET together
Daniel@0 6 % the data contribution to the Hessian for a set of inputs and targets.
Daniel@0 7 % It returns the regularised Hessian using any zero mean Gaussian
Daniel@0 8 % priors on the weights defined in NET. In addition, if a MASK is
Daniel@0 9 % defined in NET, then the entries in H that correspond to weights with
Daniel@0 10 % a 0 in the mask are removed.
Daniel@0 11 %
Daniel@0 12 % [H, HDATA] = HBAYES(NET, HDATA) additionally returns the data
Daniel@0 13 % component of the Hessian.
Daniel@0 14 %
Daniel@0 15 % See also
Daniel@0 16 % GBAYES, GLMHESS, MLPHESS, RBFHESS
Daniel@0 17 %
Daniel@0 18
Daniel@0 19 % Copyright (c) Ian T Nabney (1996-2001)
Daniel@0 20
Daniel@0 21 if (isfield(net, 'mask'))
Daniel@0 22 % Extract relevant entries in Hessian
Daniel@0 23 nmask_rows = size(find(net.mask), 1);
Daniel@0 24 hdata = reshape(hdata(logical(net.mask*(net.mask'))), ...
Daniel@0 25 nmask_rows, nmask_rows);
Daniel@0 26 nwts = nmask_rows;
Daniel@0 27 else
Daniel@0 28 nwts = net.nwts;
Daniel@0 29 end
Daniel@0 30 if isfield(net, 'beta')
Daniel@0 31 h = net.beta*hdata;
Daniel@0 32 else
Daniel@0 33 h = hdata;
Daniel@0 34 end
Daniel@0 35
Daniel@0 36 if isfield(net, 'alpha')
Daniel@0 37 if size(net.alpha) == [1 1]
Daniel@0 38 h = h + net.alpha*eye(nwts);
Daniel@0 39 else
Daniel@0 40 if isfield(net, 'mask')
Daniel@0 41 nindx_cols = size(net.index, 2);
Daniel@0 42 index = reshape(net.index(logical(repmat(net.mask, ...
Daniel@0 43 1, nindx_cols))), nmask_rows, nindx_cols);
Daniel@0 44 else
Daniel@0 45 index = net.index;
Daniel@0 46 end
Daniel@0 47 h = h + diag(index*net.alpha);
Daniel@0 48 end
Daniel@0 49 end