Daniel@0: function h = hesschek(net, x, t)
Daniel@0: %HESSCHEK Use central differences to confirm correct evaluation of Hessian matrix.
Daniel@0: %
Daniel@0: %	Description
Daniel@0: %
Daniel@0: %	HESSCHEK(NET, X, T) takes a network data structure NET, together with
Daniel@0: %	input and target data matrices X and T, and compares the evaluation
Daniel@0: %	of the Hessian matrix using the function NETHESS and using central
Daniel@0: %	differences with the function NETERR.
Daniel@0: %
Daniel@0: %	The optional return value H is the Hessian computed using NETHESS.
Daniel@0: %
Daniel@0: %	See also
Daniel@0: %	NETHESS, NETERR
Daniel@0: %
Daniel@0: 
Daniel@0: %	Copyright (c) Ian T Nabney (1996-2001)
Daniel@0: 
Daniel@0: w0 = netpak(net);
Daniel@0: nwts = length(w0);
Daniel@0: h = nethess(w0, net, x, t);
Daniel@0: 
Daniel@0: w = w0;
Daniel@0: hcent = zeros(nwts, nwts);
Daniel@0: h1 =  0.0; h2 =  0.0; h3 =  0.0; h4 = 0.0;
Daniel@0: epsilon = 1.0e-4;
Daniel@0: fprintf(1, 'Checking Hessian ...\n\n');
Daniel@0: for k = 1:nwts;
Daniel@0:   for l = 1:nwts;
Daniel@0:     if(l == k)
Daniel@0:       w(k) = w0(k) + 2.0*epsilon;
Daniel@0:       h1 = neterr(w, net, x, t);
Daniel@0:       w(k) = w0(k) - 2.0*epsilon;
Daniel@0:       h2 = neterr(w, net, x, t);
Daniel@0:       w(k) = w0(k);
Daniel@0:       h3 = neterr(w, net, x, t);
Daniel@0:       hcent(k, k) = (h1 + h2 - 2.0*h3)/(4.0*epsilon^2);
Daniel@0:     else
Daniel@0:       w(k) = w0(k) + epsilon;
Daniel@0:       w(l) = w0(l) + epsilon;
Daniel@0:       h1 = neterr(w, net, x, t);
Daniel@0:       w(k) = w0(k) - epsilon;
Daniel@0:       w(l) = w0(l) - epsilon;
Daniel@0:       h2 = neterr(w, net, x, t);
Daniel@0:       w(k) = w0(k) + epsilon;
Daniel@0:       w(l) = w0(l) - epsilon;
Daniel@0:       h3 = neterr(w, net, x, t);
Daniel@0:       w(k) = w0(k) - epsilon;
Daniel@0:       w(l) = w0(l) + epsilon;
Daniel@0:       h4 = neterr(w, net, x, t);
Daniel@0:       hcent(k, l) = (h1 + h2 - h3 - h4)/(4.0*epsilon^2);
Daniel@0:       w(k) = w0(k);
Daniel@0:       w(l) = w0(l);
Daniel@0:     end
Daniel@0:   end
Daniel@0: end
Daniel@0: 
Daniel@0: fprintf(1, '   analytical    numerical       delta\n\n');
Daniel@0: temp = [h(:), hcent(:), (h(:) - hcent(:))];
Daniel@0: fprintf(1, '%12.6f  %12.6f  %12.6f\n', temp');