annotate toolboxes/FullBNT-1.0.7/netlab3.3/knnfwd.m @ 0:cc4b1211e677 tip

initial commit to HG from Changeset: 646 (e263d8a21543) added further path and more save "camirversion.m"
author Daniel Wolff
date Fri, 19 Aug 2016 13:07:06 +0200
parents
children
rev   line source
Daniel@0 1 function [y, l] = knnfwd(net, x)
Daniel@0 2 %KNNFWD Forward propagation through a K-nearest-neighbour classifier.
Daniel@0 3 %
Daniel@0 4 % Description
Daniel@0 5 % [Y, L] = KNNFWD(NET, X) takes a matrix X of input vectors (one vector
Daniel@0 6 % per row) and uses the K-nearest-neighbour rule on the training data
Daniel@0 7 % contained in NET to produce a matrix Y of outputs and a matrix L of
Daniel@0 8 % classification labels. The nearest neighbours are determined using
Daniel@0 9 % Euclidean distance. The IJth entry of Y counts the number of
Daniel@0 10 % occurrences that an example from class J is among the K closest
Daniel@0 11 % training examples to example I from X. The matrix L contains the
Daniel@0 12 % predicted class labels as an index 1..N, not as 1-of-N coding.
Daniel@0 13 %
Daniel@0 14 % See also
Daniel@0 15 % KMEANS, KNN
Daniel@0 16 %
Daniel@0 17
Daniel@0 18 % Copyright (c) Ian T Nabney (1996-2001)
Daniel@0 19
Daniel@0 20
Daniel@0 21 errstring = consist(net, 'knn', x);
Daniel@0 22 if ~isempty(errstring)
Daniel@0 23 error(errstring);
Daniel@0 24 end
Daniel@0 25
Daniel@0 26 ntest = size(x, 1); % Number of input vectors.
Daniel@0 27 nclass = size(net.tr_targets, 2); % Number of classes.
Daniel@0 28
Daniel@0 29 % Compute matrix of squared distances between input vectors from the training
Daniel@0 30 % and test sets. The matrix distsq has dimensions (ntrain, ntest).
Daniel@0 31
Daniel@0 32 distsq = dist2(net.tr_in, x);
Daniel@0 33
Daniel@0 34 % Now sort the distances. This generates a matrix kind of the same
Daniel@0 35 % dimensions as distsq, in which each column gives the indices of the
Daniel@0 36 % elements in the corresponding column of distsq in ascending order.
Daniel@0 37
Daniel@0 38 [vals, kind] = sort(distsq);
Daniel@0 39 y = zeros(ntest, nclass);
Daniel@0 40
Daniel@0 41 for k=1:net.k
Daniel@0 42 % We now look at the predictions made by the Kth nearest neighbours alone,
Daniel@0 43 % and represent this as a 1-of-N coded matrix, and then accumulate the
Daniel@0 44 % predictions so far.
Daniel@0 45
Daniel@0 46 y = y + net.tr_targets(kind(k,:),:);
Daniel@0 47
Daniel@0 48 end
Daniel@0 49
Daniel@0 50 if nargout == 2
Daniel@0 51 % Convert this set of outputs to labels, randomly breaking ties
Daniel@0 52 [temp, l] = max((y + 0.1*rand(size(y))), [], 2);
Daniel@0 53 end