Non-Parametric: K-NNK-NN.K-NNK-NN Examples.Non-parametric Classification.Non-Parametric ClassificationNearest Neighbour Decision RuleSlide 8Slide 9Randomized Decisions.NN Error AnalysisSlide 12Slide 13Slide 14KNN Decision RuleNN Decision RuleNon-Parametric: K-NNProf. A.L. YuilleStat 231. Fall 2004.Duda, Hart and Stork: Chp 4.4 & 4.5.K-NN.K-NNK-NN Examples.Non-parametric Classification.Non-Parametric ClassificationNearest Neighbour Decision RuleNearest Neighbour Decision RuleNearest Neighbour Decision RuleRandomized Decisions.NN Error AnalysisHere x* is the sample closest to point x. As the no. samples becomeslarge x* will be arbitrarily close to x.NN Error AnalysisNN Error AnalysisNN Error AnalysisKNN Decision RuleNN Decision Rule•The nearest neighbour decision rule is very easy to use.•It can be effective in situations where other classification rules – e.g. linear separation – will not work.•The asymptotic result shows that the NN rule often approaches the performance of the (optimal) Bayes
View Full Document