If you need an accessible version of this item please contact JSTOR User Support

A Probabilistic Nearest Neighbour Method for Statistical Pattern Recognition

C. C. Holmes and N. M. Adams
Journal of the Royal Statistical Society. Series B (Statistical Methodology)
Vol. 64, No. 2 (2002), pp. 295-306
Published by: Wiley for the Royal Statistical Society
Stable URL: http://www.jstor.org/stable/3088801
Page Count: 12
  • Download PDF
  • Cite this Item

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

login

Log in to your personal account or through your institution.

If you need an accessible version of this item please contact JSTOR User Support
A Probabilistic Nearest Neighbour Method for Statistical Pattern Recognition
Preview not available

Abstract

Nearest neighbour algorithms are among the most popular methods used in statistical pattern recognition. The models are conceptually simple and empirical studies have shown that their performance is highly competitive against other techniques. However, the lack of a formal framework for choosing the size of the neighbourhood k is problematic. Furthermore, the method can only make discrete predictions by reporting the relative frequency of the classes in the neighbourhood of the prediction point. We present a probabilistic framework for the k-nearest-neighbour method that largely overcomes these difficulties. Uncertainty is accommodated via a prior distribution on k as well as in the strength of the interaction between neighbours. These prior distributions propagate uncertainty through to proper probabilistic predictions that have continuous support on (0, 1). The method makes no assumptions about the distribution of the predictor variables. The method is also fully automatic with no user-set parameters and empirically it proves to be highly accurate on many bench-mark data sets.

Page Thumbnails

  • Thumbnail: Page 
[295]
    [295]
  • Thumbnail: Page 
296
    296
  • Thumbnail: Page 
297
    297
  • Thumbnail: Page 
298
    298
  • Thumbnail: Page 
299
    299
  • Thumbnail: Page 
300
    300
  • Thumbnail: Page 
301
    301
  • Thumbnail: Page 
302
    302
  • Thumbnail: Page 
303
    303
  • Thumbnail: Page 
304
    304
  • Thumbnail: Page 
305
    305
  • Thumbnail: Page 
306
    306