You are not currently logged in.
Access your personal account or get JSTOR access through your library or other institution:
If You Use a Screen ReaderThis content is available through Read Online (Free) program, which relies on page scans. Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
General Observer-Agreement Measures on Individual Subjects and Groups of Subjects
Dianne L. O'Connell and Annette J. Dobson
Vol. 40, No. 4 (Dec., 1984), pp. 973-983
Published by: International Biometric Society
Stable URL: http://www.jstor.org/stable/2531148
Page Count: 11
Since scans are not currently available to screen readers, please contact JSTOR User Support for access. We'll provide a PDF copy for your screen reader.
Preview not available
General chance-corrected measures of agreement on individual subjects, for several observers using nominal or ordinal categories, are developed. The subject-specific measures can be used to identify subjects whom the observers find difficult to rate. The relationship of the subject-specific measures to a general chance-corrected measure of agreement for a group of subjects is demonstrated. By suitable choices of disagreement functions, the measure of agreement for a group of subjects is shown to include, as special cases, many of the kappa-like statistics. Also, it is asymptotically equivalent to various intraclass correlation coefficients. The measures do not require that the observers all use the classification scale in the same way. The asymptotic null and non-null variances obtained by Taylor-series approximations for the statistics are presented. The application of the measures is illustrated by data obtained when seven pathologists classified slides on a five-point ordinal scale for the diagnosis of carcinoma in situ of the uterine cervix.
Biometrics © 1984 International Biometric Society