Access

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

login

Log in to your personal account or through your institution.

If you need an accessible version of this item please contact JSTOR User Support

Development of Automated Scoring Algorithms for Complex Performance Assessments: A Comparison of Two Approaches

Brian E. Clauser, Melissa J. Margolis, Stephen G. Clyman and Linette P. Ross
Journal of Educational Measurement
Vol. 34, No. 2 (Summer, 1997), pp. 141-161
Stable URL: http://www.jstor.org/stable/1435350
Page Count: 21
  • More info
  • Cite this Item
If you need an accessible version of this item please contact JSTOR User Support
Development of Automated Scoring Algorithms for Complex Performance Assessments: A Comparison of Two Approaches
Preview not available

Abstract

Performance assessments are typically scored by having experts rate individual performances. The cost associated with using expert raters may represent a serious limitation in many large-scale testing programs. The use of raters may also introduce an additional source of error into the assessment. These limitations have motivated development of automated scoring systems for performance assessments. Preliminary research has shown these systems to have application across a variety of tasks ranging from simple mathematics to architectural problem solving. This study extends research on automated scoring by comparing alternative automated systems for scoring a computer simulation test of physicians' patient management skills; one system uses regression-derived weights for components of the performance, the other uses complex rules to map performances into score levels. The procedures are evaluated by comparing the resulting scores to expert ratings of the same performances.

Page Thumbnails

  • Thumbnail: Page 
141
    141
  • Thumbnail: Page 
142
    142
  • Thumbnail: Page 
143
    143
  • Thumbnail: Page 
144
    144
  • Thumbnail: Page 
145
    145
  • Thumbnail: Page 
146
    146
  • Thumbnail: Page 
147
    147
  • Thumbnail: Page 
[148]
    [148]
  • Thumbnail: Page 
149
    149
  • Thumbnail: Page 
150
    150
  • Thumbnail: Page 
151
    151
  • Thumbnail: Page 
152
    152
  • Thumbnail: Page 
153
    153
  • Thumbnail: Page 
154
    154
  • Thumbnail: Page 
155
    155
  • Thumbnail: Page 
156
    156
  • Thumbnail: Page 
157
    157
  • Thumbnail: Page 
158
    158
  • Thumbnail: Page 
159
    159
  • Thumbnail: Page 
160
    160
  • Thumbnail: Page 
161
    161