Access

You are not currently logged in.

Access your personal account or get JSTOR access through your library or other institution:

login

Log in to your personal account or through your institution.

If you need an accessible version of this item please contact JSTOR User Support

A Multivariate Generalizability Analysis of Data from a Performance Assessment of Physicians' Clinical Skills

Brian E. Clauser, Polina Harik and Melissa J. Margolis
Journal of Educational Measurement
Vol. 43, No. 3 (Fall, 2006), pp. 173-191
Stable URL: http://www.jstor.org/stable/20461823
Page Count: 19
  • More info
  • Cite this Item
If you need an accessible version of this item please contact JSTOR User Support
A Multivariate Generalizability Analysis of Data from a Performance Assessment of Physicians' Clinical Skills
Preview not available

Abstract

Although multivariate generalizability theory was developed more than 30 years ago, little published research utilizing this framework exists and most of what does exist examines tests built from tables of specifications. In this context, it is assumed that the universe scores from levels of the fixed multivariate facet will be correlated, but the error terms will be uncorrelated because subscores result from mutually exclusive sets of test items. This paper reports on an application in which multiple subscores are derived from each task completed by the examinee. In this context, both universe scores and errors may be correlated across levels of the fixed multivariate facet. The data described come from the United States Medical Licensing Examination® Step 2 Clinical Skills Examination. In this test, each examinee interacts with a series of standardized patients and each interaction results in four component scores. The paper focuses on the application of multivariate generalizability theory in this context and on the practical interpretation of the resulting estimated variance and covariance components.

Page Thumbnails

  • Thumbnail: Page 
173
    173
  • Thumbnail: Page 
174
    174
  • Thumbnail: Page 
175
    175
  • Thumbnail: Page 
176
    176
  • Thumbnail: Page 
177
    177
  • Thumbnail: Page 
178
    178
  • Thumbnail: Page 
179
    179
  • Thumbnail: Page 
180
    180
  • Thumbnail: Page 
181
    181
  • Thumbnail: Page 
182
    182
  • Thumbnail: Page 
183
    183
  • Thumbnail: Page 
184
    184
  • Thumbnail: Page 
185
    185
  • Thumbnail: Page 
186
    186
  • Thumbnail: Page 
187
    187
  • Thumbnail: Page 
188
    188
  • Thumbnail: Page 
189
    189
  • Thumbnail: Page 
190
    190
  • Thumbnail: Page 
191
    191