主观题评价中基于IRT的评分者效应模型

Journal: Modern Education Forum DOI: 10.12238/mef.v5i2.4838

宫子恩, 朱殷睿

浙江师范大学教师教育学院

Abstract

主观题考试的评分基本依赖于评分员的主观印象,容易受到评卷员的知识水平、综合能力、爱好、情绪、疲劳等主观因素的影响,因此在评分的准确性、严厉度和集中度等方面容易导致评分者效应。为了控制评分者效应的大小,本文介绍了基于项目反应理论的多面Rasch模型、评委束模型、阶层评分者模型及等级反应多水平侧面评分者模型,并对其进行了评述。

Keywords

主观题;评分者效应;评分者模型

References

[1] Wolfe,E.W.Identifying Rater Effects Using Latent Trait Models[J].Psychology Science, 2004(45):35-51.
[2] 李中权,孙晓敏,张厚粲,等.多面Rasch模型在主观题评分培训中的应用[J].中国考试(研究版),2008(01):26-31.
[3] Patz, R.J., Junker, B.W., Johnson, M.S.,et al. The Hierarchical Rater Model For rated Test Items and its Application to Large-scale Educational Assessment Data[J]. Journal of Educational and Behavioral Statistics, 2002,27(03):302- 314.
[4] Wilson, M. & Adams, R.J. Rasch Models for Item Bundles[J].Psy-chometrika, 1995,60(02):181-198.
[5] Mariano,L.T.InformationAccunmulation, Model,Selection and Rater Behavior in Constructed Response Student Assessments[J].Carnegie Mellon University, 2002,35(01):274-279.
[6] Hung L.F., Wang W.C. The Generalized Multilevel Facets Model for Longitudinal Data[J]. Journal of Educational and Behavioral Statistics, 2012,37(02):231-255.
[7] Wang W.C., Liu C.Y. Formulation and Application of the Generalized Multilevel Facets Model[J]. Educational and Psychological Measurement, 2007,67(04):583-605.
[8] 纪凌开.分部评分模型与其它几种多级模型的比较[J].心理科学,2004,27(04):1000-1001.
[9] 康春花,孙小坚,曾平飞.等级反应多水平侧面模型及其在主观题评分中的应用[J].心理科学,2017,40(06):1483-1490.

Copyright © 2022 宫子恩, 朱殷睿

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License