心理科学
心理科學
심이과학
Psychological Science
2012年
6期
1497~1501
,共null页
蔡艳 丁树良 涂冬波 戴海琦
蔡豔 丁樹良 塗鼕波 戴海琦
채염 정수량 도동파 대해기
GIRT模型 矩阵抽样 群体水平项目参数 学校能力
GIRT模型 矩陣抽樣 群體水平項目參數 學校能力
GIRT모형 구진추양 군체수평항목삼수 학교능력
group-level IRT Model, matrix sample, group-level item parameters, school ability
传统上,群体评估都是以个体的评估结果的平均值为基础进行的。而群体水平IRTGIRT理论则可以避开对个体的评估,直接实现对群体的评估,它具有许多传统方法难以企及的优点。本文将群体水平IRT模型应用于2007年某省高考英语阅读理解的410所学校的能力评估,评估结果发现:410所学校的英语阅读理解能力几乎都在[-1,1]区间内,没有能力极高或极低的学校。对这些学校而言,测验中所有项目的难度较易,区分度适中。所有的评估结果与IRT模型的评估结果相关显著,GIRT模型在实践中是可供选择的群体评估方法。
傳統上,群體評估都是以箇體的評估結果的平均值為基礎進行的。而群體水平IRTGIRT理論則可以避開對箇體的評估,直接實現對群體的評估,它具有許多傳統方法難以企及的優點。本文將群體水平IRT模型應用于2007年某省高攷英語閱讀理解的410所學校的能力評估,評估結果髮現:410所學校的英語閱讀理解能力幾乎都在[-1,1]區間內,沒有能力極高或極低的學校。對這些學校而言,測驗中所有項目的難度較易,區分度適中。所有的評估結果與IRT模型的評估結果相關顯著,GIRT模型在實踐中是可供選擇的群體評估方法。
전통상,군체평고도시이개체적평고결과적평균치위기출진행적。이군체수평IRTGIRT이론칙가이피개대개체적평고,직접실현대군체적평고,타구유허다전통방법난이기급적우점。본문장군체수평IRT모형응용우2007년모성고고영어열독리해적410소학교적능력평고,평고결과발현:410소학교적영어열독리해능력궤호도재[-1,1]구간내,몰유능력겁고혹겁저적학교。대저사학교이언,측험중소유항목적난도교역,구분도괄중。소유적평고결과여IRT모형적평고결과상관현저,GIRT모형재실천중시가공선택적군체평고방법。
Traditionally the assessment of groups is based on the assessment of individuals, which uses their means or other similar statistics as the findings. This method requires that all items be answered by each individual. But in practice, it is hard to perform. Now a new method, based on Group - level Item Response Theory (GIRT) , can be used for the assessment of groups without the individual assessment. Although it cannot realize the individual assessment, some simulation studies show that it has advantages over IRT when only group assessment is required. However, there have been few studies on the effect of the GIRT framework on group assessment in practice. This paper tried to explore this issue through an English reading comprehension test data with a two - parameter Logistic GIRT model(2GPLM). There are two purposes of this study: one is to conduct a group/school assessment to provide comparison between schools ; the other is to discuss the effect on group under 2GPLM through the comparison with the group - level finding under the two parametric Logistic IRT model (2PLM). Findings showed that:
( 1 ) Under 2GPLM, for the 410 schools, the mean and standard variation of the school ability was - 0. 1743 and . 4300, almost all school ability indicators were the internal [ - 1,1 ]. As a whole, the global group - level ability was at tile moderate to low level. When all of the schools were classified into three types( superior school, senior school and ordinary school) according to the rules of this province, the mean of the school ability indicators were different significantly through multiple comparison test (LSD), which was consistent with the intent of the rules.
(2) Under the IRT framework, for the 82000 students, the mean and standard variation of their ability was zero and . 90913, the distribution of students' ability was normal. The correlation the school ability under GIRT with that under IRT was . 953, which suggests that the findings between both models were consistent.
( 3 ) For both individuals and schools, almost all items were easy and had moderate discrimination. It could be verified that the item difficulty parameters at the student - level and at the group - level were significant correlated, which means that there is a functional relationship between the items difficulty parameters under both models.
All these findings suggest that the model under GIRT framework could be used to make group - level assessment in real practice, and it could be used for similar assessment of groups on the IRT model. During the assessment, it was found that the GIRT model had some advantages over the IRT model when only group - level assessment was in demand. Specifically, it made the assessment more flexible, effective and time saving. Thus we hope this research could provide some references for the researchers and field workers. We also hope that more and more researchers will get involved in studying GIRT.