心理科学
心理科學
심이과학
Psychological Science
2014年
6期
1478~1484
,共null页
喻晓锋 罗照盛 高椿雷 秦春影
喻曉鋒 囉照盛 高椿雷 秦春影
유효봉 라조성 고춘뢰 진춘영
认知诊断 Q矩阵 贝叶斯网 可达矩阵 DINA模型
認知診斷 Q矩陣 貝葉斯網 可達矩陣 DINA模型
인지진단 Q구진 패협사망 가체구진 DINA모형
cognitive diagnosis, Q matrix, Bayesian Networks, reachable matrix, DINA model
Q矩阵是认知诊断测验的重要组成部分之一,围绕Q矩阵构建的诊断模型对Q矩阵中包含的错误较敏感。贝叶斯网分类模型是基于网络结点之间的关系构建的模型,将朴素贝叶斯网作为诊断模型,与DINA模型进行比较。模拟实验结果表明:Q矩阵中是否包含可达矩阵和错误界定的项目数量对DINA模型影响较大,对贝叶斯网模型影响较小;项目数量对DINA和贝叶斯网模型影响都较大;样本大小对贝叶斯网模型影响较大,对DINA模型影响较小。模拟研究结果显示,当Q矩阵中不包含可达阵、包含5个以上错误项目或样本数较大时,贝叶斯网分类模型优于DINA模型;而当Q矩阵中包含可达阵和5个(以下)错误项目时,DINA模型优于贝叶斯分类模型。
Q矩陣是認知診斷測驗的重要組成部分之一,圍繞Q矩陣構建的診斷模型對Q矩陣中包含的錯誤較敏感。貝葉斯網分類模型是基于網絡結點之間的關繫構建的模型,將樸素貝葉斯網作為診斷模型,與DINA模型進行比較。模擬實驗結果錶明:Q矩陣中是否包含可達矩陣和錯誤界定的項目數量對DINA模型影響較大,對貝葉斯網模型影響較小;項目數量對DINA和貝葉斯網模型影響都較大;樣本大小對貝葉斯網模型影響較大,對DINA模型影響較小。模擬研究結果顯示,噹Q矩陣中不包含可達陣、包含5箇以上錯誤項目或樣本數較大時,貝葉斯網分類模型優于DINA模型;而噹Q矩陣中包含可達陣和5箇(以下)錯誤項目時,DINA模型優于貝葉斯分類模型。
Q구진시인지진단측험적중요조성부분지일,위요Q구진구건적진단모형대Q구진중포함적착오교민감。패협사망분류모형시기우망락결점지간적관계구건적모형,장박소패협사망작위진단모형,여DINA모형진행비교。모의실험결과표명:Q구진중시부포함가체구진화착오계정적항목수량대DINA모형영향교대,대패협사망모형영향교소;항목수량대DINA화패협사망모형영향도교대;양본대소대패협사망모형영향교대,대DINA모형영향교소。모의연구결과현시,당Q구진중불포함가체진、포함5개이상착오항목혹양본수교대시,패협사망분류모형우우DINA모형;이당Q구진중포함가체진화5개(이하)착오항목시,DINA모형우우패협사분류모형。
In recent years, cognitive diagnostic assessment is an area of research that has attracted widespread attention. As we all know, one of the important components in cognitive diagnosis is Q-matrix, because Q-matrix reflects the design of the assessment instrument and is the core element that determines the quality of the diagnostic feedback for the instrument. At present, there are some researches about classification accuracy in D1NA model with error existed in Q-matrix. These studies indicate that the quality of the Q-matrix has a great influence on the diagnostic accuracy rate, and also indicate that cognitive diagnosis models constructed around Q-matrix are sensitive to the accuracy of Q-matrix, greatly influenced by Q-matrix, and mostly, the starting point of these research are "if the Q-matrix contains errors, how does it affect the accuracy of parameters estimation and classification accuracy".
Up to now, the most problem is that we haven't an effective method for validating the Q-matrix at hand. Different diagnostic models have different diagnostic classification accuracy rate, and affected by factors that are not the same. Bayesian networks is one of a widespread concerned model, it has strong processing capacity to uncertainly problem. Starting from another perspective view, uses Bayesian network model which less affected by Q-matrix as diagnosis classification model. Compares Bayesian network with the D1NA model in cognitive diagnostic classification accuracy on the base of a Q-matrix which contains errors. Bayesian network classification model is less affected by the Q-matrix than D1NA model.
Then, two simulation studies are carried out. The first is to study the performance of DINA and Bayesian network classification model when the Q-matrix contains error items, the data is generated under D1NA model. To be fair, the data generated in the second research doesn't base on any specified models, adopts the method introduced by Leighton, Gierl & Hunka(2004). Investigates the effect of different type of Q-matrix (contains a reachable matrix or not), contain different type of error (contain 0, 5, 7, 10, 13, 15 items which have 0, 1, 2, 3 erred calibrate attributes) during classification in different models. The performance of Bayesian network classification model was superior in many cases than DINA model. When Q matrix contained a reachable matrix and 5(or less) error specified items, the performance of DINA model was slightly better than the Bayesian network classification model; but when Q matrix didn't contained a reachable matrix, or contained more than 5 error specified items, the Bayesian network classification model is better than D1NA model.