CAJ | 학술논문

目的根据首都医学发展科研基金的实际函评结果,对函评立项指标体系进行全面的分析与评价,为进一步完善指标体系提供依据的方式和方法.方法应用克朗巴赫系数、分半信度法、结构方程模型的验证性因子分析、专家评定法的内容效度指数、高低分组法鉴别指数,结合实际函评结果,对指标体系的信度、效度、区分度、合理可行性等分析评价.结果 ①信度:一级指标及指标体系总体的克朗巴赫系数、分半信度均在0.8以上.②校度:指标体系的条目层次分析,标化因子载荷范围在0.57～0.86均大于0.5,路径分析具有统计学意义(t值大于1.96),标准误范围在0.01～0.02,二级指标的路径性能表现良好；模型整体拟合效果的主要拟合指数均达到标准(RMSEA=0.065、NNFI=0.99、IFI=0.99、CFI=0.99、GFI=0.95、AGFI=0.93、X2=1028.21),指标体系结构效度良好.③内容效度:指标体系内容效度指数为0.97(均值S-CVI),一致性好；每项二级指标条目内容与研究目的关联认可的一致性,除“学术思想”的内容效度指数0.57(I-CVI)较低外,其他二级指标的I-CVI均为1.00.④区分度:各二级指标,一级指标、总分的鉴别指数范围在0.51～0.76,均大于0.40,区分度良好.⑤合理可行性:对2007年立项评审项目的指标体系得分分析,中位数为57.67,均值与中位数相近,分布趋近正态分布,符合函审的要求,合理可行.结论首发基金函评立项指标体系的信度、效度、区分度良好,能较好的反应实际情况,合理可行,所应用的方法对分析、评价及完善科研基金函评立项指标体系,具有实际的应用和借鉴价值.
목적 근거수도의학발전과연기금적실제함평결과,대함평립항지표체계진행전면적분석여평개,위진일보완선지표체계제공의거적방식화방법.방법 응용극랑파혁계수、분반신도법、결구방정모형적험증성인자분석、전가평정법적내용효도지수、고저분조법감별지수,결합실제함평결과,대지표체계적신도、효도、구분도、합리가행성등분석평개.결과 ①신도:일급지표급지표체계총체적극랑파혁계수、분반신도균재0.8이상.②교도:지표체계적조목층차분석,표화인자재하범위재0.57～0.86균대우0.5,로경분석구유통계학의의(t치대우1.96),표준오범위재0.01～0.02,이급지표적로경성능표현량호；모형정체의합효과적주요의합지수균체도표준(RMSEA=0.065、NNFI=0.99、IFI=0.99、CFI=0.99、GFI=0.95、AGFI=0.93、X2=1028.21),지표체계결구효도량호.③내용효도:지표체계내용효도지수위0.97(균치S-CVI),일치성호；매항이급지표조목내용여연구목적관련인가적일치성,제“학술사상”적내용효도지수0.57(I-CVI)교저외,기타이급지표적I-CVI균위1.00.④구분도:각이급지표,일급지표、총분적감별지수범위재0.51～0.76,균대우0.40,구분도량호.⑤합리가행성:대2007년립항평심항목적지표체계득분분석,중위수위57.67,균치여중위수상근,분포추근정태분포,부합함심적요구,합리가행.결론 수발기금함평립항지표체계적신도、효도、구분도량호,능교호적반응실제정황,합리가행,소응용적방법대분석、평개급완선과연기금함평립항지표체계,구유실제적응용화차감개치.
Objective The purpose of this study was to evaluate the written project approval Indexes System of Capital Medical Ddevelopment Research Foundation.We analyzed the approval results of application projects and proposed measures to improve the index system.Methods We evaluated its reliability with Cronbach's alpha coefficient,split-half reliability; validity was evaluated with contract validity and content validity,discrimination was studies according to discretion grouping law,and feasibility was studied with the percentage-of-completion method.Results ① Reliability:Cronbach's alpha coefficient of factor and total scores'and split-half reliability were all over 0.80.②Contract validity:the standard factor loading coefficients of the index system were over 0.70 (range:0.57～0.86),indicating path performed well.All factor loading coefficients were statistical significant (T-values were 30.49～54.25,all were over 1.96).Fit Indexes (RMSEA =0.065、NNFI =0.99、IFI =0.99、CFI =0.99、GFI =0.95、AGFI =0.93、X2 =1028.21、X2/DF =11.82) indicated the system's goodness of fit was good.③ Content validity:Scale-level CVI,S-CVI was 0.97 and Interrater agreement was 0.93,over 0.90,which indicated that indexes system's whole Content validity performed well.Except for the item Academic thought item-level CVI being 0.57 all items' item-level CVI were 1.00.④Discrimination:Discrimination index of every primary index,secondary index and total score ranged from 0.51 to 0.76 (all were over 0.40),meaning that discrimination performed extremely well.Conclusion The indexes system's reliability,contract validity,content validity and discrimination conformed to the actual application projects appraisal results.