Residential College | false |
Status | 已發表Published |
Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening | |
Liao, Linyu; Yao, Don | |
2021-11-25 | |
Source Publication | Frontiers in Psychology |
ABS Journal Level | 1 |
ISSN | 1664-1078 |
Volume | 12Pages:767244 |
Abstract | Differential Item Functioning (DIF) analysis is always an indispensable methodology for detecting item and test bias in the arena of language testing. This study investigated grade-related DIF in the General English Proficiency Test-Kids (GEPT-Kids) listening section. Quantitative data were test scores collected from 791 test takers (Grade 5 = 398; Grade 6 = 393) from eight Chinese-speaking cities, and qualitative data were expert judgments collected from two primary school English teachers in Guangdong province. Two R packages “difR” and “difNLR” were used to perform five types of DIF analysis (two-parameter item response theory [2PL IRT] based Lord’s chi-square and Raju’s area tests, Mantel-Haenszel [MH], logistic regression [LR], and nonlinear regression [NLR] DIF methods) on the test scores, which altogether identified 16 DIF items. ShinyItemAnalysis package was employed to draw item characteristic curves (ICCs) for the 16 items in RStudio, which presented four different types of DIF effect. Besides, two experts identified reasons or sources for the DIF effect of four items. The study, therefore, may shed some light on the sustainable development of test fairness in the field of language testing: methodologically, a mixed-methods sequential explanatory design was adopted to guide further test fairness research using flexible methods to achieve research purposes; practically, the result indicates that DIF analysis does not necessarily imply bias. Instead, it only serves as an alarm that calls test developers’ attention to further examine the appropriateness of test items. |
Keyword | Grade Dif Gept-kids Listening Mixed-methods Approach |
DOI | 10.3389/fpsyg.2021.767244 |
URL | View the original |
Indexed By | SSCI |
Language | 英語English |
WOS Research Area | Psychology |
WOS Subject | Psychology, Multidisciplinary |
WOS ID | WOS:000728817600001 |
Publisher | FRONTIERS MEDIA SA, AVENUE DU TRIBUNAL FEDERAL 34, LAUSANNE CH-1015, SWITZERLAND |
Scopus ID | 2-s2.0-85120954973 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF ENGLISH |
Affiliation | Department of English, University of Macau, Macao |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Liao, Linyu,Yao, Don. Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening[J]. Frontiers in Psychology, 2021, 12, 767244. |
APA | Liao, Linyu., & Yao, Don (2021). Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening. Frontiers in Psychology, 12, 767244. |
MLA | Liao, Linyu,et al."Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening".Frontiers in Psychology 12(2021):767244. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment