UM  > Faculty of Arts and Humanities  > DEPARTMENT OF ENGLISH
Residential Collegefalse
Status已發表Published
Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening
Liao, Linyu; Yao, Don
2021-11-25
Source PublicationFrontiers in Psychology
ABS Journal Level1
ISSN1664-1078
Volume12Pages:767244
Abstract

Differential Item Functioning (DIF) analysis is always an indispensable methodology for detecting item and test bias in the arena of language testing. This study investigated grade-related DIF in the General English Proficiency Test-Kids (GEPT-Kids) listening section. Quantitative data were test scores collected from 791 test takers (Grade 5 = 398; Grade 6 = 393) from eight Chinese-speaking cities, and qualitative data were expert judgments collected from two primary school English teachers in Guangdong province. Two R packages “difR” and “difNLR” were used to perform five types of DIF analysis (two-parameter item response theory [2PL IRT] based Lord’s chi-square and Raju’s area tests, Mantel-Haenszel [MH], logistic regression [LR], and nonlinear regression [NLR] DIF methods) on the test scores, which altogether identified 16 DIF items. ShinyItemAnalysis package was employed to draw item characteristic curves (ICCs) for the 16 items in RStudio, which presented four different types of DIF effect. Besides, two experts identified reasons or sources for the DIF effect of four items. The study, therefore, may shed some light on the sustainable development of test fairness in the field of language testing: methodologically, a mixed-methods sequential explanatory design was adopted to guide further test fairness research using flexible methods to achieve research purposes; practically, the result indicates that DIF analysis does not necessarily imply bias. Instead, it only serves as an alarm that calls test developers’ attention to further examine the appropriateness of test items.

KeywordGrade Dif Gept-kids Listening Mixed-methods Approach
DOI10.3389/fpsyg.2021.767244
URLView the original
Indexed BySSCI
Language英語English
WOS Research AreaPsychology
WOS SubjectPsychology, Multidisciplinary
WOS IDWOS:000728817600001
PublisherFRONTIERS MEDIA SA, AVENUE DU TRIBUNAL FEDERAL 34, LAUSANNE CH-1015, SWITZERLAND
Scopus ID2-s2.0-85120954973
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF ENGLISH
AffiliationDepartment of English, University of Macau, Macao
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Liao, Linyu,Yao, Don. Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening[J]. Frontiers in Psychology, 2021, 12, 767244.
APA Liao, Linyu., & Yao, Don (2021). Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening. Frontiers in Psychology, 12, 767244.
MLA Liao, Linyu,et al."Grade-Related Differential Item Functioning in General English Proficiency Test-Kids Listening".Frontiers in Psychology 12(2021):767244.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liao, Linyu]'s Articles
[Yao, Don]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liao, Linyu]'s Articles
[Yao, Don]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liao, Linyu]'s Articles
[Yao, Don]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.