Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests

dc.authoridSAHIN, ALPER/0000-0001-7750-4408
dc.contributor.authorSahin, Alper
dc.contributor.authorOzbasi, Durmus
dc.date.accessioned2025-01-27T20:24:20Z
dc.date.available2025-01-27T20:24:20Z
dc.date.issued2017
dc.departmentÇanakkale Onsekiz Mart Üniversitesi
dc.description.abstractPurpose: This study aims to reveal effects of content balancing and item selection method on ability estimation in computerized adaptive tests by comparing Fisher's maximum information (FMI) and likelihood weighted information (LWI) methods. Research Methods: Four groups of examinees (250, 500, 750, 1000) and a bank of 500 items with 10 different content domains were generated through Monte Carlo simulations. Examinee ability was estimated by fixing all settings except for the item selection methods mentioned. True and estimated ability (theta) values were compared by dividing examinees into six subgroups. Moreover, the average number of items used was compared. Findings: The correlations decreased steadily as examinee theta level increased among all examinee groups when LWI was used. FMI had the same trend with the 250 and 500 examinees. Correlations for 750 examinees decreased as. level increased as well, but they were somewhat steady with FMI. For 1000 examinees, FMI was not successful in estimating examinee. accurately after. subgroup 4. Moreover, when FMI was used,. estimates had less error than LWI. The figures regarding the average items used indicated that LWI used fewer items in subgroups 1, 2, 3 and that FMI used less items in subgroups 4, 5, and 6. Implications for Research and Practice: The findings indicated that when content balancing is put into use, LWI is more suitable to estimate examinee theta for examinees between -3 and 0 and that FMI is more stable when examinee. is above 0. An item selection algorithm combining these two item selection methods is recommended. (C) 2017 Ani Publishing Ltd. All rights reserved
dc.identifier.doi10.14689/ejer.2017.69.2
dc.identifier.endpage36
dc.identifier.issn1302-597X
dc.identifier.issue69
dc.identifier.scopus2-s2.0-85021703119
dc.identifier.scopusqualityQ3
dc.identifier.startpage21
dc.identifier.trdizinid262035
dc.identifier.urihttps://doi.org/10.14689/ejer.2017.69.2
dc.identifier.urihttps://search.trdizin.gov.tr/tr/yayin/detay/262035
dc.identifier.urihttps://hdl.handle.net/20.500.12428/22161
dc.identifier.wosWOS:000416647400002
dc.identifier.wosqualityN/A
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.indekslendigikaynakTR-Dizin
dc.language.isoen
dc.publisherAni Yayincilik
dc.relation.ispartofEurasian Journal of Educational Research
dc.relation.publicationcategoryinfo:eu-repo/semantics/openAccess
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_WoS_20250125
dc.subjectlikelihood weighted information fisher's maximum information Estimation accuracy
dc.titleEffects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests
dc.title.alternativeBilgisayar ortamında bireye uyarlanmış testlerde içerik dengeleme ve madde seçme yönteminin yetenek düzeyi kestirimine etkileri
dc.typeArticle

Dosyalar