Investigating the Invariance of Person Parameter Estimates Based on Classical Test and Item Response Theories

Adedoyin, Omobola O

doi:10.1080/09751122.2010.11889987

Cited by 13 publications

(16 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These results were found to be consistent with other finding of Marie (2004). The foregoing results resemble that of previous studies (Adedoyin, Nenty, & Chilisa, 2008;Nukhet, 2002;Fan, 1998). However, the difference lies in the choice of a two-parameter or three-parameter.…”

Section: Discussionsupporting

confidence: 78%

See 1 more Smart Citation

Comparative Analysis of Classical Test Theory and Item Response Theory Based Item Parameter Estimates of Senior School Certificate Mathematics Examination

Awopeju

Afolabi

2016

ESJ

View full text Add to dashboard Cite

The study compared Classical Test Theory (CTT) and Item Response Theory (IRT)-estimated item difficulty and item discrimination indices in relation to the ability of examinees in Senior School Certificate Examination (SSCE) in Mathematics with a view to providing empirical basis for informed decisions on the appropriateness of statistical and psychometric tests. The study adopted ex-post-facto design. A sample of 6,000 students was selected from the population of 35,262 students who sat for the NECO SSCE Mathematics Paper 1 in 2008 in Osun State, Nigeria. An instrument consisting of 60-multiple-choice items, May/June 2008 NECO SSCE Mathematics Paper 1 was used. Three sampling plans: random, gender and ability sampling plans were employed to study the behaviours of the examinees scores under the CTT and IRT measurement frameworks. BILOG-MG 3 was used to estimate the indices of item parameters and SPSS 20 was used to compare CTT- and IRT-based item parameters. The results showed that CTT-based item difficulty estimates and oneparameter IRT item difficulty estimates were comparable (the correlations were generally in the -0.702 to -0.988 range in large sample and -0.622 to - 0.989 range in small sample). Results also indicated that CTT-based and two-parameter IRT-based item discrimination estimates were comparable (the correlations were in the 0.430 to 0.880 ranges in large sample and 0.531 to 0.950 range in small sample). The study concluded that CTT and IRT were comparable in estimating item characteristics of statistical and psychometric tests and thus could be used as complementary procedures in the development of national examinations

show abstract

Section: Discussionsupporting

confidence: 78%

“…Some studies linking CTT and IRT item characteristics have shown signs of positive indications of a relationship that exist between them (Adedoyin, Nenty & Chilisa, 2008;Nukhet, 2002;Fan, 1998). Royce (2009) discovered that 2-parameter IRT model closely resembles CTT of the verbal and non-verbal test in terms of item characteristics.…”

Section: Introductionmentioning

confidence: 99%

Comparative Analysis of Classical Test Theory and Item Response Theory Based Item Parameter Estimates of Senior School Certificate Mathematics Examination

Awopeju

Afolabi

2016

ESJ

View full text Add to dashboard Cite

show abstract

“…Based on this premise, many researchers have empirically assessed the comparability of IRT and CTT item parameters using different data sets. Some of them include: Fan (1998); Adedoyin, Nenty and Chilisa (2008); Nukhet (2002); Courville (2005) ;MacDonald and Paunonen (2002) and Metibemu (2016). They found that both CTT and IRT statistics were very comparable.…”

Section: Introductionmentioning

confidence: 99%

An Assessment of Item Statistics Estimates of Basic Education Certificate Examination through Classical Test Theory and Item Response Theory approach

Ayanwale¹,

Adeleke²,

Mamadelo³

2018

International Journal of Educational Research Review

View full text Add to dashboard Cite

In this study, the researchers assessed comparability of item statistics of 2017 basic education certific ate mathematics examination of National Examinations Council (NECO) through Classical Test Theory (CTT) and Item Response Theory (IRT) measurement frameworks. The study adopted instrumentation design. A 60-item NECO basic education certificate education mathematics objective test paper I was administered to 978 bas ic nine examinees, randomly selected from Osogbo and Olorunda Local Government Area, Osun S tate, Nigeria. The responses of the examinees to the test data were analysed using Marginal Maximum Likelihood Estimation of JMETRIK software. The result showed that the test data obey the assumption of unidimensionality of 3parameter logistic model and Classical Test Theory measurement framework deleted more items 33 (55%) compare to IRT measurement framework 12 (20%). Also, it was observed that item statistics fro m the two contrasting frameworks (CTT and IRT) were not comparable. Moreover, further analysis showed that there was low c orrelation among the item statistics index. The implication of this is that NECO should jettison the use of Classical Test Theory and embrace utilization of Item Response Theory framework during their test development and item analysis.

show abstract

“…3. Finally, while in CTT ability levels for items and person tend to change depending on format of the test and sample, in IRT ability levels for both items and person will be invariant across different test formats and different samples (Abedalaziz & Leng, 2013;Adedoyin, Nenty, & Chilisa, 2008).…”

Section: The New Ecological Paradigm (Nep-r)mentioning

confidence: 99%

Propriedades psicométricas da versão brasileira da escala de novo paradigma ecológico: revisada

et al. 2016

View full text Add to dashboard Cite

The New Ecological Paradigm (NEP-R) is one of the hallmarks for the measurement of ecological attitudes. Attention has been given to its psychometric properties during the last ten years, but no analyses have been conducted until now using an Item Response Theory (IRT) approach. With this purpose, a sample of 410 recruited responders answered the NEP-R's 15 items in Brazilian Portuguese. An item analysis was conducted considering: dimensionality; reliability; discrimination; item information; and item/person hierarchy. The results for the principal component analysis of standardized residues supports a unidimensional structure. Results for item fi t coeffi cients (INFIT and OUTFIT) indicate that the items have good predictive power for the response patterns in the latent trait continuum representing ecocentrism. In turn, the results for person discrimination and item hierarchy point out that the scale is restricted as to the levels of diffi culty it represents. The fi ndings include that the most revealing items for environmental attitudes in a Brazilian sample consist of the set of items representing the "limits of growth" facet.

show abstract

Investigating the Invariance of Person Parameter Estimates Based on Classical Test and Item Response Theories

Cited by 13 publications

References 2 publications

Comparative Analysis of Classical Test Theory and Item Response Theory Based Item Parameter Estimates of Senior School Certificate Mathematics Examination

Comparative Analysis of Classical Test Theory and Item Response Theory Based Item Parameter Estimates of Senior School Certificate Mathematics Examination

An Assessment of Item Statistics Estimates of Basic Education Certificate Examination through Classical Test Theory and Item Response Theory approach

Propriedades psicométricas da versão brasileira da escala de novo paradigma ecológico: revisada

Contact Info

Product

Resources

About