Classical Test Theory and Item Response Theory

DeMars, Christine E.

doi:10.1002/9781118489772.ch2

Cited by 28 publications

(20 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…First, participants were assigned to either the high- or low-score group according to their scores on each subscale or listening task. The high-score groups contained participants with a percentile rank greater than 73, whereas participants who scored lower than 27th percentile were classified as low-score groups (DeMars, 2018, p. 59). Subsequently, we investigated the differences in scores of the Gold-MSI subscales, the Melody Memory Task and the Beat Alignment Perception Task between high- and low-score groups by a series of t -test.…”

Section: Resultsmentioning

confidence: 99%

The Chinese version of the Gold-MSI: Adaptation and validation of an inventory for the measurement of musical sophistication in a Taiwanese sample

Lin¹,

Kopiez

Müllensiefen

et al. 2019

Musicae Scientiae

View full text Add to dashboard Cite

This study presents the Chinese adaptation of the Goldsmiths Musical Sophistication Index (Gold-MSI), an instrument for measuring individual differences in musical ability and skilled musical behaviour. Its psychometric properties were examined with a Taiwanese sample. The Gold-MSI inventory was translated into Chinese following recommendations from the literature on cross-cultural test development. Subsequently, the psychometric properties of the Chinese Gold-MSI self-report inventory, including the Melody Memory Task and the Beat Alignment Perception Task, were evaluated using an online survey with 1,065 participants. Results of confirmatory factor analysis suggest that the original factor structure of the Gold-MSI inventory showed an acceptable fit with the data from the Chinese-speaking sample. In addition, the Chinese Gold-MSI inventory shows good reliability. The Melody Memory Task and the Beat Alignment Perception Task also have sufficient test-retest reliability. Finally, correlations between the Chinese Gold-MSI inventory and the Musical-Rhythmic Intelligence subscale of the Eight Multiple Intelligences Questionnaire as well as the two additional music tests provide evidence for convergent and divergent validity. Overall, the data suggest that the Chinese Gold-MSI has good psychometric properties. Percentile norms for the Gold-MSI inventory and the music tests from the present sample are reported for use in future studies. The present study thus makes a valuable contribution to cross-cultural research in music psychology by enabling the comparison between Chinese and Western studies of individual differences in musical ability.

show abstract

Section: Resultsmentioning

confidence: 99%

The Chinese version of the Gold-MSI: Adaptation and validation of an inventory for the measurement of musical sophistication in a Taiwanese sample

Lin¹,

Kopiez

Müllensiefen

et al. 2019

Musicae Scientiae

View full text Add to dashboard Cite

show abstract

“…Sebagai upaya mengatasi kelemahan pendekatan teori tes klasik, berkembanglah pendekatan baru yaitu item response theory. Pendekatan ini hadir dengan mengusung tiga asumsi yaitu unidimensi, independensi lokal, dan invariansi parameter (DeMars, 2018). Asumsi tersebut merupakan jawaban atas kelemahan teori tes klasik, sehingga hasil pengukuran tidak lagi bergantung pada karakteristik butir soal yang diujikan karena pengukuran kemampuan didasari oleh peluang peserta tes dalam menjawab butir soal.…”

Section: Pendahuluanunclassified

“…Naga (1992) menyebutkan bahwa independensi lokal merupakan asumsi yang mensyaratkan skor butir suatu tes tidak bergantung pada butir lainnya. Asumsi independensi lokal akan terpenuhi apabila suatu tes terbukti bersifat unidimensi (DeMars, 2018;Santoso et al, 2019). Dengan demikian, soal PAS bahasa Arab MAN 1 Pangkalpinang memenuhi asumsi independensi lokal karena telah terbukti bersifat unidimensi.…”

Section: Asumsi Unidimensi Dan Independensi Lokalunclassified

“…Terdapat 33 butir (82,5%) memiliki indeks kesukaran berkategori baik dan 7 butir (17,5%) berkategori kurang baik karena memiliki tingkat kesukaran berkategori sangat mudah sehingga perlu direvisi/diperbaiki, yaitu butir nomor 10, 26, 27, 29, 32, 34, dan 35. Tingkat kesukaran butir yang baik di rentang -2 sampai dengan +2 dalam skala logit (DeMars, 2018;Hambleton & Swaminathan, 1985;Mardapi, 1998;Sumintono & Widhiarso, 2015). Sedangkan butir yang memiliki indeks kesukaran diluar rentang tersebut dapat diperbaiki atau dieliminasi (Heri Retnawati, 2014).…”

Section: Karakteristik Butir Soalunclassified

See 1 more Smart Citation

Item Response Theory Approach: Kalibrasi Butir Soal Penilaian Akhir Semester Mata Pelajaran Bahasa Arab

Danni¹,

Wahyuni

Tauratiya³

2021

AJAS

View full text Add to dashboard Cite

This study describes the item details of the final semester questions in Arabic MAN 1 Pangkalpinang using the item response theory approach. The problem behind this research is that the development of Arabic final assessment items did not go through the correct stages. Therefore, this research is quantitative research. The subjects of this study were 176 students of class XI MAN 1 Pangkalpinang. The answer data is in the form of answers to questions in the final semester in Arabic which are 40 multiple-choice items with five answers. The results showed that the final results of the Arabic semester (1) proved valid, indicated by 40 items (100%) with loading factors; (2) proven to be reliable, indicated by the reliability coefficient of 0.884; (3) there are 33 items (82.5%) of the 40 items that have a good level of difficulty and distinguishing power so that they can be stored in the question bank and used in subsequent activities, while 7 items (17.5%) are item number 10, 26, 27, 29, 32, 34, and 35 do not meet the criteria for a good level of difficulty so they need to be revised or eliminated; and (4) suitable for use in students with low to moderate ability (θ) in the range -3.5 to +1.5 in logit. Future research is expected to be able to analyze Arabic language question items in the form of descriptive tests on a large scale or develop high-quality high-order thinking skills in Arabic.

show abstract

“…Responses from the pilot sample (n = 268) to the 50 original items were analysed to select those most useful for the final survey. In psychometrically designed tests, items should: a) have a suitable range of difficulty, and b) correlate positively to the total test score, i.e., item discrimination (DeMars, 2017). Firstly, items were discarded if more than 88% of the sample answered correctly.…”

Section: Pilot Testmentioning

confidence: 99%

Knowing and doing

Nierenberg

Låg

Dahl

2021

JIL

View full text Add to dashboard Cite

This study touches upon three major themes in the field of information literacy (IL): the assessment of IL, the association between IL knowledge and skills, and the dimensionality of the IL construct. Three quantitative measures were developed and tested with several samples of university students to assess knowledge and skills for core facets of IL. These measures are freely available, applicable across disciplines, and easy to administer. Results indicate they are likely to be reliable and support valid interpretations. By measuring both knowledge and practice, the tools indicated low to moderate correlations between what students know about IL, and what they actually do when evaluating and using sources in authentic, graded assignments. The study is unique in using actual coursework to compare knowing and doing regarding students’ evaluation and use of sources. It provides one of the most thorough documentations of the development and testing of IL assessment measures to date. Results also urge us to ask whether the source-focused components of IL – information seeking, source evaluation and source use – can be considered unidimensional constructs or sets of disparate and more loosely related components, and findings support their heterogeneity.

show abstract

Classical Test Theory and Item Response Theory

Cited by 28 publications

References 41 publications

The Chinese version of the Gold-MSI: Adaptation and validation of an inventory for the measurement of musical sophistication in a Taiwanese sample

The Chinese version of the Gold-MSI: Adaptation and validation of an inventory for the measurement of musical sophistication in a Taiwanese sample

Item Response Theory Approach: Kalibrasi Butir Soal Penilaian Akhir Semester Mata Pelajaran Bahasa Arab

Knowing and doing

Contact Info

Product

Resources

About