The Application of Item Response Theory in Analysis of Characteristics of Mathematical Literacy Test Items

doi:10.17051/ilkonline.2021.01.119

Cited by 4 publications

(4 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This study used the S-X 2 fit index to determine fit items because they correspond to polytomous items in educational and psychological research (Kang and Chen, 2011). An item is called fit if it has a p.S_X 2 value > 0.05 (Dewanti et al, 2021). to distinguish between individuals with different levels of ability.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Development of Computer-Based Chemical Five-Tier Diagnostic Test Instruments: A Generalized Partial Credit Model

Suparman,

Rohaeti,

Wening

2024

ERIES Journal

View full text Add to dashboard Cite

This study focuses on developing a five-tier chemical diagnostic test based on a computer-based test with 11 assessment categories with an assessment score from 0 to 10. A total of 20 items produced were validated by education experts, material experts, measurement experts, and media experts and obtained an average index of the Aiken test > 0.70. The validation results were tested on 580 respondents and analyzed using the Generalized Partial Credit Model (GPCM) Item Response Theory (IRT) type. The results of the analysis show that all of the items meet the requirements to be said to be valid for the model; the evidence of the value this: RMSEA < 0.08, CFI > 0.87, SRMR < 0.10, GFI > 0.90, NFI > 0.90, NNFI > 0.90, IFI > 0.90, TLI > 0.90, and RFI > 0.90, and all items were obtained has a p.S_X2 value greater than 0.05 which indicates that all items developed are fit and by the GPCM model. The construct reliability (CR) value is 0.99, which suggests the construct is reliable. The most challenging item is item 9, and the most accessible item is item 4

show abstract

Section: Discussionmentioning

confidence: 99%

“…Item fit is an essential consideration in developing and using IRT-basedtests. An item is called fit if it has a p.S_X 2 value > 0.05(Dewanti, Hadi and Nu'man, 2021). The qualified items for the instruments developed using the GPCM model are according to Table6.…”

mentioning

confidence: 99%

Development of Computer-Based Chemical Five-Tier Diagnostic Test Instruments: A Generalized Partial Credit Model

Suparman,

Rohaeti,

Wening

2024

ERIES Journal

View full text Add to dashboard Cite

show abstract

“…The concept of Item Response Theory (IRT) is still rarely used in educational practice in Indonesia. In practice, the most familiar concept used is the Classical Test Theory (CTT) (Dewanti et al, 2021). The IRT concept must be understood by teachers in relation to standardized tests that can be used on a large scale (national) rather than locally.…”

Section: Introductionmentioning

confidence: 99%

“…Two conditions of invariance that must be met are (1) item parameters should not be influenced by participants' abilities, and (2) participants' abilities should not be influenced by item parameters (Retnawati, 2014). Both of these conditions cannot be met by the CTT model (Dewanti et al, 2021). Invariance property becomes an assumption that must be met when using IRT for instrument calibration (Nguyen et al, 2014;Retnawati, 2014).…”

Section: Introductionmentioning

confidence: 99%

Kalibrasi Instrumen Literasi Matematika Siswa Menggunakan IRT dan Aplikasinya untuk Estimasi Skor

Susanto,

Retnawati

2023

Universitas Jambi

View full text Add to dashboard Cite

Literasi matematika merupakan salah satu komponen yang menjadi perhatian pada Assesmen Kompetensi Minimum (AKM). Kebijakan ini sebagai upaya Kemendikbud untuk mengatasi rendahnya kemampuan literasi siswa, dan faktor-faktor penyebabnya. Multistage Adaptive Test (MSAT) digunakan sebagai metode penilaian pada AKM. MSAT dikembangkan dengan konsep IRT. Tujuan dari artikel ini yaitu mengaplikasikan Item Respons Theory (IRT) untuk kalibrasi instrumen literasi matematika, dan memanfaatkan parameter butir hasil kalibrasi untuk estimasi skor kemampuan literasi matemtika. Banyak butir pada instrumen yang digunakan yaitu 15 butir pilihan ganda. Responden yang digunakan sebanyak 65 siswa SMP kelas 8. Setelah melalui proses validtias konstruk menggunakan Confirmatory Factor Analysis (CFA) 2 butir tidak memenuhi, karena memiliki faktor loading yang rendah dan 13 butir digunakan untuk proses kalibrasi. Proses kalibrasi butir dan penskroan dilakukan dengan program R package mirt. Hasil kalibrasi menunjukan bahwa instrumen cocok dengan model Rasch. Semua asumsi IRT unidimensi terbukti terpenuhi, sehingga tidak ada pelanggaran dalam mengestimasi parameter butir. Parameter butir berupa tingkat kesulitan dimana terdapat satu butir tidak fit yaitu butir ke-3. Perpotongan fungsi informasi dan standar error menunjukkan instrumen akan meberikan informasi yang akurat, jika digunakan siswa dengan kemampuan -2.965 sampai 1.085. Parameter butir yang dihasilakan dapat digunakan untuk estimasi skor kemampuan literasi matematika konten aljabar.

show abstract

Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis

Nu’man¹,

Retnawati²,

Sugiman³

et al. 2021

EUROPEAN J ED RES

View full text Add to dashboard Cite

<p style="text-align: justify;">Within the context of Self-Regulated Learning (SRL), a process of directing oneself to facilitate individual learning more effectively, the SRL instrument development is deemed necessary to measure students’ self-reliance in learning mathematics in the science, technology, engineering, and mathematics (STEM) framework. The research aims to develop and test the validity and reliability of an SRL instrument, namely a 14-item SRL questionnaire accommodating four aspects, namely planning, self-monitoring, self-controlling, and evaluation. The study involved 420 junior high school students in East Java, Central Java, and Yogyakarta Special Region. The results show that the questionnaire was developed as planned and that planning, monitoring, controlling, and evaluating aspects can reflect the SRL variable in a valid, reliable, and significant way supported by each aspect's behavior indicator. The SRL variable theoretical model corresponds (good fit) with the empirical data, and all of the items are likely valid and reliable to assess student's mathematics SRL in the STEM framework. The SRL questionnaire was also found suitable for use by teachers to measure junior high school students’ self-reliance in SRL.</p>

show abstract

The Application of Item Response Theory in Analysis of Characteristics of Mathematical Literacy Test Items

Cited by 4 publications

References 27 publications

Development of Computer-Based Chemical Five-Tier Diagnostic Test Instruments: A Generalized Partial Credit Model

Development of Computer-Based Chemical Five-Tier Diagnostic Test Instruments: A Generalized Partial Credit Model

Kalibrasi Instrumen Literasi Matematika Siswa Menggunakan IRT dan Aplikasinya untuk Estimasi Skor

Measuring Self-Regulated Learning in the STEM Framework: A Confirmatory Factor Analysis

Contact Info

Product

Resources

About