The Validity and Reliability of Five-Tier Conception Diagnostic Test for Vector Concepts

Abstract

Abstract
 Misconceptions has commonly found in Physics concepts, including in Vector concepts. For example, students assumed when an object moves at a certain path and returns to the original position using different path, the displacement is not zero. Meanwhile, according to the Vector concept, the object displacement is zero when it moves and returns to the original position. This discrepancy is called misconception. Such misconception needs to be identified. One of them is by multi-tiers conception diagnostic test. This study was aimed to develop a five-tier conception diagnostic test for Vector concepts and determine the validity (both internal and external aspects) and the reliability. Two groups of students were involved in this work: 25 students to collect common reasons (three-tier questions) and 65 students to calculate the validity and reliability scores. The internal validity was justified by two pointed lecturers at Physics Dept. UNESA. The external validity contains content and construct aspects. The content aspect was determined based on false positive (FP) and false negative (FN) scores, each should be <10%. The construct aspect was calculated by the Pearson’s product-moment correlation. The reliability was determined using Alpha Cronbach with = 0.244 and 5% significance level. The internal validity score = 95%, the FP and FN scores = 3.5 and 9.0% respectively which means that the developed instrument is valid. The = 0.656 and = 0.898 which are > rtheoritic. Therefore, the developed instrument is valid and reliable to diagnoses student’s conception on the Vector concepts.
 Keywords: Vector concepts, five-tier conception diagnostic test, validity, reliability
 
 Abstrak
 Miskonsepsi, secara umum, banyak ditemukan pada konsep Fisika, termasuk pada konsep-konsep Vektor. Sebagai contoh, peserta didik (PD) menganggap apabila suatu benda bergerak pada lintasan tertentu dan kembali pada posisi semula melalui lintasan lain, maka perpindahan tersebut tidak nol. Sementara menurut konsep Vektor, perpindahan suatu benda dikatakan nol apabila benda tersebut bergerak dan kemudian kembali pada posisi semula. Perbedaan keduanya disebut miskonsepsi. Miskonsepsi seperti itu perlu diidentifikasi. Salah satunya adalah dengan tes diagnostik konsepsi multi-tier. Penelitian ini ditujukan untuk mengembangkan sebuah tes diagnostik konsepsi berformat five-tier untuk konsep Vektor dan menentukan tingkat validitas dan reliabilitasnya. Dua kelompok PD dilibatkan dalam pekerjaan ini, yaitu 25 PD untuk menjaring alasan yang umum dikemukakan oleh siswa (pertanyaan three-tier) dan 65 PD untuk menghitung skor validitas (baik aspek internal maupun eksternal) dan reliabilitas tes tersebut. Validitas internal diuji oleh dua dosen Jurusan Fisika UNESA yang ditunjuk. Validitas eksternal terdiri dari aspek konten dan konstruk. Aspek konten ditentukan berdasarkan skor false positive (FP) dan false negative (FN), dimana tiap skor tersebut harus <10%. Aspek konstruk dihitung dengan persamaan korelasi Pearson Product Moment . Reliabilitas ditentukan menggunakan Alpha Cronbach dengan = 0.244 dan taraf signifikasi 5%. Skor validitas internal = 95%, skor FP dan FN masing-masing = 3.5 dan 9.0% yang berarti bahwa instrumen yang telah dikembangkan ini valid. Nilai = 0.656 dan = 0.898 yang nilainya > rteori. Karena itu, instrumen ini valid dan reliabel untuk dipergunakan untuk mendiagnosis konsepsi PD pada konsep-konsep Vektor.
 Kata kunci: Konsep-konsep Vektor, five-tier diagnostic test, validitas, reliabilitas

The Five-Tier Multiple Choice Instruments in Parabolic Motion for Assessing Concept Understanding of High School Students

“…Therefore, the five-tier multiple choice instrument The parabolic motion produced in this study is valid, so it is feasible to use it to assess the concept understanding of SMA/MA students. The research result was in line with research conducted by [23] who also developed a five-tier multiple choice instrument on vector. The research result shown that the instrument developed is externally valid and reliable.…”

“…Because the four-tier multiple choice instrument is limited to the reasons for choosing the answer, It is important to create a five-tier system that includes confirmation of student answers in the shape of picture commands, equations, and also conclusions [22]. Currently, many fivetier multiple choice instruments have been developed in learning of physics, one of which is done by [23], which results in a five-tier multiple choice instrument on vector. Through the five-tier, it is possible to assess the understanding of the concept more [24].…”

The Effectiveness of The Six Tier Diagnostic Test (STDT) Instrument in Viewed from Empirical Validity to Identify Student's Misconceptions in Chemical Equilibrium Materials

“…Diagnostic tests determine weaknesses in students' understanding of a concept (Anam, 2019;Prodjosantoso, 2019). An excellent diagnostic test can provide an accurate picture of the misconceptions experienced by students based on the error information they make (Bayuni, 2018;Maharani, 2019;Qonita & Ermawati, 2020). Good diagnostic questions not only show that students do not understand certain parts of the material but can also show how students think in answering the questions given, even though the answers are not correct (Setiawan, 2020;Sari, 2020;Timothy, 2023).…”

Development of Google Form-Based Five-Tier E-Diagnostic Test to Identify Conception Levels and Track Students' Misconceptions on Thermodynamics Materials

“…The third and fourth-tiers, contain the respondent's reasons/arguments for the answers given in tier-2 and the respondent's beliefs on the choice of these reasons/arguments. The fifth tier is the respondent's open answer, and it can be in the form of a figure or statement that supports the answer in each tier, as well as a form of expression of knowledge and confirmation of the respondent (Qonita & Ermawati, 2020).…”