Using ACER ConQuest program to examine multidimensional and many-facet models

Koyuncu, Mahmut Sami; Şata, Mehmet

doi:10.21449/ijate.1238248

Cited by 1 publication

(1 citation statement)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is recommended that future studies and researchers working in this field should examine the role of time in the evaluation of multidimensional constructs. The availability of statistical package programs used in the measurement of multidimensional constructs makes this possible (Koyuncu & Sata 2023).…”

Section: Discussion Conclusion and Recommendationsmentioning

confidence: 99%

The Role of Time on Performance Assessment (Self, Peer and Teacher) in Higher Education: Rater Drift

ŞEVGİN,

ŞATA

2023

Participatory Educational Research

Self Cite

View full text Add to dashboard Cite

This study aimed to investigate the change in teacher candidates' oral presentation skills over time through self, peer, and teacher assessments using the rater drift method. A longitudinal descriptive research model was used as a quantitative research approach to achieve this aim. The study group consisted of 47 teacher candidates receiving formation education at a state university in the Eastern Anatolia Region and an instructor teaching the course. An analytical rubric was used as a data collection tool to evaluate the candidates' oral presentation skills. The data collection process lasted six weeks in total. Since the performance evaluation process aimed to examine the change over time, the many-facet Rasch model was used. When the findings of the study were examined, it was determined that the rater behavior of teacher candidates had statistically significant differences at the group level over time. It was found that 26 out of 48 peer raters had rater drift in their evaluations. It was also found that the majority of rater drift over time was positive, meaning that evaluators became more generous over time. Another result obtained in the study was that teacher assessment did not show rater drift over time, with similar ratings for six weeks. The study’s findings were discussed with previous studies in the literature, and recommendations were made to researchers.

show abstract

Section: Discussion Conclusion and Recommendationsmentioning

confidence: 99%