At a first glance – How reliable and valid is the thin slices technique to assess instructional quality?

Begrich, Lukas; Kuger, Susanne; Klieme, Eckhard; Kunter, Mareike

doi:10.1016/j.learninstruc.2021.101466

Cited by 7 publications

(15 citation statements)

References 80 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Multilevel confirmatory factor analysis confirmed the theoretically expected three factors, indicating that the raters were able to distinguish between different aspects of instructional quality (Begrich et al, 2021). Thin slices ratings and the ratings given by trained raters based on the full-length classroom videos correlated significantly (r up to 0.52), indicating evidence of convergent validity (Begrich et al, 2021). Further, thin slices ratings predicted how much students learned from different teachers, even when students' prerequisites were controlled (Begrich et al, 2020).…”

Section: The Thin Slices Techniquementioning

confidence: 63%

“…In all studies, interrater reliability was good or even excellent, with intraclass correlation coefficients reaching up to 0.98 (Begrich et al, 2020). Multilevel confirmatory factor analysis confirmed the theoretically expected three factors, indicating that the raters were able to distinguish between different aspects of instructional quality (Begrich et al, 2021). Thin slices ratings and the ratings given by trained raters based on the full-length classroom videos correlated significantly (r up to 0.52), indicating evidence of convergent validity (Begrich et al, 2021).…”

Section: The Thin Slices Techniquementioning

confidence: 67%

“…In particular, positive associations were found between thin slices ratings and student ratings while the teachers were displaying disciplinary actions or interacting with students (Babad et al, 2003). Begrich et al (2017Begrich et al ( , 2020Begrich et al ( , 2021 applied the thin slices technique to assess instructional quality at school based on 30-s classroom videos. Instructional quality was operationalized with three basic dimensions of instructional quality (e.g., Klieme, 2006;Praetorius et al, 2018).…”

Section: The Thin Slices Techniquementioning

confidence: 99%

“…Since untrained thin slices raters were able to accurately assess teaching quality at schools (Begrich et al, 2017(Begrich et al, , 2020(Begrich et al, , 2021, the present study intends to examine the accuracy of highly trained thin slices raters in the ECEC context. Based on previous research results (Sokolovic et al, 2021), we assume that highly trained thin slices raters yield psychometrically accurate results, implying that highly trained experts may serve as conventional raters as well as thin slices raters.…”

Section: Aims Of the Studymentioning

confidence: 99%

“…In a multitude of research areas (e.g., clinical psychology, personality psychology or education), the thin slices technique yielded intriguingly accurate results (e.g., Wood, 2014;Murphy and Hall, 2021). Begrich et al (2017Begrich et al ( , 2020Begrich et al ( , 2021 demonstrated that teaching quality at school can be accurately measured with 30-s classroom videos. Sokolovic et al (2021) demonstrated that, under certain conditions, children's outcomes can be predicted with the thin slices technique in ECEC settings.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Using the thin slices technique to assess interactional quality in early childhood education and care settings

Vinokic,

Baron,

Kunter

et al. 2024

Front. Educ.

Self Cite

View full text Add to dashboard Cite

There are a variety of instruments for measuring interaction quality of Early Childhood Education and Care (ECEC) teachers. However, these instruments are extremely resource-demanding in terms of time and money. Hence, a more economical and yet accurate method for measuring interaction quality of ECEC teachers would be desirable. The so-called thin slices technique has been applied to observe, measure and predict human behavior with only minimal amounts of information. In a wide array of research domains, thin slices ratings (i.e., ratings based on first impressions) proved to be accurate. The present study explores the accuracy of thin slices ratings of interaction quality in toddler classrooms along two CLASS Toddler domains (Emotional and Behavioral Support and Engaged Support for Learning). Eight CLASS-certified raters assessed interaction quality based on 30-s classroom videos. The findings suggest predominantly good reliabilities of these ratings. Confirmatory factor analysis yielded evidence for construct validity, meaning that thin slices raters could differentiate between two domains of interaction quality. Further, thin slices ratings correlated, at least partly, with ratings based on full-length videos, indicating that thin slices raters and raters watching the full-length videos had a similar impression of interaction quality of ECEC teachers.

show abstract

Section: The Thin Slices Techniquementioning

confidence: 63%