Visual Observation Techniques

Carins, Julia

doi:10.1007/978-981-10-1829-9_7

Cited by 2 publications

(1 citation statement)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Others use observations in a diverse range of non-educational settings such as evaluating the effectiveness of assistive technology for dementia patients (Nolan et al, 2002), the quality of parent-child interactions (Gardner, 2000), and consumer behavior (Carins, 2016). Teachers use direct observations to assess student skills, performance, and understanding as an alternative form of testing (Mertler, 2016).…”

mentioning

confidence: 99%

When Seeing Is Believing: Generalizability and Decision Studies for Observational Data in Evaluation and Research on Teaching

Weston

Hayward

Laursen

2021

American Journal of Evaluation

View full text Add to dashboard Cite

Observations are widely used in research and evaluation to characterize teaching and learning activities. Because conducting observations is typically resource intensive, it is important that inferences from observation data are made confidently. While attention focuses on interrater reliability, the reliability of a single-class measure over the course of a semester receives less attention. We examined the use and limitations of observation for evaluating teaching practices, and how many observations are needed during a typical course to make confident inferences about teaching practices. We conducted two studies based on generalizability theory to calculate reliabilities given class-to-class variation in teaching over a semester. Eleven observations of class periods over the length of a semester were needed to achieve a reliable measure, many more than the one to four class periods typically observed in the literature. Findings suggest practitioners may need to devote more resources than anticipated to achieve reliable measures and comparisons.

show abstract

mentioning

confidence: 99%