The Potential of Computer-Assisted Direct Observation Apps

Abstract

Abstract-Direct behavior observation, i.e., without first creating a video recording, is a challenging, one-shot task. The behavior has to be coded accurately during the situation itself. Mobile devices can assist direct observation, and there already are applications available for these purposes. However, the mobile revolution has led to new developments in devices, infrastructure, and market penetration that have opened up new, yet untapped, possibilities. In this article, expanded activity theory is used to highlight the unused potential of computer assisted direct observation (CADO) apps. If this potential is realized, it can provide observation with the same advantages online questionnaires and sites like Mechanical Turk have provided for surveys and Internet experiments.

Comparing Coding Viewing and Recording Methods to Quantify Embedded Instruction Learning Trials

“…Recommendations related to selecting and using particular viewing and recording methods have primarily relied on scholars’ experiences and anecdotal observations. From these experiences and observations, strengths and limitations of using various viewing and recording methods have been described or proposed in the literature (e.g., Suen & Ary, 2014; Wessel, 2015; Yoder et al, 2018).…”

Accuracy of paper-and-pencil systematic observation versus computer-aided systems

“…Wessel ( 2015 ) has described the advantages of computer-assisted direct-observation apps, relative to desktop computer-based systems, which may allow for accurate real-time coding of events in vivo. Real-time observation apps are highly accessible via smartphones and simplify the ethical concerns derived from video-based observation.…”

“…In spite of the apparent advantages of computer-aided data collection systems, very little research has empirically evaluated their impact on the accuracy of the data collection process (Jackson & Dixon, 2007;Kahng & Iwata, 1998;Tarbox et al, 2010). Wessel (2015) has described the advantages of computerassisted direct-observation apps, relative to desktop computer-based systems, which may allow for accurate real-time coding of events in vivo. Real-time observation apps are highly accessible via smartphones and simplify the ethical concerns derived from video-based observation.…”