Reading behavior and the effect of embedded selfies in role-playing picture e-books: An eye-tracking investigation

Abstract

Digital and interactive media platforms, such as e-books, are becoming important tools in reading and education. In particular, picture e-books can embed multimedia effects such as sound, animation or personalized images, with potential benefits for learning and engagement. However, little is known about how such e-books are read, and most designs remain untested. In this study, an innovative type of role-playing picture e-book entitled "The Prank in the Forest" was designed which provides three different role-playing approaches: emotive selfies that allow the reader to appear as one of the main characters and were varied according to the story development, a fixed selfie that was the same on each page, or no selfie. Sixty-five students were randomly assigned to the emotive selfie, fixed selfie, and no selfie groups. To understand students' online reading processes, their eye movements were tracked. The results showed that the emotive selfies attracted attention to the main character and also promoted scanning between text and pictures, indicating a better integration of the written and pictorial information. The selfie design led to distinct scanpaths, and this was particularly true when emotive selfies were embedded which responded to the context. Self-report questionnaires of reading motivation and engagement demonstrated that this condition was also the most engaging design for readers. We conclude that emotive selfies can boost reading engagement since they encourage the reader to observe the development of the story from the role he/she chose to play, and we discuss how embodying the reader within the graphics can enhance role-play activities with the potential for improved educational outcomes. We suggest this emotive selfie role-playing design could be applied in e-book user interfaces to create more interaction and personal meaning for the readers.

AI and robotics in reshaping the dynamics of learning

“…AI has achieved good results in the education field, which include providing better learning experiences (Dede, Grotzer, Kamarainen, & Metcalf, 2017;Koć-Januchta, Schönborn, Tibell, Chaudhri, & Heller, 2020), reducing teachers' workload (Mavrikis, Geraniou, & Poulovassilis, 2019;Westera, Dascalu, Kurvers, Ruseti, & Trausan-Matu, 2018), and offering timely feedback (Banszki et al, 2018;Kao, Chiang, & Foulsham, 2019;Lee, Yu, Tang, Wong, & Poon, 2018). Further advances could be achieved by combining efficient educational approaches with AI technology to make learning more effective and tailored to the student.…”

The Effects of ARCS Motivational Instruction in Physical Education on Learning Cognition and the Health-Related Physical Fitness of Students

“…Referring to Kao et al ( 2019 ), health-related physical fitness in this study contains four dimensions.…”

Computers And Electrical Engineering Template

“…For instance, the use of eye-tracking technology has been applied to analyzed student reading behavior while reading electronic books. In the study of Kao [12], eye-tracking technology was used to understand the reading process of students while visualizing online materials. On the other hand, image processing devices have also been used to analyze the studying behavior of mathematics content at elementary school one example of this is the work of Sun in which a software interface that employs eye-tracking technology was developed to improve the teaching framework [13].…”