Using Haptic and Auditory Interaction Tools to Engage Students with Visual Impairments in Robot Programming Activities

Abstract

The robotics field represents the integration of multiple facets of computer science and engineering. Robotics-based activities have been shown to encourage K-12 students to consider careers in computing and have even been adopted as part of core computer-science curriculum at a number of universities. Unfortunately, for students with visual impairments, there are still inadequate opportunities made available for teaching basic computing concepts using robotics-based curriculum. This outcome is generally due to the scarcity of accessible interfaces to educational robots and the unfamiliarity of teachers with alternative (e.g., nonvisual) teaching methods. As such, in this paper, we discuss the use of alternative interface modalities to engage students with visual impairments in robotics-based programming activities. We provide an overview of the interaction system and results on a pilot study that engaged nine middle school students with visual impairments during a two-week summer camp.

Applying Robotics in School Education: a Systematic Review

“…Within three years (2007)(2008)(2009) after the introduction of the program into the school, 91.2% of pupils on average received a sufficient assessment in mathematics, and none of them received the lowest scores. Howard et al, (2012) noted that one of the greatest factors of the effect of the interface was a robot motion feedback signal involving turns to the left and to the right, which used to be incomprehensible to pupils (children with eyesight disorders). The main findings and conclusions of the selected articles are presented in Table 8.…”

“…Varney et al, 2012;Meyers et al, 2012 Robotics lessons have the influence on students' future career. Howard et al, 2012 Early age children have the emotional satisfaction while playing with robot humanoids.…”

“…Howard et al, 2012 "The storytelling robot successfully promoted children's emotional involvement in the learning process" Fridin, 2014 The TASEM program is an effective tool for developing pupils' character, as this encourages and teaches them to use team skills in the development of own robots. Pupils, taught according to this program, understood the principle of team work better and engaged in STEM discussions taking a wiser position (Varney et al, 2012).…”

Machines that learn and teach seamlessly

“…One obvious use of computer haptic interfaces has been to use them to engage trainees who suffer from vision and/ or hearing impairment [32]. Another obvious application is training for surgery.…”

Applying Gaming Principles to Virtual Environments for Upper Extremity Therapy Games

“…Through such feedback, the player can reflect on the actions that have led them to that state, which in turn can help the player understand and better master the game. Feedback can be received in different forms: visually (through text or graphics), haptically, or through auditory channels [19]. By using multiple modes of communication, the player can experience a greater sense of realism and immersion.…”