Gaze and voice controlled drawing

Kamp, Jan van der; Sundstedt, Veronica

doi:10.1145/1983302.1983311

Cited by 40 publications

(30 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By addressing the aspects of narrative elements and story, we could extend the framework as it exclusively focuses on functionality and visualization (i.e., aesthetics and consistency). Furthermore, the considerations made in this article could also be applied to multi-modal constellations, as gaze has been studied in combination with gestures [99], facial expressions [100], or voice [101].…”

Section: Contextualizing the Frameworkmentioning

confidence: 99%

Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors

Gómez

Lankes

2019

MTI

View full text Add to dashboard Cite

Gaze-based interactions have found their way into the games domain and are frequently employed as a means to support players in their activities. Instead of implementing gaze as an additional game feature via a game-centred approach, we propose a diegetic perspective by introducing gaze interaction roles and gaze metaphors. Gaze interaction roles represent ambiguous mechanics in gaze, whereas gaze metaphors serve as narrative figures that symbolise, illustrate, and are applied to the interaction dynamics. Within this work, the current literature in the field is analysed to seek examples that design around gaze mechanics and follow a diegetic approach that takes roles and metaphors into account. A list of surveyed gaze metaphors related to each gaze role is presented and described in detail. Furthermore, a case study shows the potentials of the proposed approach. Our work aims at contributing to existing frameworks, such as EyePlay, by reflecting on the ambiguous meaning of gaze in games. Through this integrative approach, players are anticipated to develop a deeper connection to the game narrative via gaze, resulting in a stronger experience concerning presence (i.e., being in the game world).

show abstract

Section: Contextualizing the Frameworkmentioning

confidence: 99%

Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors

Gómez

Lankes

2019

MTI

View full text Add to dashboard Cite

show abstract

“…Many researchers put effort into the eye-user interface framework [20,21,22,23,24]. Eye tracker devices also contribute to a paint style program [25] by Kamp with voice command and other graphical software [26] by Gepner.…”

Section: Gaze Controllermentioning

confidence: 99%

Study on Applications of Eye Tracking in Different Fields

Ke¹,

Bo-gang²,

Yang³

2018

dtcse

View full text Add to dashboard Cite

Abstract. The arising technology eye tracking has been blooming not only in the medical field but also in the field of computer science. There are various usages of eye tracking that range from human study, over usability of design, up to controller input of computer interfaces to information security. In this paper, the application of the real-time gaze-base technique eye tracking is introduced with the presented usages. A comprehensive summary shows the progress of this innovative technology. Finally, the challenges and potential directions of this uprising tool are being discussed.

show abstract

“…Hornof and Cavender present EyeDraw [30], a software program that allows children with severe motor impairments to draw with their eyes. Likewise, van der Kamp and Sundstedt [47] propose a combination of gaze and voice commands for interacting with a paint style program. In their proposed application, voice commands are used to activate drawing, while gaze is used to move the cursor.…”

Section: Related Workmentioning

confidence: 99%

Design and Development of One-Switch Video Games for Children with Severe Motor Disabilities

López

Corno

Russis

2017

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

Video games are not just played for fun, they have become a handy instrument for the cognitive, emotional and social development of children. However, several barriers prevent many children with disabilities from playing action-oriented video games, alone or with their peers. In particular, children with severe motor disabilities, who rely on one-switch interaction for accessing electronic devices, nd fast-paced games, that require rapid decision-making and timely responses, completely unplayable. This paper contributes to lowering such barriers by presenting GNomon, a software framework that allows the creation of action-oriented single switch video games. The paper reports the results of two studies that evaluate the playability and rehabilitation-suitability of GNomon-based video games. The playability of GNomon-based games is evaluated by assessing their learnability, eectiveness, errors, satisfaction, memorability and enjoyability, with a group of 8 children with severe motor disabilities. The suitability for pediatric rehabilitation is determined by means of a focus group with a team of speech therapists, physiotherapists, and psychologists from a Local Health Agency in Turin, Italy. The results of the playability study are positive: all children had fun playing GNomon-based video games, and 7 out of 8 were able to interact and play autonomously. The results of the rehabilitation-suitability study also entail that GNomon-based games can be exploited in training hand-eye coordination and maintenance of selective attention over time. The paper nally oers critical hindsight and reections, and shows possible new future game concepts. CCS Concepts: • Human-centered computing → Accessibility design and evaluation methods; Graphical user interfaces; • Applied computing → Computer games;

show abstract

Gaze and voice controlled drawing

Cited by 40 publications

References 10 publications

Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors

Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors

Study on Applications of Eye Tracking in Different Fields

Design and Development of One-Switch Video Games for Children with Severe Motor Disabilities

Contact Info

Product

Resources

About