Real-time sensory substitution to enable players who are blind to play video games using whole body gestures

Morelli, Tony; Folmer, Eelke

doi:10.1145/2159365.2159385

Cited by 23 publications

(15 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Rector et al developed an application called Eyes-free Yoga using Kinect that allows visually impaired people to enjoy yoga. Morelli et al have reported cases in which visually impaired people can play sports games by identifying tactile feedback to their whole body according to physical movements [51].…”

Section: Audio and Inclusive Gamesmentioning

confidence: 99%

Game

Miura

Matsuo

Yabu

et al. 2020

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Although many computer games have become diversified in recent years, much effort and ingenuity are needed to produce games that persons with visual impairments can enjoy. However, game developers face difficulties in adjusting the parameters of these games, including difficulty and interface features, because the control skills and disability conditions of gamers vary. Thus, it is essential to establish a scheme to evaluate game interfaces and stages with individuals trials with a short time. In this study, our purpose is to propose and establish the concept of GAME (Game As a Measurement Environment) that can evaluate game interfaces and stages. This concept aims to divide a game stage into substages and then randomly allocate them to the stage. Then, the generated stage records the play logs and play conditions and then analyzes them logs based on test theories, including classical test theory (CTT) and item response theory (IRT). Based on the analysis of the gathered play logs of side-scroller action games, our concept could clarify the relationship between the stage contents, interface effects, and players skills and disabilities.

show abstract

Section: Audio and Inclusive Gamesmentioning

confidence: 99%

Game

Miura

Matsuo

Yabu

et al. 2020

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

show abstract

“…Applications in this area mostly focus on controlling interfaces [11,42,46] and supporting users [34,42], especially those with physical impairments [17,40,47]. Common to these approaches is that they use Kinect's 3D depth camera for enabling gesture-based interactions.…”

Section: Related Workmentioning

confidence: 99%

WikiNect: image schemata as a basis of gestural writing for kinetic museum wikis

Mehler

Lücking

Abrami

2014

Univ Access Inf Soc

View full text Add to dashboard Cite

This paper provides a theoretical assessment of gestures in the context of authoring image-related hypertexts by example of the museum information system WikiNect. To this end, a first implementation of gestural writing based on image schemata is provided (Lakoff in Women, fire, and dangerous things: what categories reveal about the mind. University of Chicago Press, Chicago, 1987). Gestural writing is defined as a sort of coding in which propositions are only expressed by means of gestures. In this respect, it is shown that image schemata allow for bridging between natural language predicates and gestural manifestations. Further, it is demonstrated that gestural writing primarily focuses on the perceptual level of image descriptions (Hollink et al. in Int J Hum Comput Stud 61(5): 2004). By exploring the metaphorical potential of image schemata, it is finally illustrated how to extend the expressiveness of gestural writing in order to reach the conceptual level of image descriptions. In this context, the paper paves the way for implementing museum information systems like WikiNect as systems of kinetic hypertext authoring based on full-fledged gestural writing.

show abstract

“…According to Morelli and Folmer [ 4 ], gesture-based games typically simulate real physical activities because they use whole-body gestures. These kinds of games are intuitive to play, they have successfully attracted users, and they provide different social forms of gaming—especially because they allow natural interaction and immersion.…”

Section: Introductionmentioning

confidence: 99%

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

Simor¹,

Brum²,

Schmidt³

et al. 2016

JMIR Serious Games

View full text Add to dashboard Cite

BackgroundGestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use.ObjectiveThis study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games.MethodsThe research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface.ResultsIn the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user’s age and limitations.ConclusionsThrough this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology and a test protocol may offer the user more comfort, welfare, and confidence.

show abstract

Real-time sensory substitution to enable players who are blind to play video games using whole body gestures

Cited by 23 publications

References 20 publications

Game

Game

WikiNect: image schemata as a basis of gestural writing for kinetic museum wikis

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review

Contact Info

Product

Resources

About