A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction

Savidis, Anthony; Stephanidis, Constantine; Korte, Andreas; Crispien, Kai; Fellbaum, Klaus

doi:10.1145/228347.228366

Cited by 43 publications

(30 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Finally, Savidis et al [13] used a non-visual 3D audio environment to allow blind users to interact with standard GUIs. Different menu items were mapped to different locations around the user's head.…”

Section: Previous Work On Auditory and Gestural Interfaces For Mobilementioning

confidence: 99%

A Study on Gestural Interaction with a 3D Audio Display

Marentakis

Brewster

2004

Mobile Human-Computer Interaction - MobileHCI 2004

View full text Add to dashboard Cite

The study reported here investigates the design and evaluation of a gesturecontrolled, spatially-arranged auditory user interface for a mobile computer. Such an interface may provide a solution to the problem of limited screen space in handheld devices and lead to an effective interface for mobile/eyes-free computing. To better understand how we might design such an interface, our study compared three potential interaction techniques: head nodding, pointing with a finger and pointing on a touch tablet to select an item in exocentric 3D audio space. The effects of sound direction and interaction technique on the browsing and selection process were analyzed. An estimate of the size of the minimum selection area that would allow efficient 3D sound selection is provided for each interaction technique. Browsing using the touch screen was found to be more accurate than the other two techniques, but participants found it significantly harder to use.

show abstract

Section: Previous Work On Auditory and Gestural Interfaces For Mobilementioning

confidence: 99%

A Study on Gestural Interaction with a 3D Audio Display

Marentakis

Brewster

2004

Mobile Human-Computer Interaction - MobileHCI 2004

View full text Add to dashboard Cite

show abstract

“…This is true not only for the real world but also in virtual computer based environments. Certain evidence of this is given by experiences done according to the HOMER UIMS approach by Savidis and Stephanidis [23]; this approach consists of developing dual user interfaces for integrating blind and sighted people. To achieve this goal standard visualization elements like control element icons, tool menus, short cuts, logical structures with nodes and links, hypertext, images and animated sequences are enriched with acoustic elements or haptic interfaces, which allow direct interaction of the user with objects of the model used for the computer to represent the problem being explained or presented.…”

Section: Parallel Reception Modesmentioning

confidence: 99%

“…The HOMER UIMS approach by Anthony Savidis and Constantine Stephanidis [22,23] develops dual user interfaces for the integration of blind and sighted. HOMER supports the integration of visual and non-visual interaction objects and their relationships.…”

Section: Related Tools For Blind Usersmentioning

confidence: 99%

Visualization for the Mind’s Eye

Baloian¹,

Luther²

2002

Software Visualization

View full text Add to dashboard Cite

Abstract. Software visualization has been almost exclusively tackled from the visual point of view; this means visualization occurs exclusively through the visual channel. This approach has its limitations. Considering previous work for blind people we propose that complementing usual approaches with those techniques used to develop interfaces for non-sighted people can enhance user awareness of logical structures or data types using different perception channels. To achieve better comprehension, we deal with new or augmented interfaces built on top of standard systems for data visualization and algorithm animation. The notion of specific concept keyboards is introduced. As a consequence, modern information and learning systems can be designed in such a way that not only sighted but also blind users can navigate within these systems.

show abstract

“…Our approach tries to extend these concepts by testing the hypothesis that a 3D sound navigable environment can create some mental images and serve as an aural representation of the space and surrounding entities such as the ones explored in previous studies [13,15,16,20]. Kobayashi [11] explores the idea of sound-space association to enable simultaneous speaker listening, but spatial navigation is not included.…”

Section: Introductionmentioning

confidence: 99%

Virtual environment interaction through 3-D audio by blind children

Sanchez¹,

Lumbreras²

1999

PsycEXTRA Dataset

View full text Add to dashboard Cite

Interactive software is profusely used for learning, cognition, and entertainment purposes. Educational entertainment software is not very familiar among blind children because most computer games and electronic toys do not have appropriate interfaces to be accessible without visual cues. This work applies the concept of interactive hyperstories to blind children. Hyperstories are tried out in a 3D acoustic virtual world. In past studies we have conceptualized a model to design hyperstories. The study illustrates the feasility of the model as well as introduces to the field of entertainment software for blind children. As a result, we have designed and field tested AudioDoom, a virtual environment interacted through 3D Audio by Blind Children.AudioDoom is also a software that enables testing non trivial interfaces and cognitive tasks with blind children. We explored the construction of cognitive spatial structures in the minds of blind children through audio-based entertainment and spatial sound navigable experiences.Children playing AudioDoom were exposed to first person experiences by exploring highly interactive virtual worlds through the use of 3D aural representations of the space. This experience was structured in several cognitive tasks where they had to build concrete models of their spatial representations constructed through the interaction with AudioDoom by using Lego blocks.We analyze our preliminary results after testing AudioDoom with chilean children from a school for blind children. We discuss issues such as interactivity in software without visual cues, the representation of spatial sound navigable experiences, and entertainment software such as computer games for blind children. We also evaluate the feasibility to construct virtual environments through the design of dynamic learning materials with audio cues.

show abstract

A generic direct-manipulation 3D-auditory environment for hierarchical navigation in non-visual interaction

Cited by 43 publications

References 3 publications

A Study on Gestural Interaction with a 3D Audio Display

A Study on Gestural Interaction with a 3D Audio Display

Visualization for the Mind’s Eye

Virtual environment interaction through 3-D audio by blind children

Contact Info

Product

Resources

About