Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice

Holloway, Leona; Goncu, Cagatay; Ilsar, Alon; Butler, Matthew; Marriott, Kim

doi:10.1145/3491102.3517465

Cited by 33 publications

(7 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When the purpose of the dance video is a tutorial rather than a performance (e.g., a short video on how to do a popular dance move), future work may explore giving detailed auditory-only instructions and feedback as Rector et al provided for yoga [63]. Sonification has also been used to improve accessibility of spatial navigation [56] and data visualization [30] by representing certain attributes (e.g., distance and data trends) as specific audio queues. However, haptics and sonification are time-based modalities (i.e.…”

Section: Extending Support For Short-form Videosmentioning

confidence: 99%

Making Short-Form Videos Accessible with Hierarchical Video Summaries

Van Daele,

Iyer,

Zhang

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

Section: Extending Support For Short-form Videosmentioning

confidence: 99%

Making Short-Form Videos Accessible with Hierarchical Video Summaries

Van Daele,

Iyer,

Zhang

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…For instance, Apple's VoiceOver Data Comprehension feature on iOS [11] offers out-of-the-box support for making data accessible through verbal descriptions and sonification (or non-speech audio). Similarly, research systems have explored methods for combining tactile graphics with voice [3,4], sonification with voice [19], haptics and sonification [15], and sonification and interactive questionanswering. Among such multimodal systems, Chart Reader [37] is a particularly apt point of comparison to our work because, like Umwelt, it incorporates best practices in visualization, structured textual description, and sonification into a single analysis interface.…”

Section: Multimodal Data Representationsmentioning

confidence: 99%

Umwelt: Accessible Structured Editing of Multi-Modal Data Representations

Zong,

Pedraza Pineros,

Chen

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…The reason for using natural sounds was to support users without musical training in understanding the sonification and auditory graph, and it was found that these natural sounds could support the understanding of categorical data and were most useful for users without musical training. Infographics, the combination of visualization and text information, has been explored with an auditory‐only approach [HGI*22]. An interactive approach, infosonic, was explored to facilitate accessibility of data to blind and low‐vision users, using spoken introduction and annotation, and non‐speech sonification.…”

Section: Adjacent Topicsmentioning

confidence: 99%

Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and Visualization

Enge,

Elmquist,

Caiola

et al. 2024

Computer Graphics Forum

View full text Add to dashboard Cite

The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non‐speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be “more than the sum of the two.” We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta‐analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co‐author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.

show abstract

Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice

Cited by 33 publications

References 34 publications

Making Short-Form Videos Accessible with Hierarchical Video Summaries

Making Short-Form Videos Accessible with Hierarchical Video Summaries

Umwelt: Accessible Structured Editing of Multi-Modal Data Representations

Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and Visualization

Contact Info

Product

Resources

About