The Sound Challenge to Visualization Design Research

Rönnberg, Niklas; Löwgren, Jonas

doi:10.3384/ecp10305

Cited by 6 publications

(6 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It would be interesting to further explore the interplay between colors, musical elements, and the perception of emotions in a future version of Photone. Musical sounds are well adapted, at least on a more general level, to conveying meaning and emotions (see for example discussions in [13,14]). Not only music affects emotions but also colors are associated with emotions [15], and there are correlations between the emotional associations of music and of colors [16].…”

Section: Future Design and Research Ideasmentioning

confidence: 99%

Photone: Exploring Modal Synergy in Photographic Images and Music

Rönnberg¹,

Löwgren²

2018

Proceedings of the 24th International Conference on Auditory Display - ICAD 2018

Self Cite

View full text Add to dashboard Cite

We present Photone, an interactive installation combining photographic images and musical sonification. An image is displayed, and a dynamic musical score is generated based on the overall color properties of the image and the color value of the pixel under the cursor. Hence, the music changes as the user moves the cursor. This simple approach turns out to have interesting experiential qualities in use. The composition of images and music invites the user to explore the combination of hues and textures, and musical sounds. We characterize the resulting experience in Photone as one of modal synergy where visual and auditory output combine holistically with the chosen interaction technique. This tentative finding is potentially relevant to further research in auditory displays and multimodal interaction.

show abstract

Section: Future Design and Research Ideasmentioning

confidence: 99%

Photone: Exploring Modal Synergy in Photographic Images and Music

Rönnberg¹,

Löwgren²

2018

Proceedings of the 24th International Conference on Auditory Display - ICAD 2018

Self Cite

View full text Add to dashboard Cite

show abstract

“…Recent examples of this trend include "data cuisine" [12], "data pottery" [13] and "data sculpture" [14]. Among this emerging trans-disciplinary practice, data visualisation experts are timidly starting to recognise the potentialities of sound and music as an effective way of communicating emotional connotations of information, through qualities such as tempo, volume, or timbre [15].…”

Section: Humanising Datamentioning

confidence: 99%

“…In the history of sonification, the Geiger-counter is possibly the most quoted [22] and the most successful example of using sound to monitor and alert users, and the one stuck into the collective memory. But more recently multimodal design research has shown a renewed interest in leveraging sound specificities, drawn mainly from psychology and psychoacoustics, cognitive sciences and neurosciences [15], to design more efficient user experiences in order to increase the information bandwidth and avoid information overload in Virtual Reality (VR) highly complex environments [17]. Maybe surprisingly, in these contexts not only functionality and efficiency but also the aesthetic of sound appears as an increasingly important characteristic to make auditory feedbacks more relevant and easier to interpret [37].…”

Section: Sonification In a Multi-modal Contextmentioning

confidence: 99%

Humanising Data through Sound: Res Extensae and a User-Centric Approach to Data Sonification

Lenzi

Gleria²

2018

Proceedings of the 24th International Conference on Auditory Display - ICAD 2018

View full text Add to dashboard Cite

In this paper, starting from a case study (the mixed-media data sonification installation Res Extensae), we discuss a number of assumptions on the efficacy of sound as a means to represent and communicate numerical data. The discussion is supported by the results of a questionnaire aimed at validating our assumptions and conducted with fifteen of the participants to the experience. At the same time, we have the ambition to contribute to a wider debate on the value of data sonification. We introduce the first stage of a research on sonification as a design-driven, user-centred and multi-modal experience, in that closer to data design practices rather than to traditional composition and computer music. We describe the usage of physical objects to help users to put sounds and data into a wider context, improving the user experience and facilitating the comprehension and retention of the meaning of data.

show abstract

“…The ability of sound to both be part of the peripheral awareness and to be experienced intentionally and attentionally (that is, focally) is something that makes sound different from visual stimuli. The auditory system has a very high resolution in terms of frequency discrimination as well as temporal resolution and perception of loudness levels, and musical sounds are well adapted to convey a multitude of information to listeners, quickly and intuitively (Tsuchiya, 2015), communicating meaning, information, and emotions (see for example discussions in Rönnberg, 2016, andTsuchiya, 2015) on a general level. This makes sound suitable for creating sonic moods, providing peripheral information, conveying general information about states in dynamic processes, and more.…”

Section: Introductionmentioning

confidence: 99%

Designing the user experience of musical sonification in public and semi-public spaces

Rönnberg

Löwgren

2021

SoundEffects

Self Cite

View full text Add to dashboard Cite

Sonification refers to sonic expression of data or information. It is often thought of as an auditory complement, providing additional information about data which can reveal patterns and facilitate interpretation and understanding of the data. Hence, the listening space created by a sonifi cation is always a hybrid where auditory augmentation complements other information modalities and, in some cases, also spatial qualities. In this work, we focus on sonifi cation in public and semi-public spaces, and specifi cally on musical sonifi cation – the use of musical sounds to create a sonic environment, augmenting or complementing a physical shared space. We draw upon established approaches in interaction design to focus our work on the user experience of musical sonifi cation in public and semi-public spaces. Specifi cally, we fi rst identify the experiential qualities of sonic atmosphere and performativity as important aspects of sonifi cation in public and semi-public spaces, then use those experiential qualities generatively in the speculative design of a musical sonifi cation sketch. The design sketch comprises a dynamic musical sonifi cation of air quality data, intending to give citizens an awareness and an enhanced individual and interpersonal understanding of air quality in their city.

show abstract

The Sound Challenge to Visualization Design Research

Cited by 6 publications

References 30 publications

Photone: Exploring Modal Synergy in Photographic Images and Music

Photone: Exploring Modal Synergy in Photographic Images and Music

Humanising Data through Sound: Res Extensae and a User-Centric Approach to Data Sonification

Designing the user experience of musical sonification in public and semi-public spaces

Contact Info

Product

Resources

About