CoHEARence of audible shapes—a qualitative user study for coherent visual audio design with resynthesized shapes

Engeln, Lars; Groh, Rainer

doi:10.1007/s00779-020-01392-5

Cited by 7 publications

(4 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other times users draw images to reference sounds. Similar findings are reported by Engeln et al [73].…”

Section: Sketching Sound Vs Interactionsupporting

confidence: 92%

Sketching in sound and interaction design

Marentakis

2024

Proceedings of the 10th Convention of the European Acoustics Association Forum Acusticum 2023

View full text Add to dashboard Cite

The process of interaction design involves multiple stages beginning from user research and ideation that lead to working prototypes and user evaluation. Sketching is considered to be important in the early interaction design stages as a way to explore, store, but also communicate ideas. Sketching is, however, a graphical process and it is not always easy to integrate sound to it, even though sound is an important part of interaction. Sketching sound, on the other hand, has received significant attention in sound design. Here, we contrast sketching in interaction design with sketching sound in order to understand whether ideas from sound sketching can be relevant when sketching interaction. The literature indicates that sketching sound has been done almost exclusively in the auditory modality and takes place in a largely independent process that is not entirely harmonized with traditional graphical sketching and interaction design practices. While this may make sense when designing sonic interactions, it is not as supportive for other interaction design contexts. We discuss this finding while taking into account graphical approaches to sketching sound in the literature.

show abstract

“…Other times users draw images to reference sounds. Similar findings are reported by Engeln et al [73].…”

Section: Sketching Sound Vs Interactionsupporting

confidence: 92%

Sketching in sound and interaction design

Marentakis

2024

Proceedings of the 10th Convention of the European Acoustics Association Forum Acusticum 2023

View full text Add to dashboard Cite

show abstract

“…erefore, it has a broad application prospect in information processing, pattern recognition, intelligent control, and other fields. Neural network-based control is called neural network control [22][23][24][25]. Intelligent simulation based on a neural network is used for control and is an important form of intelligent control, which has achieved rapid development in recent years.…”

Section: Related Workmentioning

confidence: 99%

Product Shape Design Scheme Evaluation Method Based on Spatial Data Mining

Wei¹

2022

Mathematical Problems in Engineering

View full text Add to dashboard Cite

The stage of product modeling design implies a lot of complex tacit knowledge, which is the embodiment of the design concept centered on product modeling design and is also the hot spot and difficulty of modern design theory and method research. Aiming at the evaluation and decision of product modeling design scheme, a decision-making method of approaching ideal solution ranking based on grey relational analysis was proposed, which realized the convergence of tacit knowledge. The empty association rule is an important knowledge content of spatial data mining. A fuzzy genetic algorithm can solve the characteristics of random and nonlinear problems and solve the data mining problems of spatial association rules. The fuzzy genetic algorithm of discrete crossover probability and mutation probability is applied to data mining of spatial association rules in a spatial database, the coding method of the fuzzy genetic algorithm and the construction of fitness function are discussed, and the process of mining spatial association rules is given. The results show that the method of mining s association rules with the fuzzy genetic algorithm is feasible and has higher mining efficiency. This paper discusses the construction method of designing a decision support database based on linear regression and neural network and then proposes a decision method combining TOPSIS and grey relational analysis, which comprehensively considers the position and shape of the scheme data curve.

show abstract

“…They found that representations are not only influenced by musical structure, but also by a participant's music proficiency. Engeln and Groh [18] loosely classified drawings of sounds that were re-synthesised from spectrograms into real-world associations like scenes, actions or emotions, abstract shapes and structures or references to audio visualisations like waveforms and amplitude envelopes.…”

Section: Background On Sound-shape Associationsmentioning

confidence: 99%

Sketching sounds: an exploratory study on sound-shape associations - Additional Material

Löbbers¹,

Barthet²,

Fazekas³

2021

View full text Add to dashboard Cite

Sound synthesiser controls typically correspond to technical parameters of signal processing algorithms rather than intuitive sound descriptors that relate to human perception of sound. This makes it difficult to realise sound ideas in a straightforward way. Cross-modal mappings, for example between gestures and sound, have been suggested as a more intuitive control mechanism. A large body of research shows consistency in human associations between sounds and shapes. However, the use of drawings to drive sound synthesis has not been explored to its full extent. This paper presents an exploratory study that asked participants to sketch visual imagery of sounds with a monochromatic digital drawing interface, with the aim to identify different representational approaches and determine whether timbral sound characteristics can be communicated reliably through visual sketches. Results imply that the development of a synthesiser exploiting sound-shape associations is feasible, but a larger and more focused dataset is needed in followup studies.

show abstract

CoHEARence of audible shapes—a qualitative user study for coherent visual audio design with resynthesized shapes

Cited by 7 publications

References 20 publications

Sketching in sound and interaction design

Sketching in sound and interaction design

Product Shape Design Scheme Evaluation Method Based on Spatial Data Mining

Sketching sounds: an exploratory study on sound-shape associations - Additional Material

Contact Info

Product

Resources

About