Some Mathematical and Computational Relations Between Timbre and Color

Mannone, Maria; Arias-Valero, Juan Sebastián

doi:10.1007/978-3-031-07015-0_11

Cited by 4 publications

(6 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…to roughly consider the stimuli as concordant or discordant. The precise definition of this approach to color-timbre associations has been recently formalized in the framework of category theory [14] and experimentally validated [26]. Specific timbres (colors) are seen as points in a "conceptual space" of timbres (colors), and the transition from one timbre (color) to another one is a path in that space.…”

Section: Background and Literature Reviewmentioning

confidence: 99%

“…Now that we defined conceptual spaces, let us consider the parameter spaces of colors and timbres needed to contextualize the multi-sensory stimuli in our study. A space of timbres, as defined in [14], is a space of complex parameters, that is, a space whose points are timbric combinations and whose paths between points are the progressive transitions transforming some colors into other ones. A space of colors is similarly defined.…”

Section: Background and Literature Reviewmentioning

confidence: 99%

“…In our study, the reference to a specific framework, that is, an improvised choreography based on multi-sensory external stimuli, constitutes a toy model of a more general approach toward the formalism of quantum mind/classic context interaction. The spectrograms refers to audio stimuli used in a color-timbre experiment [14], and the "response" poses of the robot Pepper are taken from [15]. The stimulus red is associated with a forte of orchestra with brass in evidence; the stimulus grey is associated with a softer orchestration with pianissimo winds and violins, and stimulus black is associated with a low-register fortissimo piano cluster.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Modeling Robotic Thinking and Creativity: A Classic–Quantum Dialogue

Mannone,

Chella,

Pilato

et al. 2024

Mathematics

View full text Add to dashboard Cite

The human mind can be thought of as a black box, where the external inputs are elaborated in an unknown way and lead to external outputs. D’Ariano and Faggin schematized thinking and consciousness through quantum state dynamics. The complexity of mental states can be formalized through the entanglement of the so-called qualia states. Thus, the interaction between the mind and the external world can be formalized as an interplay between classical and quantum-state dynamics. Since quantum computing is more and more often being applied to robots, and robots constitute a benchmark to test schematic models of behavior, we propose a case study with a robotic dance, where the thinking and moving mechanisms are modeled according to quantum–classic decision making. In our research, to model the elaboration of multi-sensory stimuli and the following decision making in terms of movement response, we adopt the D’Ariano–Faggin formalism and propose a case study with improvised dance based on a collection of poses, whose combination is presented in response to external and periodic multi-sensory stimuli. We model the dancer’s inner state and reaction to classic stimuli through a quantum circuit. We present our preliminary results, discussing further lines of development.

show abstract

Section: Background and Literature Reviewmentioning

confidence: 99%

Section: Background and Literature Reviewmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Modeling Robotic Thinking and Creativity: A Classic–Quantum Dialogue

Mannone,

Chella,

Pilato

et al. 2024

Mathematics

View full text Add to dashboard Cite

show abstract

“…Categories abstractly help investigate some fields, including applications in the domain of computer science. Because there are more and more connections with computer science which are related with music and the visual arts as probes to investigate perception, an application of the language of categories to the arts can thus be fruitful for computer science developments in the humanities [20][21][22]. We can envisage techniques to translate (or, better, define a mapping between) a visual form and a(n equivalence class of) musical structure(s) [23].…”

Section: And Comparisonsmentioning

confidence: 99%

“…It would consist in the progressive partials addition reaching white noise (timbres), and a color superposition reaching white light (colors). Such a structured application has recently been coded in the Reference [20].…”

Section: Mapping Of Color Classes Onto Timbre Classesmentioning

confidence: 99%

Color and Timbre Gestures: An Approach with Bicategories and Bigroupoids

Mannone

Santini²,

Adedoyin

et al. 2022

Mathematics

Self Cite

View full text Add to dashboard Cite

White light can be decomposed into different colors, and a complex sound wave can be decomposed into its partials. While the physics behind transverse and longitudinal waves is quite different and several theories have been developed to investigate the complexity of colors and timbres, we can try to model their structural similarities through the language of categories. Then, we consider color mixing and color transition in painting, comparing them with timbre superposition and timbre morphing in orchestration and computer music in light of bicategories and bigroupoids. Colors and timbres can be a probe to investigate some relevant aspects of visual and auditory perception jointly with their connections. Thus, the use of categories proposed here aims to investigate color/timbre perception, influencing the computer science developments in this area.

show abstract