In a Silent Way

McCormack, Jon; Gifford, Toby; Hutchings, Patrick; Rodriguez, Maria Teresa Llano; Yee-King, Matthew; d’Inverno, Mark

doi:10.1145/3290605.3300268

Cited by 42 publications

(15 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When adding agents into the process, more dimensions to evaluation processes are introduced; for example, not only whether it adds to the musical experience but also how the performer feels while collaborating with the agent – do they enjoy it, do they struggle to understand what is going on and why it is doing certain things. McCormack, Gifford, Hutchings, Llano Rodriguez, Yee-King and d’Inverno (2019) complete such an evaluation in their collaborative human–AI improvisational system, which looks at establishing trust in these partnerships by looking to communicate internal states.…”

Section: The Role Of Evaluationmentioning

confidence: 99%

On the Integration of Machine Agents into Live Coding

Wilson,

Fazekas,

Wiggins

2023

Org. Sound

View full text Add to dashboard Cite

Co-creation strategies for human–machine collaboration have recently been explored in various creative disciplines and more opportunities for human–machine collaborations are materialising. In this article, we outline how to augment musical live coding by considering how human live coders can effectively collaborate with a machine agent imbued with the ability to produce its own patterns of executable code. Using machine agents allows live coders to explore not-yet conceptualised patterns of code and supports them in asking new questions. We argue that to move away from scenarios where machine agents are used in a merely generative way, or only as creative impetus for the human, and towards a more collaborative relationship with the machine agent, consideration is needed for system designers around the aspects of reflection, aesthetics and evaluation. Furthermore, owing to live coding’s close relationship with exposing processes, using agents in such a way can be a useful manner to explore how to make artificial intelligence processes more open and explainable to an audience. Finally, some speculative futures of co-creative and artificially intelligent systems and what opportunities they might afford the live coder are discussed.

show abstract

Section: The Role Of Evaluationmentioning

confidence: 99%

On the Integration of Machine Agents into Live Coding

Wilson,

Fazekas,

Wiggins

2023

Org. Sound

View full text Add to dashboard Cite

show abstract

“…Who owns "I Keep Counting"? Intellectual property is challenging when using AI methods (McCormack et al, 2019). Most of the time, direct plagiarism is prohibitedas the rules of the AI Song Contest explicitly stated -but when does plagiarism start?…”

Section: Data Availabilitymentioning

confidence: 99%

I Keep Counting: An Experiment in Human/AI Co-creative Songwriting

Micchi

Bigo

Giraud

et al. 2021

Transactions of the International Society for Music Information Retrieval

View full text Add to dashboard Cite

Musical co-creativity aims at making humans and computers collaborate to compose music. As an MIR team in computational musicology, we experimented with co-creativity when writing our entry to the "AI Song Contest 2020". Artificial intelligence was used to generate the song's structure, harmony, lyrics, and hook melody independently and as a basis for human composition. It was a challenge from both the creative and the technical point of view: in a very short time-frame, the team had to adapt its own simple models, or experiment with existing ones, to a related yet still unfamiliar task, music generation through AI. The song we propose is called "I Keep Counting". We openly detail the process of songwriting, arrangement, and production. This experience raised many questions on the relationship between creativity and machine, both in music analysis and generation, and on the role AI could play to assist a composer in their work. We experimented with AI as automation, mechanizing some parts of the composition, and especially AI as suggestion to foster the composer's creativity, thanks to surprising lyrics, uncommon successions of sections and unexpected chord progressions. Working with this material was thus a stimulus for human creativity.

show abstract

“…This results in a continuous interaction between (sustained) user input (e.g., moving a camera feed) and AI suggestions. Other recent examples from the HCI literature include the use of gaze-enabled intention recognition [38] and collaborative music improvisation [34] -showcasing how both implicit and explicit user input can drive continuous AI support systems. We illustrate these different interaction paradigms in Figure 8.…”

Section: Designing Ai For Continuous Adaptationmentioning

confidence: 99%

Designing Visual Markers for Continuous Artificial Intelligence Support

Berkel

Ahmad

Stoyanov

et al. 2020

ACM Trans. Comput. Healthcare

View full text Add to dashboard Cite

Colonoscopy, the visual inspection of the large bowel using an endoscope, offers protection against colorectal cancer by allowing for the detection and removal of pre-cancerous polyps. The literature on polyp detection shows widely varying miss rates among clinicians, with averages ranging around 22%--27%. While recent work has considered the use of AI support systems for polyp detection, how to visualise and integrate these systems into clinical practice is an open question. In this work, we explore the design of visual markers as used in an AI support system for colonoscopy. Supported by the gastroenterologists in our team, we designed seven unique visual markers and rendered them on real-life patient video footage. Through an online survey targeting relevant clinical staff ( N = 36), we evaluated these designs and obtained initial insights and understanding into the way in which clinical staff envision AI to integrate in their daily work-environment. Our results provide concrete recommendations for the future deployment of AI support systems in continuous, adaptive scenarios.

show abstract

In a Silent Way

Cited by 42 publications

References 34 publications

On the Integration of Machine Agents into Live Coding

On the Integration of Machine Agents into Live Coding

I Keep Counting: An Experiment in Human/AI Co-creative Songwriting

Designing Visual Markers for Continuous Artificial Intelligence Support

Contact Info

Product

Resources

About