Towards an open Web Audio plugin standard

Buffa, Francesca M.; Lebrun, Jérôme; Kleimola, Jari; Larkin, Oliver; Letz, Stéphane

doi:10.1145/3184558.3188737

Cited by 8 publications

(9 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A new version of the WebAudioModule (WAM) standard [16,17], which had been first released in 2015, was redesigned for reflecting recent technological developments. A URI can be used to fetch a WAM plugin from the web, and the current WebAudio context can be used to initialize it.…”

Section: Parametersmentioning

confidence: 99%

JSPatcher, a Visual Programming Environment for Building High-Performance Web Audio Applications

Ren¹,

Pottier²,

Buffa³

et al. 2022

J. Audio Eng. Soc.

View full text Add to dashboard Cite

Many visual programming languages (VPLs) which include Max or PureData provide a graphic canvas for connecting between functions or data. This canvas, also called a patcher, is basically a graph meant to be interpreted as a dataflow computation by the system. Some VPLs are used for multimedia performance or content generation since the UI system is generally a significant element of the language. This paper presents a web-based VPL, JSPatcher, which allows you to build audio graphs using the Web Audio API. Users can use a web browser to graphically design and run DSP algorithms using domain specific languages (DSL) for audio processing such as FAUST or Gen and execute them in a dedicated high priority thread called AudioWorklet. The application can also be utilized to create interactive programs and shareable artworks online with other JavaScript language built-ins, Web APIs, web-based audio plugins or external JavaScript modules.

show abstract

Section: Parametersmentioning

confidence: 99%

JSPatcher, a Visual Programming Environment for Building High-Performance Web Audio Applications

Ren¹,

Pottier²,

Buffa³

et al. 2022

J. Audio Eng. Soc.

View full text Add to dashboard Cite

show abstract

“…In connection with the FAST project 2 , an offline chord analysis of 442k songs has been performed, and both an online enhanced audio player [49] and chord search engine [50] have been built around it. A rich set of Web Audio applications and plugins has been proposed [12,13,14]. All these metadata, computational analyses and Web Audio applications have now been gathered in one easy-to-use web interface, the WASABI Interactive Navigator 3 , illustrated in Figure 1.…”

Section: Constructing the Wasabi Song Corpusmentioning

confidence: 99%

“…Notice that an online data source we used for song lyrics at the beginning of the WASABI project (2017-2021), LyricsWikia, is now offline 14 . However, it is still possible for researchers to obtain the full lyrics we used using commercial APIs such as MusixMatch 15 .…”

Section: Getting Access To Copyrighted Contentmentioning

confidence: 99%

The WASABI song corpus and knowledge graph for music lyrics analysis

Fell

Cabrio²,

Tikat³

et al. 2022

Lang Resources & Evaluation

View full text Add to dashboard Cite

We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.

show abstract

“…7 As of last year, WAP now includes support for pure MIDI plugins (a GM midi synthesizer, virtual midi keyboards, a MIDI event monitoring plugin, etc 8 ). For more details about the WAP proposal, and how it is related to other approaches like Web Audio Modules (WAMs), WebAudio API eXtension (WAAX) [8], or JavaScript Audio Plugin (JSAP), see [2].…”

Section: Introductionmentioning

confidence: 99%

“…Most of them aim at adapting existing code bases (usually developed in native languages like C/C++) as well as facilitating the use of existing audio Digital Signal Processing (DSP) languages and platforms. Our two teams previously presented an open format for WebAudio Plugins coined WAP [2]. It aims at: (i) improving the interoperability of audio/MIDI plugins developed using pure Web APIs, (ii) porting existing native code bases, or (iii) using Domain Specific Languages (DSL).…”

mentioning

confidence: 99%