Using a dedicated toolkit and the cloud to coordinate shared music representations

Vlachakis, George; Karadimitriou, Nikolas; Akoumianakis, Demosthenes

doi:10.1109/iisa.2014.6878783

Cited by 3 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…5 The next type describes music systems used for asynchronous exchange, editing MIDI (Musical Instrument Digital Interface) audio data, and building virtual rooms for audio recording and transmission using centralized servers. [6][7][8] The third class contains sonic environments with many music instrument players participating in improvisation experiments as well as audience during the process. [9][10][11] The last category describes real-time musical interaction between musicians located in different places, requiring perfect synchronicity, resulting in NMP systems.…”

Section: Prerequisitesmentioning

confidence: 99%

Improving networked music performance systems using application‐network collaboration

Lakiotakis

Liaskos

Dimitropoulos

2018

Concurrency and Computation

View full text Add to dashboard Cite

Summary Networked Music Performance (NMP) systems involve musicians located in different places who perform music while staying synchronized via the Internet. The maximum end‐to‐end delay in NMP applications is called Ensemble Performance Threshold (EPT) and should be less than 25 milliseconds. Due to this constraint, NMPs require ultra–low‐delay solutions for audio coding, network transmission, relaying, and decoding, each one a challenging task on its own. There are two directions for study in the related work referring to the NMP systems. From the audio perspective, researchers experiment on low‐delay encoders and transmission patterns, aiming to reduce the processing delay of the audio transmission, but they ignore the network performance. On the other hand, network‐oriented researchers try to reduce the network delay, which contributes to reduced end‐to‐end delay. In our proposed approach, we introduce an integration of dynamic audio and network configuration to satisfy the EPT constraint. The basic idea is that, the major components participating in an NMP system, the application and the network interact during the live music performance. As the network delay increases, the network tries to equalize it by modifying the routing behavior using Software‐Defined Networking principles. If the network delay exceeds a maximum affordable threshold, the network reacts by informing the application to change the audio processing pattern to overcome the delay increase, resulting in below EPT end‐to‐end delay. A full prototype of the proposed system was implemented and extensively evaluated in an emulated environment.

show abstract

Section: Prerequisitesmentioning

confidence: 99%

Improving networked music performance systems using application‐network collaboration

Lakiotakis

Liaskos

Dimitropoulos

2018

Concurrency and Computation

View full text Add to dashboard Cite

show abstract

“…in the order of 10 −6 − 10 −8 with network jitter below 1 ms, as in academic networks). 5 Alternatively, the simplest solution on the sender side consists of transmitting duplicate packets in order to reduce the probability of losing them, but this tends to increase the data rate in the stream and, consequently, worsen the delay. Another sender-based countermeasure against packet loss implies packet interleaving [74], which is done with the purpose of dispersing data vacancies, thus limiting their size to one or two packets at a time.…”

Section: F Packet Loss Concealment Techniquesmentioning

confidence: 99%

“…• musical team-composing systems allowing for asynchronous exchange and editing of MIDI (Musical Instrument Digital Interface) data [3]- [5] or recreating virtual online rooms for remote recording sessions based on distributed systems connected through centralized servers 1 ;…”

Section: Introductionmentioning

confidence: 99%

An Overview on Networked Music Performance Technologies

Chafe²,

et al. 2016

View full text Add to dashboard Cite

Networked music performance (NMP) is a potential game changer among Internet applications, as it aims at revolutionizing the traditional concept of musical interaction by enabling remote musicians to interact and perform together through a telecommunication network. Ensuring realistic performance conditions, however, constitutes a significant engineering challenge due to the extremely strict requirements in terms of network delay and audio quality, which are needed to maintain a stable tempo, a satisfying synchronicity between performers and, more generally, a high-quality interaction experience. In this paper, we offer a review of the psycho-perceptual studies conducted in the past decade, aimed at identifying latency tolerance thresholds for synchronous real-time musical performance. We also provide an overview of hardware/software enabling technologies for NMP, with a particular emphasis on system architecture paradigms, networking configurations, and applications to real use cases.

show abstract

“…The MusiNet toolkit is a desktop application which implements a specialized presentation vocabulary for articulating musical idioms and exploits file sharing services and open APIs as means for peer collaborative engagements (Vlachakis, Karadimitriou & Akoumianakis, 2014). The toolkit's implementation strategy was grounded on (a) augmenting interaction facilities of an open source library (i.e., JMusic, http://explodingart.com/jmusic/) so as to improve the handling of established music interaction components, such as staves and midi rolls; (b) expanding the library to provide programmatic support for new and customized interaction objects, such as new top-level containers and object hierarchies; (c) integrating the library with third-party applications and services through appropriate APIs to promote interoperability, thus appropriation of features such as cloud-based file sharing, communication and reuse.…”

Section: The Virtual Settlementmentioning

confidence: 99%

Online ‘Tells' with Cultural Bindings

Akoumianakis

2016

International Journal of Virtual Communities and Social Networking

Self Cite

View full text Add to dashboard Cite

The paper explores the explanatory value of digital traces, especially for gaining insight to ‘cultural' settings in the absence of cultural participants. We consider digital traces as the ‘matter' of online social phenomena which can be revealed through transformation, re-alignment or re-configuration of data. In this vein, the notion of ‘imbrication' is used to provide a conceptual lens for organizing inquiries in which digital traces should be re-arranged so as to act interdependently with other digital representations to provide posterior insights into designated virtual settlements. Empirical insight is sought by two case studies addressing different digital settings and different social accomplishments in the absence of ‘cultural' participants.

show abstract

Using a dedicated toolkit and the cloud to coordinate shared music representations

Cited by 3 publications

References 18 publications

Improving networked music performance systems using application‐network collaboration

Improving networked music performance systems using application‐network collaboration

An Overview on Networked Music Performance Technologies

Online ‘Tells' with Cultural Bindings

Contact Info

Product

Resources

About