Personal orchestra: a real-time audio/video system for interactive conducting

Borchers, Jan; Lee, Eric; Samminger, Wolfgang; M�hlh�user, Max

doi:10.1007/s00530-004-0139-2

Cited by 15 publications

(14 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An inertialsensor-based system for drum hitting gesture recognition is presented in [22]. Other works can be found that analyse the motion of a human orchestra conductor [35], and several studies have proposed various systems for the implementation of motion-tracking functionalities for conducting performance, such as by means of stereo-cameras [24], infrared markers and a dataglove [31], infrared sensors [6,27,31,36], or inertial sensors [3,7,32]. Off-the-shelf devices have also been studied for the creation of new interaction models for music performance, such as the case of the WiiRemote [37] and Kinect devices [30,38,39,42], and even mobile phones [14].…”

Section: Prior Studies On Advanced Human-computer Interfaces For Musimentioning

confidence: 99%

Drumkit simulator from everyday desktop objects

Herrero

Barbancho

Tardón

et al. 2014

Multimed Tools Appl

View full text Add to dashboard Cite

In this paper, an augmented reality application for drumkit simulation is presented. The system is capable of classifying any percussive sounds produced by the user from an everyday desktop environment, e.g. clapping, snapping, stroking different objects with a pencil, etc., recognizing up to six different classes of drum hits. These different types of user-generated sounds will subsequently be associated to predefined drumkit sounds, resulting in a natural and intuitive audio interface for drummers and percussionists, which only requires a computer with a built-in microphone. A set of audio features and classification techniques are evaluated for the implementation of the aforementioned system.

show abstract

Section: Prior Studies On Advanced Human-computer Interfaces For Musimentioning

confidence: 99%

Drumkit simulator from everyday desktop objects

Herrero

Barbancho

Tardón

et al. 2014

Multimed Tools Appl

View full text Add to dashboard Cite

show abstract

“…Many systems have recognized this problem and opted for rear projection, such as our conducting exhibits [Borchers, Lee, Samminger and Mühlhäuser 2004], even when the user is not directly touching the display. The reason is that rear projection reaches higher display contrast than front projection, improving the visual quality of the interface.…”

Section: ♦♦♦mentioning

confidence: 99%

The Aachen Media Space: Design Patterns for Augmented Work Environments

Borchers

2009

Designing User Friendly Augmented Work Environments

Self Cite

View full text Add to dashboard Cite

Abstract. Design Patterns are a format to capture the knowledge about successful solutions to recurring design problems in a uniform, interconnected, and easily understood way. The format originated in urban architecture, but has made its way into software engineering and Human-Computer Interaction (HCI). This makes them an ideal format to provide guidelines for the design of Augmented Environments, which requires a highly interdisciplinary team to collaborate.The author, who published the original book on HCI design patterns, has worked on Augmented Environments since 1995. He has captured his experience in designing such environments within the patterns presented here. The chapter first introduces the design pattern format, gives practical tips for reading and writing design patterns, and presents the Augmented Environments from which the patterns in this chapter were distilled. The main part of this chapter then consists of the collection of design patterns for Augmented Environments. These patterns provide practical guidance on how to create an Augmented Environment, with a focus on architectural, interior design, software infrastructure, and user interface considerations. The chapter includes nineteen such patterns connected into a network, as well as suggestions for additional patterns.

show abstract

“…Our previous work on interactive conducting systems [1,5] allows users to control the speed, volume and instrumentation of a digital audio and video recording of an orchestra using basic conducting gestures. While evaluating these systems with users, we have confirmed that users most readily grasp the ability to control the tempo over the other parameters of volume and instrumentation.…”

Section: Introductionmentioning

confidence: 99%

Designing time-based interactions with multimedia

Lee

2005

Proceedings of the 13th Annual ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

The current model of time in multimedia frameworks poses particular problems when designing multimedia systems with timebased interaction. We propose to expand and extend an existing distinction between semantic time and real time from music and film theory to multimedia systems design. The semantic time concept also forms the foundation of a new software framework for multimedia systems that we are building, that, unlike most existing frameworks, includes mechanisms for time-based effects such as time-stretching.

show abstract

Personal orchestra: a real-time audio/video system for interactive conducting

Cited by 15 publications

References 0 publications

Drumkit simulator from everyday desktop objects

Drumkit simulator from everyday desktop objects

The Aachen Media Space: Design Patterns for Augmented Work Environments

Designing time-based interactions with multimedia

Contact Info

Product

Resources

About