Enabling humanoid musical interaction and performance

Kim, Youngmoo E.; Grunberg, David; Batula, Alyssa M.; Lofaro, Daniel M.; Oh, Jun-Ho; Oh, Paul

doi:10.1109/cts.2011.5928689

Cited by 8 publications

(6 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Neither of these systems, however, consider mood. The RoboCup Junior competition includes a 'dancing' event, in which robots dance to a piece of music 2 . The music is known in advance and played from file, though, so musical features can be marked by hand instead of being extracted from the music.…”

Section: Related Workmentioning

confidence: 99%

“…Hubo is an adult-sized humanoid developed by the Korean Advanced Institute for Science and Technology (KAIST). We have used Hubo in several other tasks involving robotic reactions to audio, such as moving in synchrony with audio beats [2]. Hubo possesses over forty degrees of freedom and can perform smooth and graceful motions such as tai chi, so it is a suitable choice for a robot that will need to move in human-like ways and display emotion.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Affective gesturing with music mood recognition

Grunberg

Batula

Schmidt

et al. 2012

2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012)

Self Cite

View full text Add to dashboard Cite

Abstract-The recognition of emotions and the generation of appropriate responses is a key component for facilitating more natural human-robot interaction. Music, often called the "language of emotions," is a particularly useful medium for investigating questions involving the expression of emotion. Likewise, movements and gestures, such as dance, can also communicate specific emotions to human observers. We apply an efficient, causal technique for estimating the emotions (mood) from music audio to enable a humanoid to perform gestures reflecting the musical mood. We implement this system using Hubo, an adult-sized humanoid that has been used in several applications of musical robotics. Our preliminary experiments indicate that the system is able to produce dancelike gestures that are judged by human observers to match the perceived emotion of the music.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Affective gesturing with music mood recognition

Grunberg

Batula

Schmidt

et al. 2012

2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012)

Self Cite

View full text Add to dashboard Cite

show abstract

“…Ye et al developed co-play algorithm to play a vibraphone [10] and Takuma et al developed two-level synchronization algorithm for coplay [11]. Moreover, Youngmoo et al developed a humanoid for musical interaction [12]. Takeshi et al investigated human-robot ensemble with a humanoid thereminist [13], and developed an algorithm for gesture recognition and beat tracking [14].…”

Section: Introductionmentioning

confidence: 99%

Drum stroke variation using Variable Stiffness Actuators

Kim

Garabini

Park

et al. 2014

2014 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

One interesting field of robotics technology is related to the entertainment industry. Performing a musical piece using a robot is a difficult task because music presents many features like melody, rhythm, tone, harmony and so on. Addressing these tasks with a robot is not trivial to implement. Most of approaches which related to this specific field lacks of quality to perform in front of human audience. Implementation of human-like motions can not be properly achieved with a conventional robot actuator. Consequently, we exploit a new type of actuator which simplifies the drawbacks of a conventional one. We used Variable Stiffness Actuator(VSA) instead of using conventional actuator. We can control position, force, and stiffness, simultaneously by using VSA. The most important novel feature is its controllable stiffness. When the stiffness of the actuator is changed, the characteristics of the actuator's response also changes. We implemented the specific stroke which is called "double stroke" using one of variable stiffness actuator. Although the double stroke is known as a special stroke which could be performed by human only, double stroke is successfully implemented by stiffness variation.

show abstract

“…We have performed substantial prior work on enabling robots to step or dance in response to music (Grunberg, Lofaro, Oh, & Kim, 2011;Kim et al, 2010). These performances, however, only considered the beat locations and tempo of the audio, and disregarded other aspects.…”

Section: Introductionmentioning

confidence: 99%

Synthetic Emotions for Humanoids

Grunberg

Batula

Schmidt

et al. 2012

International Journal of Synthetic Emotions

Self Cite

View full text Add to dashboard Cite

The recognition and display of synthetic emotions in humanoid robots is a critical attribute for facilitating natural human-robot interaction. The authors utilize an efficient algorithm to estimate the mood in acoustic music, and then use the results of that algorithm to drive movement generation systems to provide motions for the robot that are suitable for the music. This system is evaluated on multiple sets of humanoid robots to determine if the choice of robot platform or number of robots influences the perceived emotional content of the motions. Their tests verify that the authors’ system can accurately identify the emotional content of acoustic music and produce motions that convey a similar emotion to that in the audio. They also determine the perceptual effects of using different sized or different numbers of robots in the motion performances.

show abstract

Enabling humanoid musical interaction and performance

Abstract: ABSTRACT

Cited by 8 publications

References 11 publications

Affective gesturing with music mood recognition

Affective gesturing with music mood recognition

Drum stroke variation using Variable Stiffness Actuators

Synthetic Emotions for Humanoids

Contact Info

Product

Resources

About