Toyota's violin‐playing robot

Kusuda, Yoshihiro

doi:10.1108/01439910810909493

Cited by 35 publications

(15 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Instead of using movements exclusively to play notes, the Shimon marimba playing robot [1] performs expressive gestures like head-bobbing to add humanness to its performance. Humanoid violin and trumpet robots from Toyota shift weight from one leg to the other, raising and lowering their instruments [13]. To summarize, no experiments have yet been conducted to assess the emotional communication between music robots and humans.…”

Section: Related Workmentioning

confidence: 99%

Towards expressive musical robots: a cross-modal framework for emotional gesture, voice and music

Lim

Ogata

Okuno

2012

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

It has been long speculated that expression of emotions from different modalities have the same underlying 'code', whether it be a dance step, musical phrase, or tone of voice. This is the first attempt to implement this theory across three modalities, inspired by the polyvalence and repeatability of robotics. We propose a unifying framework to generate emotions across voice, gesture, and music, by representing emotional states as a 4-parameter tuple of speed, intensity, regularity, and extent (SIRE). Our results show that a simple 4-tuple can capture four emotions recognizable at greater than chance across gesture and voice, and at least two emotions across all three modalities. An application for multi-modal, expressive music robots is discussed.

show abstract

Section: Related Workmentioning

confidence: 99%

Towards expressive musical robots: a cross-modal framework for emotional gesture, voice and music

Lim

Ogata

Okuno

2012

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

show abstract

“…The hardware exists already. State-of-the-art humanoid robots such as the NASA/GM Robonaut 2 (Diftler et al, 2011), the Willow Garage Personal Robot 2 (http://www.willowgarage.com), the iCub from the Italian Institute of Technology (IIT) (Metta et al, 2008), and Toyota's Partner Robots (Takagi, 2006;Kusuda, 2008) are impressive machines with many degrees of freedom (DOFs). Physically speaking, they should be capable of doing a much wider variety of jobs than their industrial ancestors.…”

Section: Introductionmentioning

confidence: 99%

REFLEXIVE COLLISION RESPONSE WITH VIRTUAL SKIN - Roadmap Planning Meets Reinforcement Learning

Frank¹,

Förster²,

Schmidhuber³

2011

Proceedings of the 4th International Conference on Agents and Artificial Intelligence

View full text Add to dashboard Cite

Abstract:Prevalent approaches to motion synthesis for complex robots offer either the ability to build up knowledge of feasible actions through exploration, or the ability to react to a changing environment, but not both. This work proposes a simple integration of roadmap planning with reflexive collision response, which allows the roadmap representation to be transformed into a Markov Decision Process. Consequently, roadmap planning is extended to changing environments, and the adaptation of the map can be phrased as a reinforcement learning problem. An implementation of the reflexive collision response is provided, such that the reinforcement learning problem can be studied in an applied setting. The feasibility of the software is analyzed in terms of runtime performance, and its functionality is demonstrated on the iCub humanoid robot.

show abstract

“…Even people who do not speak a common language can share a friendly and joyful time through music not withstanding age, region, and race that we belong to. Music robots can be classified into two categories; entertainment-oriented robots like the violinist robot [1] exhibited in the Japanese booth at Shanghai Expo or dancer robots, and coplayer robots for natural interaction. Although the former category has been studied extensively, our research aims at the latter category, that is, a robot capable of musical expressiveness in harmony with humans.…”

Section: Introductionmentioning

confidence: 99%

Real-Time Audio-to-Score Alignment Using Particle Filter for Coplayer Music Robots

Otsuka

Nakadai

Takahashi

et al. 2010

EURASIP J. Adv. Signal Process.

View full text Add to dashboard Cite

Our goal is to develop a coplayer music robot capable of presenting a musical expression together with humans. Although many instrument-performing robots exist, they may have difficulty playing with human performers due to the lack of the synchronization function. The robot has to follow differences in humans' performance such as temporal fluctuations to play with human performers. We classify synchronization and musical expression into two levels: (1) melody level and (2) rhythm level to cope with erroneous synchronizations. The idea is as follows: When the synchronization with the melody is reliable, respond to the pitch the robot hears, when the synchronization is uncertain, try to follow the rhythm of the music. Our method estimates the score position for the melody level and the tempo for the rhythm level. The reliability of the score position estimation is extracted from the probability distribution of the score position. The experimental results demonstrate that our method outperforms the existing score following system in 16 songs out of 20 polyphonic songs. The error in the prediction of the score position is reduced by 69% on average. The results also revealed that the switching mechanism alleviates the error in the estimation of the score position.

show abstract

Toyota's violin‐playing robot

Cited by 35 publications

References 0 publications

Towards expressive musical robots: a cross-modal framework for emotional gesture, voice and music

Towards expressive musical robots: a cross-modal framework for emotional gesture, voice and music

REFLEXIVE COLLISION RESPONSE WITH VIRTUAL SKIN - Roadmap Planning Meets Reinforcement Learning

Real-Time Audio-to-Score Alignment Using Particle Filter for Coplayer Music Robots

Contact Info

Product

Resources

About