Context-aware sensor-doll as a music expression device

Yonezawa, Tomoko; Clarkson, Brian; Yasumura, Michiaki; Mase, Kenji

doi:10.1145/634067.634249

Cited by 17 publications

(7 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Freely downloadable libraries are constantly developed to interface these sensors with computers [9]. Finally, visual programming languages like Max/MSP are an accessible possibility for project developers with little or no programming experience [4,5,11]. …”

Section: Introductionmentioning

confidence: 99%

“…In particular, sensing for sound manipulation purposes has proven critical in developing new musical interfaces and means of expression [5,27,30,31]. Sensory technologies and computational power have enabled the development of virtual musical instruments and augmented reality environments [6,10,11,32]. Unfortunately, almost all auditory interaction technologies developed until now have focused on humans as potential users.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Primate Drum Kit: A System for Studying Acoustic Pattern Production by Non-Human Primates Using Acceleration and Strain Sensors

Ravignani

Olivera

Gingras

et al. 2013

Sensors

View full text Add to dashboard Cite

The possibility of achieving experimentally controlled, non-vocal acoustic production in non-human primates is a key step to enable the testing of a number of hypotheses on primate behavior and cognition. However, no device or solution is currently available, with the use of sensors in non-human animals being almost exclusively devoted to applications in food industry and animal surveillance. Specifically, no device exists which simultaneously allows: (i) spontaneous production of sound or music by non-human animals via object manipulation, (ii) systematical recording of data sensed from these movements, (iii) the possibility to alter the acoustic feedback properties of the object using remote control. We present two prototypes we developed for application with chimpanzees (Pan troglodytes) which, while fulfilling the aforementioned requirements, allow to arbitrarily associate sounds to physical object movements. The prototypes differ in sensing technology, costs, intended use and construction requirements. One prototype uses four piezoelectric elements embedded between layers of Plexiglas and foam. Strain data is sent to a computer running Python through an Arduino board. A second prototype consists in a modified Wii Remote contained in a gum toy. Acceleration data is sent via Bluetooth to a computer running Max/MSP. We successfully pilot tested the first device with a group of chimpanzees. We foresee using these devices for a range of cognitive experiments.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Primate Drum Kit: A System for Studying Acoustic Pattern Production by Non-Human Primates Using Acceleration and Strain Sensors

Ravignani

Olivera

Gingras

et al. 2013

Sensors

View full text Add to dashboard Cite

show abstract

“…Yonezawa et al made an interactive plush toy by equipping it with seven types of sensors (bend sensor, microphone, etc.) [28]. They have also created an application to be used with this toy that composes music on the basis of the intensity and frequency of interaction.…”

Section: Plush Toy Interfacesmentioning

confidence: 99%

Detecting shape deformation of soft objects using directional photoreflectivity measurement

Sugiura

Kakehi

Withana

et al. 2011

Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

We present the FuwaFuwa sensor module, a round, handsize, wireless device for measuring the shape deformations of soft objects such as cushions and plush toys. It can be embedded in typical soft objects in the household without complex installation procedures and without spoiling the softness of the object because it requires no physical connection. Six LEDs in the module emit IR light in six orthogonal directions, and six corresponding photosensors measure the reflected light energy. One can easily convert almost any soft object into a touch-input device that can detect both touch position and surface displacement by embedding multiple FuwaFuwa sensor modules in the object. A variety of example applications illustrate the utility of the FuwaFuwa sensor module. An evaluation of the proposed deformation measurement technique confirms its effectiveness.ACM Classification: H5.m. Information interfaces and presentation (e.g., HCI): Miscellaneous.

show abstract

“…Also our major concern is to give an elegant look to the physical embodiment rather than the metallic view of robots. Similar to our work is the sensor doll built by Yonezawa et al [18]. The doll is augmented with multimodal interface and can react to external stimuli by playing music.…”

Section: Related Workmentioning

confidence: 99%