This paper investigates how the perceived physicality of the action of applying force with a finger on a rigid surface (such as on a force-sensing touch screen) can be enhanced using real-time synthesized audio feedback. A selection of rich and evocative audio designs was used. Additionally, audio-tactile cross-modal integration was encouraged, by observing that the main rules of multisensory integration were supported. The study conducted showed that richness of perceived physicality increased considerably, mostly in its auditory expression (what pressing sounded like). In addition, in many instances it was observed that the haptic expression of physicality also increased (what pressing felt like), including some perception of compliance. This last result was particularly interesting as it showed that audio-tactile cross-modal integration might be present.

In this paper, we present the WanderOnStage project and its improvisational performance entitled Untitled #1, created with a focus to engage with the audience within the context of live percussion performance with electronics. This project is carried out with author's experiences of being a percussionist and media artist. The technical solution of WanderOnStage enables the performer to control real-time recording with arm and bodily movements. The wireless device also provides a theatrical potential by allowing the performer to move around freely in the performance space, join the audience as a listener, or motivate audience members to participate performing. This paper traces the design process over matter of concept development, relevant technology, interface design, and the configuration of the concert performance. In addition, the author's experience gained from the concert performance, which involved audience participation is also discussed as well as what has been learnt.

No abstract

No abstract