Recognizing intuitive pre-defined gestures for cultural specific interactions: An image-based approach

Abstract

Abstract-Hands-free gaming systems are likely to gain, in the near future, the total share of the electronic gaming market. Such process has been anticipated by the introduction of the Nintendo Wii that, within a few months from its launch, stably reached the top ranking of sales among gaming systems. We can expect something similar will occur once the for-long expected Microsoft Kinect system will be available on the shelves of computer gaming stores. In general, it is clear from this sequence of events, that the opportunity of playing a game naturally, performing the same movements that would be made in a real setting, has a magnetic effect on customers. What, instead, is less evident is the great wealth of research that has been performed in the recent years to reach such result. In fact, behind the development of such gaming platforms strenuous research efforts have been made in a number of areas, which include and are not limited to hand following techniques and gesture recognition algorithms. As a beneficial side effect, the development of these areas can also play an important role in a number of other applications, including technical and artistic interactive exhibitions. In this paper we will describe the process that led us to devise a novel hand following and an innovative gesture recognition technique that both can easily be applied to exhibition scenarios (e.g., museums, fairs, etc.) and in general all those performing events where a pre-defined set of gestures are needed to enjoy a cultural experience, as they can be easily jointly put to good use to recognize a predefined set of movements. Our algorithms are robust and easy to implement, for this reason they are particularly suited for exhibition scenarios where stands can often change or adapted to new requirements.

On the design and player satisfaction evaluation of an immersive gestural game

“…We have specifically reported on a real case study of a food game (termed the Tortellino X-Perience) we developed, which has been publicly enjoyed by over one hundred players at the Shanghai 2010 World Expo [1,6,8]. We feel that our work brings an important contribution to the DOC (Design Of Communication) field, as our techniques can be generally expoited to provide a support to all those performing events to be enjoyed publicly, where a predefined set of gestures need to be automatically recognized.…”

Development of a Biomechatronic Device for Motion Analysis Through a RGB-D Camera

“…This map is normally obtained through a stereovision system but the Kinect is not such a system as it is equipped only with a color camera, a depth camera, and an infrared emitter. [9][10] The solution adopted was that the infrared emitter projects a large number of light spots into the environment whose distribution, at first sight, seems random. The emitted pattern is visible by turning off the lights and framing the environment with a digital camera.…”

Low-cost, High-capability, Embedded Systems for Education and Research: A Toolbox for the Microsoft Kinect

“…Early applications are largely focused on a stationary sensor detecting and/or tracking object motion in 3 dimensions, and include articulated skeleton tracking for improved human control of robots, hand gesture recognition, and 3D virtual environment construction. Recent publications include [10][11][12].…”