A Real-Time Calibration Method of Kinect Recognition Range Extension for Media Art

Abstract

Kinect is a device that has been widely used in many areas since it was released in 2010. Kinect SDK was announced in 2011 and used in many other areas than its original purpose, which was a controller for gaming. In particular, it has been used by a number of artists in digital media art since it is inexpensive and has a fast recognition rate. However, there is a problem. Kinect create 3D coordinates with a single 2D RGB image for x, y value - single depth image for z value. And this creates a significant limitation on the installation for interactivity of media art. Because the Cartesian XY coordinate and the spherical Z coordinate system are used in combination, depth error depending on the distance is generated, which makes real-time rotation recognition and coordinate correction difficult above coordinate system. This paper proposes a real-time calibration method of Kinect recognition range expansion for useful application in the digital media art area. The proposed method can recognize the viewer accurately by calibrating a coordinate in any direction in front of the viewer. 3,400 datasets witch acquire from experiment were measured as five stances: the 1m attention stance, 1m hands-up stance, 2m attention stance, 2m hands-up stance, and 2m hands-half-up stance, which were taken and recorded every 0.5 sec. The experimental results showed that the accuracy rate was improved about 11.5% compared with front measurement data according to Kinect reference installation method.

Color Interactive Contents System using Kinect Camera Calibration

“…Introduction Recently, various real-time interactive works have been increasing as exhibitions in the development of fusion art [1][2][3][4][5]. Especially in the interactive media art exhibition space, various digital contents are being rapidly developed based on digital technology [3].…”

“…The Microsoft Kinect has been recognized as the most well-implemented and applied device for realizing a gesture interface using human tracking as a new input device. The production of Kinect was suspended from October 2017, but the core technology RGB single-depth motion capture has been utilized in the Microsoft HoloLens [5]. The Kinect sensor uses the Kinect V2 library to analyze and recognize people with an algorithm of a total of 25 skeleton joint points [6].…”