Octree segmentation based calling gesture recognition for elderly care robot

Abstract

This paper presents a method of calling gesture recognition by isolating the head and hand of a caller based on octree segmentation. The recognition of calling gestures is designed here mainly for elderly to call a service robot for their service request. A big challenge to solve is how to make the calling gesture recognition work in a complex environment with crowded people, cluttered and randomly moving objects, as well as illumination variations. The approach taken here is to segment out individual people from the 3D point cloud acquired by Microsoft Kinect or ASUS Xtion Pro and detect their heads and hands in certain geometric configurations. The segmentation is done fast by representing the 3D point cloud in octree cells and clustering those octree cells connected by the neighborhood relationship. The head and hand in a certain geometric configuration are identified from the candidate regions defined with a segmented object and by detecting the shape and color evidences. Color model in HSV color space also discussed to well define the skin color model. The proposed method has been implemented and tested on "HomeMate," a service robot developed for elderly care. The result of performance evaluation is given.

MobiKa - Low-Cost Mobile Robot for Human-Robot Interaction

“…cameras and laser scanner, a mobile base and sometimes a pair of arms. Care-O-bot [13], Homemate [26] and PR2, Toyota HSR [25] and TIAGo [5] are good examples of fully capable service robots. They can fetch and carry objects for people, navigate autonomously indoor, perceive a person with their cameras and approach them for interaction.…”

Kinect based calling gesture recognition for taking order service of elderly care robot

“…Proposed calling gesture recognition, used in the above taking order scenario, includes two modes: 1) Kinect skeleton based gesture recognition approach: in this procedure, user segments and skeleton information is generated by Microsoft Kinect, a verification process of Haar like feature based face detection is applied on each skeleton, and several calling gestures are defined for natural using; 2) Octree segmentation based calling gesture recognition [11] which is used as supplementary. In the following section, we will state the problems of using Microsoft Kinect skeleton based gesture recognition, and explain how our proposed algorithms provides an active solution to these problems.…”