Gesture interaction algorithm based on navigation information

Abstract

Selection and manipulation are one of the fundamental aspects of gesture interaction. Selection is the precondition of gesture interaction. Collision detection is a key step in the gesture operation, which determines the reality and immersion of gesture interaction. However, the current related approach lack of a unified interaction model, thus it is difficult to fundamentally improve the user experience. In this paper, it is the application of navigation information to guide the object selection and collision detection. This paper obtains the navigation information of object selection and collision detection by cognitive information including the historical data of 3D hand, the hand and the object state information and the relative relationship between the hand and object, and uses the navigation information to guide the operator to carry out the next step operation. The main innovation is the establishment of a unified interaction model which is based cognitive information, and the correlation algorithm is proposed and implemented. The experimental results show that, the algorithm described in this paper not only reduce the time cost of object selection and collision detection, but also enhance the user's sense of immersion and allow users to operate more comfortable and enjoyable.