Detection and Localisation of Pointing, Pairing and Grouping Gestures for Brainstorming Meeting Applications

Pointing, Pairing and Grouping Gesture Recognition in Virtual Reality

“…Our work builds upon the work from Liechti et al [9] who detected and distinguished three different gestures on a whiteboard: pointing, pairing, and grouping. While this work proved that a distinction of deictic gestures based on tracking signals is in general possible, the accuracy was rather low.…”

“…A first approach was introduced by Kunz et al [8] who detected pointing gestures on artifacts on a horizontal workspace. Later, pointing gestures on artifacts on a vertical screen were detected using an Microsoft Kinect depth cam [2], and recently an HTC Vive tracking system was used to track hand gestures and to distinguish them into pointing, pairing, and grouping as the most relevant ones for referring to objects (cards) on a whiteboard [9].…”

“…Instead, a tracker was attached to the user's head, while the other was attached to the user's wrist. Unlike in [9], the virtual pointing ray is thus calculated from the user's eye position (the top of the head minus an offset) and the user's hand, which eventually is the more precise approach.…”

“…To test and compare the improvements of our algorithm compared to [9], we designed our experiment in the following manner. First, we gave a short introduction to the participants and collected the data obtained from the initial questionnaires.…”

Accessibility of Co-Located Meetings

“…While also for gesture detection and interpretation deep learning approaches exist, they are not applicable to referring gestures, e.g., on artifacts on a whiteboard, since here also the environment has to be taken into account. In particular for pointing gestures on a whiteboard's content, a high accuracy in detecting them is required to precisely display the corresponding artifact's content to the blind and visually impaired person [1,8]. However, the precision relies on various factors such as pointing accuracy, tracking accuracy, amount and position of artifacts on the whiteboard, etc.…”