Consistent, Continuous, and Customizable Mid-Air Gesture Interaction for Browsing Multimedia Objects on Large Displays

Analysis of User-Defined Radar-Based Hand Gestures Sensed Through Multiple Materials

“…One can memorize only a limited number of gestures, preferably user-defined: Nacenta et al [79] found that userdefined gestures are easier to remember, both immediately after creation and on the next day with a 24% difference in recall rate compared to pre-designed gestures. Sluÿters et al [57] reported also an excellent recall rate of a limited number of gestures when gestures were user-defined, even after one week. So, we wanted to select a limited number of classes from the user-defined gestures proposed in our three aforementioned studies.…”

“…The authors analyzed micro-gestures performed with the hands and fingers and sensed with a small radar, and compiled a consensus set of 19 gestures using the agreement rate measure. Sluÿters et al [57] conducted a multicontext GES for eliciting mid-air hand gestures to interact with multimedia content presented on a large display. The resulting vocabulary was transferred to the stage of gesture recognition to determine to what extent these user-defined gestures were also efficient as system-recognizable gestures.…”

FreeMapRetrieve: Freehand Gestures for Retrieve Operations in Large-Screen Map Environments

“…The gestures introduced in the previous section were implemented in the FreeMapRetrieve prototype using the Python programming language. Initial tests before implementing the prototype have shown that pyKinectAzure 1. drawing a line (Siddhpuria et al, 2017) 2. dragging (Nancel et al, 2011) 3. movement from a resting hand to a pointing hand (Fikkert et al, 2009) 4. one-hand grabbing gesture (Boulos et al, 2011) 5. move hand while pointing index (Sluÿters et al, 2023) 6. the joystick gesture (Stellmach et al, 2012) 7. one hand wipe (Bartoschek et al, 2014) 1. full-circle clock/anti-clockwise (Siddhpuria et al, 2017) 2. turning the hand clock/anticlockwise (Nancel et al, 2011), 3. movement from cupped hands to pointing hands (Fikkert et al, 2009) 4. two-hand grabbing gesture (Boulos et al, 2011) (also in virtual reality, see Newbury et al ( 2021))…”

“…5. pinch in/out (Sluÿters et al, 2023) 6. the hand-zoom gesture (Stellmach et al, 2012) 7. two hand spread (Bartoschek et al, 2014) 1. point (Walter et al, 2014;Yoo et al, 2015) 2. swipe (Walter et al, 2014) 3. push (Yoo et al, 2015;Hespanhol et al, 2012) 4. dwell (Hespanhol et al, 2012) 5. drawing a lasso (Hespanhol et al, 2012) 6. grab (Hespanhol et al, 2012) 1. dwell (Walter et al, 2014;Yoo et al, 2015) 2. swipe (Walter et al, 2014) 3. push (Walter et al, 2014) 4. point (Walter et al, 2014) 5. grip (Walter et al, 2014) 6. wave (Walter et al, 2014) 7. AirTap (Vogel and Balakrishnan, 2005) 8. thumb trigger (Vogel and Balakrishnan, 2005) Table 2.…”

“…By contrast, gesture performance evaluation studies, which provide insight into the cost and benefits of using a specific gesture for a given task (e.g. Sluÿters et al, 2023;Hatscher et al, 2017) seem less frequent, despite their necessity for a more thorough understanding of the adequacy of gestures for specific tasks. This work contributes a gesture performance evaluation study, which helps to learn about viable gesture combinations for Retrieve for map interaction on large displays.…”