Development of Surface EMG Game Control Interface for Persons with Upper Limb Functional Impairments

Abstract

In recent years, surface Electromyography (sEMG) signals have been effectively applied in various fields such as control interfaces, prosthetics, and rehabilitation. We propose a neck rotation estimation from EMG and apply the signal estimate as a game control interface that can be used by people with disabilities or patients with functional impairment of the upper limb. This paper utilizes an equation estimation and a machine learning model to translate the signals into corresponding neck rotations. For testing, we designed two custom-made game scenes, a dynamic 1D object interception and a 2D maze scenery, in Unity 3D to be controlled by sEMG signal in real-time. Twenty-two (22) test subjects (mean age 27.95, std 13.24) participated in the experiment to verify the usability of the interface. From object interception, subjects reported stable control inferred from intercepted objects more than 73% accurately. In a 2D maze, a comparison of male and female subjects reported a completion time of 98.84 s. ± 50.2 and 112.75 s. ± 44.2, respectively, without a significant difference in the mean of the one-way ANOVA (p = 0.519). The results confirmed the usefulness of neck sEMG of sternocleidomastoid (SCM) as a control interface with little or no calibration required. Control models using equations indicate intuitive direction and speed control, while machine learning schemes offer a more stable directional control. Control interfaces can be applied in several areas that involve neck activities, e.g., robot control and rehabilitation, as well as game interfaces, to enable entertainment for people with disabilities.

Touchless Head-Control (THC): Head Gesture Recognition for Cursor and Orientation Control

“…Individual limitations in motion constraints were not considered in the current analysis method. In the future, THC could be equipped with a combination of IMUs and We have demonstrated the ability of the proposed method, THC 1,2 , to control the cursor and object orientation using head movements under various demanding conditions. In the video, the controls are moved slowly to mimic the movements of people with motor limitations.…”

“…uman-computer interaction (HCI) has advanced recently, making computers more accessible to persons with the restricted motor ability [1,2]. Previous studies have developed various devices to assist disabled people using gestures and other non-contact techniques [3,4].…”

Design and Analysis of an Upper Limb Rehabilitation Robot Based on Multimodal Control

“…Since sEMG is non-invasive, rapid, and convenient, it is commonly used in rehabilitation medicine to evaluate muscle function recovery. The field of prosthetic control is also based on sEMG, which is used for motion recognition and classification to control the movement of prostheses according to the patient's intention [33][34][35].…”

Development of a Virtual Environment-Based Electrooculogram Control System for Safe Electric Wheelchair Mobility for Individuals with Severe Physical Disabilities

“…The reason for this is due to their availability and ease of acquisition. Some of the bio-signals that are typically used as an interface between machines and humans include the Electrooculogram (EOG) [13]- [16] Electroencephalogram (EEG) [5], [17]- [19] and the electromyogram (EMG) signal [18], [20]- [24]. Electrooculography (EOG) is a method of measuring the eyes' resting potential.…”