Lightmyography Based Decoding of Human Intention Using Temporal Multi-Channel Transformers

Godoy, Ricardo V.; Dwivedi, Anany; Shahmohammadi, Mojtaba; Liarokapis, Minas

doi:10.1109/iros47612.2022.9981514

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

2025

Publication Types

Select...

Article3

Other1

Relationship

Self Cite1

Independent3

Authors

Journals

Cited by 4 publications

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Transformers in biosignal analysis: A review

Anwar,

Khalifa,

Coyle

et al. 2025

Information Fusion

View full text Add to dashboard Cite

Transformers in biosignal analysis: A review

Anwar,

Khalifa,

Coyle

et al. 2025

Information Fusion

View full text Add to dashboard Cite

On lightmyography based muscle-machine interfaces for the efficient decoding of human gestures and forces

Shahmohammadi

Guan

Godoy

et al. 2023

Sci Rep

Self Cite

View full text Add to dashboard Cite

Conventional muscle-machine interfaces like Electromyography (EMG), have significant drawbacks, such as crosstalk, a non-linear relationship between the signal and the corresponding motion, and increased signal processing requirements. In this work, we introduce a new muscle-machine interfacing technique called lightmyography (LMG), that can be used to efficiently decode human hand gestures, motion, and forces from the detected contractions of the human muscles. LMG utilizes light propagation through elastic media and human tissue, measuring changes in light luminosity to detect muscle movement. Similar to forcemyography, LMG infers muscular contractions through tissue deformation and skin displacements. In this study, we look at how different characteristics of the light source and silicone medium affect the performance of LMG and we compare LMG and EMG based gesture decoding using various machine learning techniques. To do that, we design an armband equipped with five LMG modules, and we use it to collect the required LMG data. Three different machine learning methods are employed: Random Forests, Convolutional Neural Networks, and Temporal Multi-Channel Vision Transformers. The system has also been efficiently used in decoding the forces exerted during power grasping. The results demonstrate that LMG outperforms EMG for most methods and subjects.

show abstract