Neurophysiological Evaluation of Haptic Feedback for Myoelectric Prostheses

Thomas, Neha; Ung, Garrett; Ayaz, Hasan; Brown, Jeremy D.

doi:10.1109/thms.2021.3066856

Cited by 17 publications

(27 citation statements)

References 53 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Despite the reported benefits of haptic feedback in dexterous task performance and mental effort reduction 22,54,55 , vibrotactile feedback alone was not able to significantly improve lifting ability and neural efficiency compared to Standard control in this study. These results agree with findings from previous investigations on the effect of haptic feedback on grasp-and-lift of a brittle object 41,42 .…”

Section: Discussioncontrasting

confidence: 83%

“…It has been shown to produce similar results as the brain imaging gold standard, fMRI 44,45 , and has been demonstrated in numerous prior studies [46][47][48][49] . Furthermore, we have previously used fNIRS to successfully assess the effect of a myoelectric prosthesis featuring vibrotactile feedback on cognitive load in a stiffness discrimination task 22 . A four-optode fNIRS imager (Model 1100W; fNIR Devices, LLC) was used to measure hemodynamic activity from four regions of the prefrontal cortex.…”

Section: Non-invasive Brain Imagingmentioning

confidence: 99%

“…In the simplest myoelectric scheme, direct control, the amount of electrical activity from an agonist-antagonist muscle pair is used to control a single degreeof-freedom prosthesis terminal device. The inherent delay between the user's interpretation of the haptic feedback and the subsequent myoelectric command could render volitional movement too slow 20 , as well as cognitively demanding 21,22 .…”

Section: Introductionmentioning

confidence: 99%

“…Moreover, in addition to task performance, we also assess participants' cognitive load during task execution using functional near infrared spectroscopy (fNIRS), a noninvasive optical brain-imaging technique 38 . This experiment builds from two previous investigations where we separately evaluated the cognitive load associated with haptic feedback during prosthesis use 22 and the task performance utility of a haptic shared control scheme 39 Here, we employ the same neurophysiological measurements to provide a holistic understanding of performance and mental effort required to achieve that performance, i.e., neural efficiency 40 . We hypothesize that haptic shared control will result in the highest neural efficiency compared to the standard prosthesis, followed by the prosthesis featuring vibrotactile feedback of grip force.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Haptic Shared Control Improves Neural Efficiency During Myoelectric Prosthesis Use

Thomas,

Miller,

Ayaz

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

Clinical myoelectric prostheses lack the sensory feedback and sufficient dexterity required to complete activities of daily living efficiently and accurately. Providing haptic feedback of relevant environmental cues to the user or imbuing the prosthesis with autonomous control authority have been separately shown to improve prosthesis utility. Few studies, however, have investigated the effect of combining these two approaches in a shared control paradigm, and none have evaluated such an approach from the perspective of neural efficiency (the relationship between task performance and mental effort measured directly from the brain). In this work, we analyzed the neural efficiency of 30 non-amputee participants in a grasp-and-lift task of a brittle object. Here, a myoelectric prosthesis featuring vibrotactile feedback of grip force and autonomous control of grasping was compared with a standard myoelectric prosthesis with and without vibrotactile feedback. As a measure of mental effort, we captured the prefrontal cortex activity changes using functional near infrared spectroscopy during the experiment. Results showed that only the haptic shared control system enabled users to achieve high neural efficiency, and that vibrotactile feedback was important for grasping with the appropriate grip force. These results indicate that the haptic shared control system synergistically combines the benefits of haptic feedback and autonomous controllers, and is well-poised to inform such hybrid advancements in myoelectric prosthesis technology.

show abstract

Section: Discussioncontrasting

confidence: 83%

Section: Non-invasive Brain Imagingmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Haptic Shared Control Improves Neural Efficiency During Myoelectric Prosthesis Use

Thomas,

Miller,

Ayaz

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…Instead, they must rely heavily on vision to complete activities of daily living [7], [8]. This visual dependency is not only cognitively burdensome [9], but it also significantly limits manipulation abilities in activities where vision is constrained or unavailable (e.g., watching a screen, searching for an object in the dark). Thus, in order for an amputee to dexterously accomplish a reach-to-grasp-and-lift task with their prosthesis in the absence of vision, the prosthesis must support volitional and reflexive control in a manner consonant with the intact sensorimotor system.…”

Section: Introductionmentioning

confidence: 99%

The Utility of Synthetic Reflexes and Haptic Feedback for Upper-Limb Prostheses in a Dexterous Task Without Direct Vision

Thomas,

Fazlollahi,

Kuchenbecker

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

Individuals who use myoelectric upper-limb prostheses often rely heavily on vision to complete their daily activities. They thus struggle in situations where vision is overloaded, such as multitasking, or unavailable, such as poor lighting conditions. Non-amputees can easily accomplish such tasks due to tactile reflexes and haptic sensation guiding their upper-limb motor coordination. Based on these principles, we developed and tested two novel prosthesis systems that incorporate autonomous controllers and provide the user with touch-location feedback through either vibration or distributed pressure. These capabilities were made possible by installing a custom contact-location sensor on the fingers of a commercial prosthetic hand, along with a custom pressure sensor on the thumb. We compared the performance of the two systems against a standard myoelectric prosthesis and a myoelectric prosthesis with only autonomous controllers in a difficult reach-to-pick-and-place task conducted without direct vision. Results from 40 non-amputee participants in this betweensubjects study indicated that vibrotactile feedback combined with synthetic reflexes proved significantly more advantageous than the standard prosthesis in several of the task milestones. In addition, vibrotactile feedback and synthetic reflexes improved grasp placement compared to only synthetic reflexes or pressure feedback combined with synthetic reflexes. These results indicate that both autonomous controllers and haptic feedback facilitate success in dexterous tasks without vision, and that the type of haptic display matters.

show abstract

Effects of automated skill assessment on robotic surgery training

Brown

Kuchenbecker

2023

Robotics Computer Surgery

Self Cite

View full text Add to dashboard Cite

Background Several automated skill‐assessment approaches have been proposed for robotic surgery, but their utility is not well understood. This article investigates the effects of one machine‐learning‐based skill‐assessment approach on psychomotor skill development in robotic surgery training. Methods N = 29 trainees (medical students and residents) with no robotic surgery experience performed five trials of inanimate peg transfer with an Intuitive Surgical da Vinci Standard robot. Half of the participants received no post‐trial feedback. The other half received automatically calculated scores from five Global Evaluative Assessment of Robotic Skill domains post‐trial. Results There were no significant differences between the groups regarding overall improvement or skill improvement rate. However, participants who received post‐trial feedback rated their overall performance improvement significantly lower than participants who did not receive feedback. Conclusions These findings indicate that automated skill evaluation systems might improve trainee self‐awareness but not accelerate early stage psychomotor skill development in robotic surgery training.

show abstract

Neurophysiological Evaluation of Haptic Feedback for Myoelectric Prostheses

Cited by 17 publications

References 53 publications

Haptic Shared Control Improves Neural Efficiency During Myoelectric Prosthesis Use

Haptic Shared Control Improves Neural Efficiency During Myoelectric Prosthesis Use

The Utility of Synthetic Reflexes and Haptic Feedback for Upper-Limb Prostheses in a Dexterous Task Without Direct Vision

Effects of automated skill assessment on robotic surgery training

Contact Info

Product

Resources

About