Surface electromyography (sEMG) has been the predominant method for sensing electrical activity for a number of applications involving muscle-computer interfaces, including myoelectric control of prostheses and rehabilitation robots. Ultrasound imaging for sensing mechanical deformation of functional muscle compartments can overcome several limitations of sEMG, including the inability to differentiate between deep contiguous muscle compartments, low signal-to-noise ratio, and lack of a robust graded signal. The objective of this study was to evaluate the feasibility of real-time graded control using a computationally efficient method to differentiate between complex hand motions based on ultrasound imaging of forearm muscles. Dynamic ultrasound images of the forearm muscles were obtained from six able-bodied volunteers and analyzed to map muscle activity based on the deformation of the contracting muscles during different hand motions. Each participant performed 15 different hand motions, including digit flexion, different grips (i.e., power grasp and pinch grip), and grips in combination with wrist pronation. During the training phase, we generated a database of activity patterns corresponding to different hand motions for each participant. During the testing phase, novel activity patterns were classified using a nearest neighbor classification algorithm based on that database. The average classification accuracy was 91%. Real-time image-based control of a virtual hand showed an average classification accuracy of 92%. Our results demonstrate the feasibility of using ultrasound imaging as a robust muscle-computer interface. Potential clinical applications include control of multiarticulated prosthetic hands, stroke rehabilitation, and fundamental investigations of motor control and biomechanics.

Technological advances in multi-articulated prosthetic hands have outpaced the development of methods to intuitively control these devices. In fact, prosthetic users often cite "difficulty of use" as a key contributing factor for abandoning their prostheses. To overcome the limitations of the currently pervasive myoelectric control strategies, namely unintuitive proportional control of multiple degrees-of-freedom, we propose a novel approach: proprioceptive sonomyographic control . Unlike myoelectric control strategies which measure electrical activation of muscles and use the extracted signals to determine the velocity of an end-effector; our sonomyography-based strategy measures mechanical muscle deformation directly with ultrasound and uses the extracted signals to proportionally control the position of an end-effector. Therefore, our sonomyography-based control is congruent with a prosthetic user’s innate proprioception of muscle deformation in the residual limb. In this work, we evaluated proprioceptive sonomyographic control with 5 prosthetic users and 5 able-bodied participants in a virtual target achievement and holding task for 5 different hand motions. We observed that with limited training, the performance of prosthetic users was comparable to that of able-bodied participants and thus conclude that proprioceptive sonomyographic control is a robust and intuitive prosthetic control strategy.

The objectives of this paper are to determine the optimal location for ultrasound transducer placement on the anterior forearm for imaging maximum muscle deformations during different hand motions and to investigate the effect of using a sparse set of ultrasound scanlines for motion classification for ultrasoundbased muscle computer interfaces (MCIs). Methods: The optimal placement of the ultrasound transducer along the forearm is identified using freehand 3D reconstructions of the muscle thickness during rest and motion completion. From the ultrasound images acquired from the optimally placed transducer, we determine classification accuracy with equally spaced scanlines across the cross-sectional field-of-view (FOV). Furthermore, we investigated the unique contribution of each scanline to class discrimination using Fisher criteria (FC) and mutual information (MI) with respect to motion discriminability. Results: Experiments with 5 able-bodied subjects show that the maximum muscle deformation occurred between 30-50% of the forearm length for multiple degrees-offreedom. The average classification accuracy was 94±6% with the entire 128 scanline image and 94±5% with 4 equally-spaced scanlines. However, no significant improvement in classification accuracy was observed with optimal scanline selection using FC and MI. Conclusion: For an optimally placed transducer, a small subset of ultrasound scanlines can be used instead of a full imaging array without sacrificing performance in terms of classification accuracy for multiple degrees-of-freedom. Significance: The selection of a small subset of transducer elements can enable the reduction of computation, and simplification of the instrumentation and power consumption of wearable sonomyographic MCIs particularly for rehabilitation and gesture recognition applications.

As photoacoustic imaging (PAI) technology matures, computational modeling will increasingly represent a critical tool for facilitating clinical translation through predictive simulation of real-world performance under a wide range of device and biological conditions. While modeling currently offers a rapid, inexpensive tool for device development and prediction of fundamental image quality metrics (e.g., spatial resolution and contrast ratio), rigorous verification and validation will be required of models used to provide regulatory-grade data that effectively complements and/or replaces in vivo testing. To address methods for establishing model credibility, we developed an integrated computational model of PAI by coupling a previously developed three-dimensional Monte Carlo model of tissue light transport with a two-dimensional (2D) acoustic wave propagation model implemented in the well-known k-Wave toolbox. We then evaluated ability of the model to predict basic image quality metrics by applying standardized verification and validation principles for computational models. The model was verified against published simulation data and validated against phantom experiments using a custom PAI system. Furthermore, we used the model to conduct a parametric study of optical and acoustic design parameters. Results suggest that computationally economical 2D acoustic models can adequately predict spatial resolution, but metrics such as signal-to-noise ratio and penetration depth were difficult to replicate due to challenges in modeling strong clutter observed in experimental images. Parametric studies provided quantitative insight into complex relationships between transducer characteristics and image quality as well as optimal selection of optical beam geometry to ensure adequate image uniformity. Multidomain PAI simulation tools provide high-quality tools to aid device development and prediction of real-world performance, but further work is needed to improve model fidelity, especially in reproducing image noise and clutter.