As a contribution toward the goal of adaptable, intelligent artificial limbs, this work introduces a continuous actor-critic reinforcement learning method for optimizing the control of multi-function myoelectric devices. Using a simulated upper-arm robotic prosthesis, we demonstrate how it is possible to derive successful limb controllers from myoelectric data using only a sparse human-delivered training signal, without requiring detailed knowledge about the task domain. This reinforcement-based machine learning framework is well suited for use by both patients and clinical staff, and may be easily adapted to different application domains and the needs of individual amputees. To our knowledge, this is the first my-oelectric control approach that facilitates the online learning of new amputee-specific motions based only on a one-dimensional (scalar) feedback signal provided by the user of the prosthesis.

No abstract

SUMMARYThe purpose of this paper is to present a robust tracking control algorithm for underactuated biped robots capable of self-balancing in the presence of external disturbances. The biped is modeled as a five-link planar robot with four actuators located at hip and knee joints. A sliding mode control law has been developed for the biped to follow a human-like gait trajectory while keeping the torso nearly upright. The control forces are calculated by defining four first-order sliding surfaces as a linear combination of the torso and the four joint tracking errors. The control approach is shown to guarantee that all trajectories will reach and stay on these surfaces during each step, while the walking cycle stability is maintained through a Lyapunov function. The criteria for asymptotic stability of the surfaces are presented and a numerical search method is implemented for the selection of the corresponding surface parameters. The paper further investigates the robustness of the controller in response to disturbances. Numerical simulations demonstrate the tracking stability of the biped's multistep walk and its human-like response to an external disturbance.

SUMMARYAn efficient, simple, and practical real time path planning method for multiple mobile robots in dynamic environments is introduced. Harmonic potential functions are utilized along with the panel method known in fluid mechanics. First, a complement to the traditional panel method is introduced to generate a more effective harmonic potential field for obstacle avoidance in dynamically changing environments. Second, a group of mobile robots working in an environment containing stationary and moving obstacles is considered. Each robot is assigned to move from its current position to a goal position. The group is not forced to maintain a formation during the motion. Every robot considers the other robots of the group as moving obstacles and hence the physical dimensions of the robots are also taken into account. The path of each robot is planned based on the changing position of the other robots and the position of stationary and moving obstacles. Finally, the effectiveness of the scheme is shown by modeling an arbitrary number of mobile robots and the theory is validated by several computer simulations and hardware experiments.

This paper deals with the obstacle avoidance problem for spatial hyper-redundant manipulators in known environments. The manipulator is divided into two sections, a proximal section that has not entered the space among the obstacles and a distal section among the obstacles. Harmonic potential functions are employed to achieve obstacle avoidance for the distal section in three-dimensional space in order to avoid local minima in cluttered environments. A modified panel method is used to generate the potential of any arbitrary shaped obstacle in three-dimensional space. An alternative backbone curve concept and an efficient fitting method are introduced to control the trajectory of proximal links. The fitting method is recursive and avoids the complications involved with solving large systems of nonlinear algebraic equations. The combination of a three-dimensional safe path derived from the harmonic potential field and the backbone curve concept leads to an elegant kinematic control strategy that guarantees obstacle avoidance.