Bioinspired robotics takes advantage of biological systems in nature for morphology, action and perception to build advanced robots of compelling performance and wide application. This paper focuses on the design, modeling and control of a bioinspired robotic fish. The design utilizes a recently-developed artificial muscle named super coiled polymer for actuation and a soft material (silicone rubber) for building the robot body. The paper proposes a learning based speed control design approach for bioinspired robotic fish using model-free reinforcement learning. Based on a mathematically tractable dynamic model derived by approximating the robotic fish with a three-link robot, speed control simulation is conducted to demonstrate and validate the control design method. Exampled with a three-link reduced-order dynamic system, the proposed learning based control design approach is applicable to many and various complicated bioinspired robotic systems.

Super-coiled polymer (SCP), one of the newly-developed artificial muscles, has various advantages over traditional artificial muscles in terms of cost, flexibility and power-to-weight ratio. This paper investigates the performance of super-coiled polymer-based actuation in underwater robotics, and presents a novel design of robotic fish using antagonistic SCP actuators. Dynamic model of the robot is derived. An example robotic fish prototype is developed and used in experiments to study SCP actuation for underwater robots. Furthermore, experimental results show that using SCP actuators in robotic fish solves the challenging heat-dissipation problem at ease, thus improving the dynamic response of SCP actuation significantly. A PID controller is designed to regulate the tail flap angle of the designed robotic fish. Simulation results of the closed-loop system are presented to validate the proposed robot design and actuation approach.

A rapidly growing field of aquatic bio-inspired soft robotics takes advantage of the underwater animals’ bio-mechanisms, where its applications are foreseen in a vast domain such as underwater exploration, environmental monitoring, search and rescue, oil-spill detection, etc. Improved maneuverability and locomotion of such robots call for designs with higher level of biomimicry, reduced order of complex modeling due to continuum elastic dynamics, and challenging robust nonlinear controllers. This paper presents a novel design of a soft robotic fish actively actuated by a newly developed kind of artificial muscles—super-coiled polymers (SCP) and passively propelled by a caudal fin. Besides SCP exhibiting several advantages in terms of flexibility, cost and fabrication duration, this design benefits from the SCP’s significantly quicker recovery due to water-based cooling. The soft robotic fish is approximated as a 3-link representation and mathematically modeled from its geometric and dynamic perspectives to constitute the combined system dynamics of the SCP actuators and hydrodynamics of the fish, thus realizing two-dimensional fish-swimming motion. The nonlinear dynamic model of the SCP driven soft robotic fish, ignoring uncertainties and unmodeled dynamics, necessitates the development of robust/intelligent control which serves as the motivation to not only mimic the bio-mechanisms, but also mimic the cognitive abilities of a real fish. Therefore, a learning-based control design is proposed to meet the yaw control objective and study its performance in path following via various swimming patterns. The proposed learning-based control design employs the use of deep-deterministic policy gradient (DDPG) reinforcement learning algorithm to train the agent. To overcome the limitations of sensing the soft robotic fish’s states by designing complex embedded sensors, overhead image-based observations are generated and input to convolutional neural networks (CNNs) to deduce the curvature dynamics of the soft robot. A linear quadratic regulator (LQR) based multi-objective reward is proposed to reinforce the learning feedback of the agent during training. The DDPG-based control design is simulated and the corresponding results are presented.

Deficit of the extraocular muscle is known as a key cause of ocular motility disorders that affect eye movement and complicate daily activities of millions of people in the US. A physical model mimicking the biomechanics of the oculomotor plant can improve the understanding of functionality and control of extraocular muscles and provide a tool for researchers to gain insights into binocular misalignment. This paper will present, for the first time, the design and development of a robotic eye system driven by antagonistic super coiled polymer (SCP) based artificial muscles and the motion control design by leveraging machine learning techniques. The dynamic model of the robotic eye will be presented. Deep reinforcement learning is used for control design of the robotic eye system, demonstrated by simulation of one-dimensional foveation control.

With increasing ocular motility disorders affecting human eye movement, the need to understand the biomechanics of the human eye rises constantly. A robotic eye system that physically mimics the human eye can serve as a useful tool for biomedical researchers to obtain an intuitive understanding of the functions and defects of the extraocular muscles and the eye. This paper presents the design, modeling, and control of a two degree-of-freedom (2-DOF) robotic eye, driven by artificial muscles, in particular, made of super-coiled polymers (SCPs). Considering the highly nonlinear dynamics of the robotic eye system, this paper applies deep deterministic policy gradient (DDPG), a machine learning algorithm to solve the control design problem in foveation and smooth pursuit of the robotic eye. To the best of our knowledge, this paper presents the first modeling effort to establish the dynamics of a robotic eye driven by SCP actuators, as well as the first control design effort for robotic eyes using a DDPG-based control strategy. A linear quadratic regulator-type reward function is proposed to achieve a balance between system performances (convergence speed and tracking accuracy) and control efforts. Simulation results are presented to demonstrate the effectiveness of the proposed control strategy for the 2-DOF robotic eye.