Manipulator Trajectory Optimization Using Reinforcement Learning on a Reduced-Order Dynamic Model with Deep Neural Network Compensation

Abstract

This article reports the construction of an articulated manipulator’s hybrid dynamic model and trajectory planning and optimization of the manipulator using deep reinforcement learning (RL) on the dynamic model. The hybrid model was composed of a physical-based reduced-order dynamic model, linear friction and damping terms, and a deep neural network model to compensate for the nonlinear characteristics of the manipulator. The hybrid model then served as the digital twin of the manipulator for trajectory planning to optimize energy efficiency and operation speed by using RL while taking obstacle avoidance into consideration. The proposed strategy was simulated and experimentally validated. The energy consumption along paths was reduced and the speed was increased so the manipulator could achieve more efficient motion.

The Learning Trajectory Based on STEM of Elementary School Pupils’ in Solving Proportion Material: Didactical Design-Research

“…Using STEM-based learning media (Science, Technology, Engineering, and Mathematics) is appropriate for improving mathematical problem-solving skills. This learning media can provide students with a more interactive and enjoyable learning experience, increasing their motivation and interest in mathematics (Chen, 2023). STEM-based learning media is also highly effective in improving problem-solving skills, especially in learning ratios in elementary school mathematics.…”