Optimal Path-Planning of Nonholonomic Terrain Robots for Dynamic Obstacle Avoidance Using Single-Time Velocity Estimator and Reinforcement Learning Approach

Abstract

A single-time velocity estimator-based reinforcement learning (RL) algorithm, integrated with a chaotic metaheuristic optimization technique is proposed in this article for the optimal path-planning of the nonholonomic robots considering a moving/stationary obstacle avoidance strategy. The additional contribution of the present study is by employing the Terramechanics principles to incorporate the effects of wheel sinkage into the deformable terrain on the dynamics of the robot aiming to find the optimal compensating force/torque magnitude to sustain a robust and smooth motion. The designed systematic control-oriented system incorporates a cost function of weighted components associated with the targettracking and the obstacle avoidance. The designed velocity estimator contributes to the finite-state Markov decision process (MDP) in order to train the transition probabilities of the problem objectives. Based on the obtained results, the optimal solution for the Q-learning in terms of the adjusting factor for the minimized tracking error and obstacle collision risk propagation profiles is found at 0.22. The results further confirm the promising capacity of the proposed optimization-based RL algorithm for the collision avoidance control of the nonholonomic robots on deformable terrains. INDEX TERMS Mechatronics, terramechanics, path-planning, artificial intelligence.

Robotic Technologies for High-Throughput Plant Phenotyping: Contemporary Reviews and Future Perspectives

“…Deep reinforcement learning (DRL) technique is an accurate and reliable method to find an optimal path with nearest and collision avoidance route. This technique can be adopted by phenotyping robots to manipulate a robotic arm for grasping process or to navigate a mobile robot between crop rows (Zhang et al, 2015;Zhang et al, 2019;Duguleana and Mogan, 2016;Franceschetti et al, 2018;Taghavifar et al, 2019). Although the robotic phenotyping is mainly focusing on leaf and stem, it can be utilized for other plant organs such as inflorescences (spike, panicle, and tassel), flowers, fruits, and roots.…”

Optimization of Dynamic Obstacle Avoidance Path of Multirotor UAV Based on Ant Colony Algorithm

“…Initially, the UAV flight was controlled by the operator of the vehicle by constantly observing changes in the surrounding environment and thus by radio remote control. With the popularization of artificial intelligence in recent years, intelligent path planning technology began to develop and mature with the extensive use of intelligent algorithms and sensors [17].…”

A novel optimal path-planning and following algorithm for wheeled robots on deformable terrains

“…There are several documented studies within the area of path-planning and pathfollowing of mobile robots on deformable terrains (Gonzalez, Fiacchini, Alamo, Guzman, & Rodriguez, 2010;Taghavifar, Xu, Taghavifar, & Qin, 2019). A tube-based Model Predictive Control (MPC) was proposed for path-tracking of constrained mobile robots in off-road conditions with robustness against wheel's longitudinal slippage (Ramón González, Fiacchini, Guzmán, Álamo, & Rodríguez, 2011).…”