Design and Implementation of Intelligent Agent Training Systems for Virtual Vehicles

Abstract

This paper presents the results of the design, simulation, and implementation of a virtual vehicle. Such a process employs the Unity videogame platform and its Machine Learning-Agents library. The virtual vehicle is implemented in Unity considering mechanisms that represent accurately the dynamics of a real automobile, such as motor torque curve, suspension system, differential, and anti-roll bar, among others. Intelligent agents are designed and implemented to drive the virtual automobile, and they are trained using imitation or reinforcement. In the former method, learning by imitation, a human expert interacts with an intelligent agent through a control interface that simulates a real vehicle; in this way, the human expert receives motion signals and has stereoscopic vision, among other capabilities. In learning by reinforcement, a reward function that stimulates the intelligent agent to exert a soft control over the virtual automobile is designed. In the training stage, the intelligent agents are introduced into a scenario that simulates a four-lane highway. In the test stage, instead, they are located in unknown roads created based on random spline curves. Finally, graphs of the telemetric variables are presented, which are obtained from the automobile dynamics when the vehicle is controlled by the intelligent agents and their human counterpart, both in the training and the test track.

Application of Intelligent Exercise Training Equipment in Clinical Nursing of Neurology Department

“…e motor function of lower limbs can be improved with the Contrast Media & Molecular Imaging increase of muscle strength [11][12][13][14]. Based on the theory of biofeedback and brain plasticity, repeated systematic training can stimulate and promote functional recombination of nerve cells around stroke lesions through axon regeneration, dendrite "germination," and synaptic threshold change; thus, partially damaged brain function can be restored, and the recovery of the central nervous system's autonomous muscle control ability can be promoted [15].…”

Design and Implementation of Online Intelligent Mental Health Testing Platform

“…As the backbone of the future development of the country and society, college students will have serious consequences if their development is affected by psychological factors. Especially when they leave the campus and enter the society, they are very susceptible to the influence or temptation of various bad factors, which will be a fatal blow to the social groups that cultivate them or their parents and teachers even irrelevant [2,3].…”

Simulated Autonomous Driving Using Reinforcement Learning: A Comparative Study on Unity’s ML-Agents Framework

“…There have been numerous advances in reinforcement learning algorithms for training intelligent agents to perform tasks in simulated environments [33], such as using the Unity engine [34]. One example is the use of deep RL, which combines the use of deep neural networks with RL algorithms to enable the learning of complex tasks from highdimensional sensory input [35].…”