AlphaZero-Inspired Game Learning: Faster Training by Using MCTS Only at Test Time

Scheiermann, Johannes; Konen, Wolfgang

doi:10.1109/tg.2022.3206733

Cited by 2 publications

(1 citation statement)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This method can only generate a single train speed operation curve, and their work is limited by the actual situation, lacking discussion of other situations. Based on Alpha Zero's progressive ideas and expert experience [21,22], AlphaZero is an artificial intelligence algorithm developed by DeepMind. It demonstrates remarkable capabilities in complex strategy games such as Go, Chess and Shogi.…”

Section: Introductionmentioning

confidence: 99%

Rapid Algorithm for Generating and Selecting Optimal Metro Train Speed Curves Based on Alpha Zero and Expert Experience

CHEN,

WU,

et al. 2024

PROMTT

View full text Add to dashboard Cite

According to the current research status of urban rail transit’s fully automatic operation (FAO), the train driving speed curves are usually obtained through simulation and calculation. The train driving speed curves obtained by this method not only have low efficiency but also are not suitable for complex road conditions. Inspired by AlphaZero, a reinforcement learning algorithm that utilised vast amounts of artificial data to defeat AlphaGo, an AI Go program, this paper investigates and analyses methods for rapidly generating a large number of speed curves and selecting those with superior performance for train operation. Firstly, we use the powerful third-party library in Python as the basis, combined with the idea of AlphaZero, to produce artificial speed curves for metro train driving. Secondly, we set relevant parameters with reference to expert experience to quickly produce massive reasonable artificial speed curves. Thirdly, we analysed relevant indicators such as energy consumption, running time error and passenger comfort to select some speed curves with better comprehensive performance. Finally, through the many observations with different running distances and different speed limits, we found that the speed curves produced and selected by our algorithm are more productive, diverse and conducive to the research of train driving operation than the actual data from traditional manual driving and ATO (automatic train operation) system.

show abstract

Section: Introductionmentioning

confidence: 99%