“…There are some synonyms of ADP including approximate dynamic programming, 8,9 adaptive dynamic programming, [10][11][12] adaptive critic designs, 13,14 neural dynamic programming, 15,16 neurodynamic programming, 17 and reinforcement learning. 18,19 In recent years, Lewis,[20][21][22] Jagannathan, 23, 24 Murray, 25 Powell 26 and Liu [27][28][29][30] have made great contribution to the development of the ADP algorithms. According to Werbos,5 ADP approaches were classified into several schemes including heuristic dynamic programming (HDP), action dependent HDP, dual heuristic programming (DHP), action dependent DHP, globalized DHP (GDHP), and ADGDHP.…”