In recent years, the access of various distributed power sources and electric vehicles (EVs) has brought more and more randomness and uncertainty to the operation and regulation of microgrids. Therefore, an optimal scheduling strategy for microgrids with EVs based on Deep Q-learning is proposed in this paper. Firstly, a vehicle-to-grid (V2G) model considering the mobility of EVs and the randomness of user charging behavior is proposed. The charging time distribution model, charging demand model, state-of-charge (SOC) dynamic model and the model of travel location are comprehensively established, thereby realizing the construction of the mathematical model of the microgrid with EVs：it can obtain the charging/discharging situation in the EV station, so as to obtain the overall output power of the EV station. Secondly, based on Deep Q-learning, the state space and action space are set up according to the actual microgrid system, and the design of the optimal scheduling reward function is completed with the goal of economy. Finally, the calculation example results show that compared with the traditional optimization algorithm, the strategy proposed in this paper has the ability of online learning and can cope with the randomness of renewable resources better. Meanwhile, the agent with experience replay ability can be trained to complete the evolution process, so as to adapt to the nonlinear influence caused by the mobility of EVs and the periodicity of user behavior, which is feasible and superior in the field of optimal scheduling of microgrids with renewable resources and EVs.

With the development of micro gas turbines (MT) and power-to-gas (P2G) technology, the electric–gas system plays an important role in maintaining the stable, economical, and flexible operation of the microgrid. When subjected to power load disturbance and natural gas load disturbance, the system controller needs to coordinately control the frequency of the microgrid and the gas pressure at the natural gas pipeline nodes. Additionally, the reliability and stability of a multi-microgrid system are much higher than that of a single microgrid, but its control technology is more complicated. Thus, a frequency–pressure cooperative control strategy of a multi-microgrid oriented to an electric–gas system is proposed in this paper. Firstly, based on the analysis of the operating characteristics of the natural gas network and the coupling equipment, the dynamic model of natural gas transmission is built. Secondly, a multi-microgrid load frequency control model including MT, P2G equipment, electric vehicles (EVs), distributed power sources and loads has been established. In addition, according to the three control objectives of microgrid frequency, node pressure and system coordination and stability, the structure of a Muti-Agent Deep Deterministic Policy Gradient (MADDPG) controller is designed, then the definition of space and reward functions are completed. Finally, different cases are set up in the multi-microgrid, and the simulation results are compared with PI control and fuzzy control. The simulation results show that, the proposed MADDPG controller can greatly suppress the frequency deviation caused by wind power and load disturbances and the air pressure fluctuations caused by natural gas network load fluctuations. Additionally, it can coordinate well the overall stability between the sub-microgrids of multi-microgrid.