Learning Human Strategies for Tuning Cavity Filters with Continuous Reinforcement Learning

Abstract

Learning to master human intentions and behave more humanlike is an ultimate goal for autonomous agents. To achieve that, higher requirements for intelligence are imposed. In this work, we make an effort to study the autonomous learning mechanism to solve complicated human tasks. The tuning task of cavity filters is studied, which is a common task in the communication industry. It is not only time-consuming, but also depends on the knowledge of tuning technicians. We propose an automatic tuning framework for cavity filters based on Deep Deterministic Policy Gradient and design appropriate reward functions to accelerate training. Simulation experiments are carried out to verify the applicability of the algorithm. This method can not only automatically tune the detuned filter from random starting position to meet the design requirements under certain circumstances, but also realize the transfer of learning skills to new situations, to a certain extent.

New Trends in the Control of Robots and Mechatronic Systems

“…Papers [15,16] deal with two topics that are strictly related: reinforcement learning (RL) and the Markov decision process (MDP). In [15], RL is used to study the autonomous learning mechanism to solve complicated human tasks. The tuning task of cavity filters is considered, which is a common task in the communication industry.…”