Because of the heavy use of electrical equipment, harmonic pollution is becoming more and more serious, which brings potential safety risks to our lives. In view of the fact that active power filters can effectively eliminate harmonics, an adaptive second-order sliding mode fuzzy control based on the backstepping method is proposed to eliminate harmonics in this article. The second-order sliding mode control can eliminate chattering in the system and results in a smoother controller. The uncertainties in the system are approximated by a fuzzy control system, and the adaptive laws are designed to ensure the stability of the system. Backstepping control can improve the stability and robustness of closed-loop systems. Simulation results show that the proposed method has better tracking effect, strong robustness, and stability and can effectively eliminate harmonics.