The CRISPR/nCas9-based cytosine base editors (CBEs) and adenine base editors (ABEs) are capable of catalyzing C•G to T•A or A•T to G•C conversions, respectively, and have become new, powerful tools for achieving precise genetic changes in a wide range of organisms. These base editors hold great promise for correcting pathogenic mutations and for being used for therapeutic applications. However, the recognition of cognate DNA sequences near their target sites can cause severe off-target effects that greatly limit their clinical applications, and this is an urgent problem that needs to be resolved for base editing systems. The recently discovered phage-derived proteins, anti-CRISPRs, which can suppress the natural CRISPR nuclease activity, may be able to ameliorate the off-target effects of base editing systems. Here, we confirm for the first time that AcrIIA2, AcrIIA4, and AcrIIA5 efficiently inhibit base editing systems in human cells. In particular, AcrIIA5 has a significant inhibitory effect on all base editing variant systems tested in our study. We further show that the off-target effects of BE3 and ABE7.10 were significantly reduced in AcrIIA5 treated cells. This study suggests that AcrIIA5 should be widely used for the precise control of base editing and to thoroughly “shut off” nuclease activity of both CBE and ABE systems.