With the increasing proportion of distributed generators (DGs), distribution networks usually include grid forming (GFM) and grid following (GFL) converters. However, the incompatibility of dynamic performance caused by different control methods of the GFM and GFL converters may bring instability problems and power quality risks to the distribution network. To solve this issue, the models of the GFM and GFL converters are established first to lay a good foundation for stability analysis and power quality improvement control. On this basis, an inner loop parameters design scheme is developed for GFM converters based on the D-Partition method, which facilitates the stability boundary characterization. Meanwhile, a current injection strategy is proposed to enhance the voltage support capacity of the GFL converter during grid faults. Moreover, for the distribution network with multi-converters, a compensation current control based on the analytic hierarchy process and coefficient of variation is proposed to ensure a balance between minimal capacity and optimal power quality. In this manner, DGs can be plug-and-play without considering stability and power quality issues. Finally, the effectiveness of the proposed strategy is validated with simulation results.