Water diversion is often used to improve water quality to reach the standard of China in the short term. However, this large amount of water diversion can not only improve the water quality, but also lead to a decline in the water quality (total phosphorus, total nitrogen) of Xuanwu Lake. Through theoretical analysis, the relationship between water quality and water diversion is established. We also found that the multiplication of the pollutant degradation coefficient (K) and the water residence time (T) is a constant (N), K⋅T=N. The water quality changed better at first, with the increase of inflow discharge, and then became worse, and the optimal water quality inflow discharge is 180,000 m3/day. By constructing two-dimensional hydrodynamic and water quality models, the optimal diversion water plan is calculated. Through model calculations, it can be seen that reducing the inflow discharge makes the water residence time longer (15.3 days changed to 23.8 days). Thereby, increasing the degradation of pollutants, and thus improving water quality. Compared with other wind directions, the southwest wind makes the water quality of Xuanwu Lake the most uniform. The concentration of water quality first became smaller and then became larger, as the wind speed increased, and eventually became constant. Implementing these results for water quality improvement in small and medium lakes will significantly reduce the cost of water diversion.