In the simulation process for multi-body systems, the generated redundant constraints will result in ill-conditioned dynamic equations, which are not good for stable simulations when the system motion proceeds near a singular configuration. In order to overcome the singularity problems, the paper presents a regularization method with an explicit expression based on Gauss principle, which does not need to eliminate the constraint violation after each iteration step compared with the traditional methods. Then the effectiveness and stability are demonstrated through two numerical examples, a slider-crank mechanism and a planar four-bar linkage. Simulation results obtained with the proposed method are analyzed and compared with augmented Lagrangian formulation and the null space formulation in terms of constraints violation, drift mechanical energy and computational efficiency, which shows that the proposed method is suitable to perform efficient and stable dynamic simulations for multi-body systems with singular configurations.