A hybrid-loop servo control system based on sliding-mode control and neural network control is proposed in this article to realize flexible forming process on a double toggle mechanical press. First, kinematics and dynamic analysis of the drive system are conducted to derive the control objective behavior. Then, the structure of the hybrid-loop system is introduced; sliding-mode control is applied to compensate the punch position errors. In the inner loop of the servo motor, complementary sliding-mode control is used to track the motor rotation angle, and a radial basis function neural network estimator is applied to eliminate the considerable load disturbances in the stamping stage. Finally, experimental hardware is constructed and a compound blanking and drawing process is carried out to validate the proposed servo control system in practice. With different materials and drawing depth, high tracking accuracy and robustness are exhibited to realize favorable forming performance.