Multi-point stretch forming (MPSF), by replacing the traditional rigid fixed-shape stretching die with the multi-point die (MPD), is an important flexible forming technique in sheet metal forming process. However, the particular dimples will be generated on the formed part surface when forming by MPD. In this paper, we prove that the dimple formation can be suppressed by changing the punch units of MPD arrangement. Therefore, the forming effect can be largely improved. Spherical parts are selected as the study objects. Under the same loading condition, two MPSF finite element numerical models are established for conventional arrangement multi-point die (CAMPD) and staggered arrangement multi-point die (SAMPD), respectively. Through the numerical simulations and the stretch forming experiments, the stress, strain, thickness, springback, and shape accuracy are compared between the two parts formed by CAMPD and SAMPD. The results show that the values of the stress, strain, thickness thinning rate, and springback of the formed part are smaller when forming by SAMPD. Moreover, the distributions of the stress, strain, and thickness are more uniform. Also, the surface forming quality and the shape accuracy are improved. These results provide a valuable guidance during developing the new types of MPD.