The surface insulation properties of insulating material under DC voltage are closely related to the characteristics of surface charge accumulation, and the surface roughness of these materials has a direct impact on the surface charge distribution in vacuum. Therefore, it is significant to study their connection. In this paper, based on the secondary electron emission avalanche model, the surface charge accumulation on polymethyl methacrylate (PMMA) with different surface roughness was simulated by using particle in cell and Monte Carlo Collision method. The simulated environment was under the finger shaped electrode and in vacuum. The results showed that under the action of the electric field the electrons emitted from the cathode triple junction moved forward and collided with the insulating material, which may lead to the generation of secondary electrons or the accumulation of surface charge. The surface charge near the cathode was mostly negative since the effect of surface electron injection was greater than that of the collision ionization. Due to the change of electron energy and the influence of electric field distribution, the number of positive charge on the insulator gradually increased, reached the maximum, and then gradually reduced with the approaching of the anode. Moreover, when the surface roughness of the material increases or the secondary electron emission coefficient decreases, the amount of surface charge accumulated on the PMMA will reduce. This paper can provide some guidance for the practical application of insulating materials.