For analyzing the influence of the system parameters on the density of the powder layers in laser powder bed fusion (LPBF) technology, an experimental method is proposed to improve the structure of the recoater in the powder laying system and optimize the parameters of the powder laying system. With this experimental method, the appropriate density of the powder layers can be attained. In the proposed experimental method, the recoater in the powder laying system was taken as the research object and the forces affecting the powder and recoater when the powder was in contact with the recoater were analyzed. The discrete element model of the powder laying system was established to simulate and analyze the influences of the recoater’s radius, translational velocity and angular velocity on the density of powder layers. In addition, orthogonal experiments were designed to discuss the magnitude of the influence of each of the powder laying system’s parameters on the density of powder layers. Finally, the optimized parameter combination plan was put forward. The results show that increasing the recoater’s radius can enhance the density of powder layers within a certain range; but, as the recoater’s radius is increased continuously, its impact on the recoater’s radius on f powder layers’ density decreases. When the translational velocity of the recoater rises, powder layers’ density increases first and then decreases. The coater’s angular velocity has little effect on powder layers’ density. Eventually, the optimized processing parameters were determined, which are 25 mm for the recoater’s radius, 30 mm/s for the recoater’s translational velocity, and 12 s−1 for the recoater’s angular velocity. The results provide some significance and guidance in improving the recoater’s structure and optimizing the powder laying system’s parameters.