Although corrugated steel plate structures have largely been applied in Korea as well as globally due to their structural efficiency, the causes of damage occurring at bolted connections should be examined. In this study, detailed finite element models for a bolted connection were formed, and the stress distribution around the connection was evaluated for various parameters, such as the number and arrangement of bolts, loads, edge length, and the spacing of bolts, by considering the cross-sectional forces of actual structures. As a consequence of the analyses, the cracks observed at the plate near a bolt hole can be attributed to very high local stresses that occur at the contact surface between the bolt head or nut and the curved plate when fastening the bolt. When the cross-sectional forces induced by external loads are applied to these local stresses, stresses in excess of the yield strength can occur. Furthermore, larger stresses occurred in an incorrect joint lap than those occurring in a correct joint lap, regardless of the number of bolts, when subjected to a bending moment. In regard to the edge length and spacing of bolts, the current specifications are appropriate in terms of the stress level. Several countermeasures to reduce the local stress around a bolt hole during fastening were also discussed, such as the use of the washers with a curved surface. It is expected that this study can contribute to the extended use of corrugated steel plate structures by clarifying the causes of damage and proposing possible improvements.