In high-strength martensitic steels, the inclusions significantly affect the material performance especially in terms of fatigue properties. In this study, a numerical procedure to investigate the effect of the inclusions types and shapes on the residual stresses during the cooling process of the martensitic steels is applied systematically based on the scanning electronic microscopy (SEM) and energy dispersive spectrometer (EDS) results of different types of inclusions. The results show that the maximum residual stress around the interface between Mg-Al-O inclusion and the matrix is the largest, followed by TiN, Al-Ca-O-S, and MnS when the inclusions are assumed as perfect spheres for simplicity. However, these results are proved to be 28.0 to 48.0% inaccurate compared to the results considering actual shapes of inclusions. Furthermore, the convex shape of inclusion will lead to stress concentration in the matrix while the concave shape of inclusion will lead to stress concentration in the inclusion. The residual stress increases with the increase of inclusion edge angle. The increase rate is the largest for TiN inclusions on the concave angle, which leads to extreme stress concentration inside TiN inclusion.