Residual stress induced during welding is an essential factor affecting a fabrication product’s service life. The vibration stress relief (VSR) technique is widely used in metal fabrication to reduce residual stresses. This paper presents an experimental assessment of the effectiveness of VSR in shielded gas metal arc welded low carbon construction steel (IS2062 E250BR) plates. An eccentric rotating mass vibration exciter with different process parameters has been used here to generate the vibration and the residual stresses have been measured by the X-ray diffraction (XRD) technique. The effect of VSR on phase crystal grain, misorientation, and texture was examined through a scanning electron microscopy (SEM) and electron backscatter diffraction (EBSD) analysis. The results indicate that the compressive residual stress was reduced by 21%. The microstructural analysis shows that the applied stress has affected the grain growth and orientation. In the end, a qualitative analysis of VSR parameters and residual stress is established.