Ultrasonic inspection of welds joining dissimilar metals in nuclear power plants has proven to be a challenge, because the ultrasonic waves are subject to diffraction, distortion, scattering, and noise. These perturbations are due to their interactions with coarse-grained microstructures having anisotropic and heterogeneous metallurgical properties that can promote ultrasonic attenuation. In this paper, to improve the reliability of ultrasonic testing for dissimilar-metal welds (DMWs), ultrasonic beam characteristics for DMWs with a buttering layer were investigated in order to analyze the beam distortion phenomenon caused by inhomogeneous anisotropic properties and coarse grains. Ultrasonic testing was performed on DMW specimens using single ultrasonic transducers to investigate the behavior of the ultrasonic beam in the welds. According to the anisotropic and heterogeneous properties, when passing through the weld and the buttering layer of the DMW, ultrasonic waves were distorted and attenuation was high. In particular, in the case of using angular incidence that passed through the weld and the buttering layer in turn, the received ultrasonic data did not contain accurate internal information. From this, it was verified that internal defects may be detected by transmitting ultrasonic waves in different directions. Finally, the existing limitations on the application of non-destructive ultrasonic testing to dissimilar-metal welds were verified, and a solution to the measurement method was proposed.