The purpose of the presented research was to determine the suitability of using ultrasonic testing (UT) to inspect heterogeneous, from a material point of view, welded joints on the example of the joints of a ferritic steel element with elements made of an austenitic steel. The echo technique with transverse (SEK) and longitudinal wave heads (SEL) addressed this issue. Due to the widespread use of 13CrMo4-5 and X2CrNiMo17-12-2 steel grades in the energy industry, they were selected as the test materials for the study. The objects of the presented research were welded joint specimens with thicknesses of 8, 12, and 16 mm and dimensions of 300 × 300 mm, made using the 135 metal active gas (MAG) process with the use of the Lincoln 309LSi wire—a ferritic–austenitic filler material. The stages of the research task were (1) making distance–amplitude curve (DAC) patterns from the test materials; (2) preparation of specimens of welded joints with artificial discontinuities in the form of through-holes; (3) performing UT tests on welded joints with artificial discontinuities using heads with 60° and 70° angles for the transverse wave and angle heads for longitudinal waves with similar beam insertion angles; (4) selection, by radiographic testing (RT), of welded joint specimens with natural discontinuities in the form of a lack of sidewall fusion; (5) performing UT tests on welded joints with natural discontinuities, using heads as welded joints with artificial discontinuities. It was found that (1) the highest sensitivity of discontinuity detection was obtained by performing tests on the ferritic steel side, which is due to the lower attenuation of the ultrasonic wave propagating in ferritic steel compared to austenitic steel; (2) the best detection of discontinuities could be obtained using a longitudinal ultrasonic wave; (3) there is a relationship between the thickness of the welded elements, the angle of the ultrasonic beam introduction, and the effectiveness of discontinuity detection.