Ultrasonic testing (UT) has been actively studied to evaluate the porosity of additively manufactured parts. Currently, ultrasonic measurements of as-deposited parts with a rough surface remain problematic because the surface lowers the signal-to-noise ratio (SNR) of ultrasonic signals, which degrades the UT performance. In this study, various deep learning (DL) techniques that can effectively extract the features of defects, even from signals with a low SNR, were applied to UT, and their performance in terms of the porosity evaluation of additively manufactured parts with rough surfaces was investigated. Experimentally, the effects of the processing conditions of additive manufacturing on the resulting porosity were first analyzed using both optical and scanning acoustic microscopy. Second, convolutional neural network (CNN), deep neural network, and multi-layer perceptron models were trained using time-domain ultrasonic signals obtained from additively manufactured specimens with various levels of porosity and surface roughness. The experimental results showed that all the models could evaluate porosity accurately, even that of the as-deposited specimens. In particular, the CNN delivered the best performance at 94.5%. However, conventional UT could not be applied because of the low SNR. The generalization performance when using newly manufactured as-deposited specimens was high at 90%.