Plasma arc welding (PAW) was employed in joining thick materials with groove. Due to the high-density plasma arc, keyhole welding was used in the butt welding. The gap might be taken in places due to the heat distortion during the welding. To achieve a high-quality welding, the adaptive control is required according to the gap. The authors tried to apply CMOS camera to obtain information from the top surface and achieve synchronization between the camera shutter and welding current. Thus, a clear image of the weld pool with the keyhole and the gap was taken. The brightness distribution in the front of the weld pool becomes uneven due to the plasma arc. To classify the gap and select the welding conditions, such as the welding current and the plasma gas flow rate, the authors used one of the deep learning algorithms, convolutional neural network (CNN). In the training and testing data, the performance of the CNN was found to be satisfactory. However, if the plasma torch does not trace the welding line, the pool image will be different from the training image. Hence, the CNN will not be able to estimate the correct gap. To avoid this, the authors detected the welding line from the pool image and selected the image area near the welding line as the input of the CNN, i.e., the input area is selected based on the image obtained during the welding. The validity of the proposed method was verified by the welding experiments.