As one of the most promising metal additive manufacturing (AM) technologies, the selective laser melting (SLM) process has high expectations ofr its use in aerospace, medical, and other fields. However, various defects such as spatter, crack, and porosity seriously hinder the applications of the SLM process. In situ monitoring is a vital technique to detect the defects in advance, which is expected to reduce the defects. This work proposed a method that combined acoustic signals with a deep learning algorithm to monitor the spatter behaviors. The acoustic signals were recorded by a microphone and the spatter information was collected by a coaxial high-speed camera simultaneously. The signals were divided into two types according to the number and intensity of spatter during the SLM process with different combinations of processing parameters. Deep learning models, one-dimensional Convolutional Neural Network (1D-CNN), two-dimensional Convolutional Neural Network (2D-CNN), Recurrent Neural Network (RNN), Long Short Term Memory (LSTM), and Gated Recurrent Unit (GRU) were trained to establish the relationships between the acoustic signals and characteristics of spatter. After K-fold verification, the highest classification confidence of models is 85.08%. This work demonstrates that it is feasible to use acoustic signals in monitoring the spatter defect during the SLM process. It is possible to use cheap and simple microphones instead of expensive and complicated high-speed cameras for monitoring spatter behaviors.