In order to obtain the respiratory condition unobtrusively and comfortably, a non-contact method based on the commercial depth camera Realsense SR300 was proposed to extract respiratory information from depth data. In this paper, a respiratory region detecting algorithm which is mainly based on the morphological method was proposed to obtain the region of interest (ROI) with the depth images. The proposed algorithm contains four steps: body edge extraction, noise reduction, ''image skeleton'' extraction, and respiratory region estimation. As a result, the respiratory waveform can be derived from the depth data in the ROI. For validation, experiments were carried out to verify the feasibility of obtaining the respiratory information with this approach. In consideration of different application scenarios, 20 kinds of conditions were designed and applied for the experiments. The respiratory rate extracted from the depth waveform can be calculated, and the accuracy achieved was 95.20% for all data while utilizing polysomnography thorax effort signal as gold standard. Through the Bland-Altman analysis, it represented that the proposed system had a good agreement (r 2 = 0.88) with the gold standard. In addition, the performances of the system in the 20 different conditions were analyzed by statistics, and the results showed that the system has good adaptability and robustness for different conditions. In conclusion, the proposed algorithm can fit different scenarios, and this paper provides a novel option for extracting the physiological information with depth data.