Pulmonary infection is a common clinical respiratory tract infectious disease with a high incidence rate and a severe mortality rate as high as 30%–50%, which seriously threatens human life and health. Accurate and timely anti-infective treatment is the key to improving the cure rate. NGS technology provides a new, fast, and accurate method for pathogenic diagnosis, which can provide effective clues to the clinic, but determining the true pathogenic bacteria is a problem that needs to be solved urgently, and a comprehensive judgment must be made by the clinician combining the laboratory results, clinical information, and epidemiology. This paper intends to effectively collect and process the missing values of NGS data, clinical manifestations, laboratory test results, imaging test results, and other multimodal data of patients with infectious respiratory diseases. It also studies the deep feature fusion algorithm of multimodal data, couples the private and shared features of different modal data of infectious respiratory diseases, and digs into the hidden information of different modalities to obtain efficient and robust shared features that are conducive to auxiliary diagnosis. The establishment of an auxiliary diagnosis model for the infectious respiratory diseases can intelligentize and automate the diagnosis process of infectious respiratory, which has important significance and application value when applied to clinical practice.