Background Early diagnosis of sepsis is very important. It is necessary to find effective and adequate biomarkers in order to diagnose sepsis. In this study, we compared the value of sialic acid and procalcitonin for diagnosing sepsis. Methods Newly admitted intensive care unit patients were enrolled from January 2019 to June 2019. We retrospectively collected patient data, including presence of sepsis or not, procalcitonin level and sialic acid level. Receiver operating characteristic curves for the ability of sialic acid, procalcitonin and combination of sialic acid and procalcitonin to diagnose sepsis were carried out. Results A total of 644 patients were admitted to our department from January 2019 to June 2019. The incomplete data were found in 147 patients. Finally, 497 patients data were analyzed. The sensitivity, specificity and area under the curve for the diagnosis of sepsis with sialic acid, procalcitonin and combination of sialic acid and procalcitonin were 64.2, 78.3%, 0.763; 67.9, 84.0%, 0.816 and 75.2, 84.6%, 0.854. Moreover, sialic acid had good values for diagnosing septic patients with viral infection, with 87.5% sensitivity, 82.2% specificity, and 0.882 the area under the curve. Conclusions Compared to procalcitonin, sialic acid had a lower diagnostic efficacy for diagnosing sepsis in critically ill patients. However, the combination of sialic acid and procalcitonin had a higher diagnostic efficacy for sepsis. Moreover, sialic acid had good value for diagnosing virus-induced sepsis.