Aims: Endemic SARS-CoV-2 infections still burden the healthcare system and represent a considerable threat to vulnerable patient cohorts, in particular immunocompromised (IC) patients. This study aimed to analyze the in-hospital outcome of IC patients with severe SARS-CoV-2 infection in Germany. Methods: This retrospective, observational study, analyzed administrative data from inpatient cases (n = 146,324) in 84 German Helios hospitals between 1 January 2022 and 31 December 2022 with regard to in-hospital outcome and health care burden in IC patients during the first 12 months of Omicron dominance. As the primary objective, in-hospital outcomes of patients with COVID-19-related severe acute respiratory infection (SARI) were analyzed by comparing patients with (n = 2037) and without IC diagnoses (n = 14,772). Secondary analyses were conducted on IC patients with (n = 2037) and without COVID-19-related SARI (n = 129,515). A severe in-hospital outcome as a composite endpoint was defined per the WHO definition if one of the following criteria were met: intensive care unit (ICU) treatment, mechanical ventilation (MV), or in-hospital death. Results: In total, 12% of COVID-related SARI cases were IC patients, accounting for 15% of ICU admissions, 15% of MV use, and 16% of deaths, resulting in a higher prevalence of severe in-hospital courses in IC patients developing COVID-19-related SARI compared to non-IC patients (Odds Ratio, OR = 1.4, p < 0.001), based on higher in-hospital mortality (OR = 1.4, p < 0.001), increased need for ICU treatment (OR = 1.3, p < 0.001) and mechanical ventilation (OR = 1.2, p < 0.001). Among IC patients, COVID-19-related SARI profoundly increased the risk for severe courses (OR = 4.0, p < 0.001). Conclusions: Our findings highlight the vulnerability of IC patients to severe COVID-19. The persistently high prevalence of severe outcomes in these patients in the Omicron era emphasizes the necessity for continuous in-hospital risk assessment and monitoring of IC patients.