Background: Muscle mass is an important biomarker of survival from a critical illness, but it is not a widely accepted method to assess whole-body muscle mass when patients are admitted to the intensive care unit (ICU). We hypothesize that ultrasound-based muscle mass assessments can reflect whole-body muscle mass. Methods: We conducted a retrospective analysis of prospectively obtained ultrasound data at ICU admission. We included patients who underwent computed tomography (CT) imaging at the third lumbar vertebral level, within 2 days before and after ICU admission. Primary outcomes included the correlation between the muscle mass (thickness and cross-sectional area) of the rectus femoris measured using ultrasound and whole-body muscle mass measurements obtained from CT. We aimed to determine whether ultrasound assessments can identify sarcopenia, defined as a skeletal muscle index of 29.0 cm2/m2 for males and 36.0 cm2/m2 for females. Secondary outcomes included the ultrasound measurements of the biceps brachii muscle mass and diaphragm thickness. Results: Among 133 patients, 89 patients underwent CT imaging, which included the third lumbar vertebra. The patients’ mean age was 72 ± 13 years, and 60 patients were male. The correlation between rectus femoris muscle ultrasound and CT was ρ = 0.57 (p < 0.01, n = 89) and ρ = 0.48 (p < 0.01, n = 89) on thickness and cross-sectional area, respectively. The thickness of the rectus femoris and cross-sectional area had the discriminative power to assess sarcopenia when the areas under the curve were 0.84 and 0.76, respectively. Ultrasound measurements of the biceps brachii muscle mass and diaphragm thickness were correlated with CT imaging [ρ = 0.57–0.60 (p < 0.01, n = 52) and ρ = 0.35 (p < 0.01, n = 79)]. Conclusions: Ultrasound measurements of muscle mass are a promising method to assess whole-body muscle mass and sarcopenia at ICU admission.Trial registration: UMIN000044032. Retrospectively registered on 25 April 2021