Sarcoma patients experience physical and psychological symptoms, depending on age of onset, subtype, treatment, stage, and location of the sarcoma, which can adversely affect patients’ health-related quality of life (HRQoL). This study aimed to unravel the heterogeneity of sarcoma survivors’ HRQoL regarding primary sarcoma location. A cross-sectional study was conducted among Dutch sarcoma survivors (N = 1099) aged ≥18, diagnosed 2–10 years ago. Primary sarcoma locations were head and neck, chest, abdominal including retroperitoneal, pelvis including urogenital organs, axial skeleton, extremities (upper and lower), breast, skin and other locations. The European Organization for Research and Treatment of Cancer—Quality of Life Questionnaire (EORTC QLQ)-C30 was used to measure HRQoL accompanied by treatment-specific HRQoL questions. Sociodemographic and clinical characteristics were collected from the Netherlands Cancer Registry. Axial skeleton sarcomas had the lowest functioning levels and highest symptoms compared to other locations. Skin sarcomas had the highest functioning levels and lowest symptoms on most scales. Bone sarcomas scored worse on several HRQoL domains compared to soft tissue sarcomas. High prevalence of treatment-specific HRQoL issues were found per location. In conclusion, sarcomas can present everywhere, which is reflected by different HRQoL outcomes according to primary sarcoma location. The currently used HRQoL measure lacks treatment-specific questions and is too generic to capture all sarcoma-related issues, emphasizing the necessity for a comprehensive sarcoma-specific HRQoL measurement strategy.