The identification of novel, robust biomarkers for the diagnosis of rheumatic diseases (RDs) and the presence of active disease might facilitate early treatment and the achievement of favourable long-term outcomes. We conducted a systematic review and meta-analysis of studies investigating the acute phase reactant, serum amyloid A (SAA), in RD patients and healthy controls to appraise its potential as diagnostic biomarker. We searched PubMed, Scopus, and Web of Science from inception to 10 April 2024 for relevant studies. We evaluated the risk of bias and the certainty of evidence using the JBI Critical Appraisal Checklist and GRADE, respectively (PROSPERO registration number: CRD42024537418). In 32 studies selected for analysis, SAA concentrations were significantly higher in RD patients compared to controls (SMD = 1.61, 95% CI 1.24–1.98, p < 0.001) and in RD patients with active disease compared to those in remission (SMD = 2.17, 95% CI 1.21–3.13, p < 0.001). Summary receiving characteristics curve analysis showed a good diagnostic accuracy of SAA for the presence of RDs (area under the curve = 0.81, 95% CI 0.78–0.84). The effect size of the differences in SAA concentrations between RD patients and controls was significantly associated with sex, body mass index, type of RD, and study country. Pending the conduct of prospective studies in different types of RDs, the results of this systematic review and meta-analysis suggest that SAA is a promising biomarker for the diagnosis of RDs and active disease.