(1) Many studies have attempted to utilize metabolomic approaches to explore potential biomarkers for the early detection of osteoarthritis (OA), but consistent and high-level evidence is still lacking. In this study, we performed a systematic review and meta-analysis of differential small molecule metabolites between OA patients and healthy individuals to screen promising candidates from a large number of samples with the aim of informing future prospective studies. (2) Methods: We searched the EMBASE, the Cochrane Library, PubMed, Web of Science, Wan Fang Data, VIP Date, and CNKI up to 11 August 2022, and selected relevant records based on inclusion criteria. The risk of bias was assessed using the Newcastle–Ottawa quality assessment scale. We performed qualitative synthesis by counting the frequencies of changing directions and conducted meta-analyses using the random effects model and the fixed-effects model to calculate the mean difference and 95% confidence interval. (3) Results: A total of 3798 records were identified and 13 studies with 495 participants were included. In the 13 studies, 132 kinds of small molecule differential metabolites were extracted, 58 increased, 57 decreased and 17 had direction conflicts. Among them, 37 metabolites appeared more than twice. The results of meta-analyses among four studies showed that three metabolites increased, and eight metabolites decreased compared to healthy controls (HC). (4) Conclusions: The main differential metabolites between OA and healthy subjects were amino acids (AAs) and their derivatives, including tryptophan, lysine, leucine, proline, phenylalanine, glutamine, dimethylglycine, citrulline, asparagine, acetylcarnitine and creatinine (muscle metabolic products), which could be potential biomarkers for predicting OA.