Introduction: Telemedicine interventions are gradually being used in primary health care to help patients with type 2 diabetes receive ongoing medical guidance. The purpose of this study was to analyze the effectiveness of using telemedicine in primary health care for the management of patients with type 2 diabetes. Methods: A systematic search was conducted from database inception to August 2021 in nine databases, including PubMed, Web of Science, Cochrane Library, EMBASE, EBSCO, CNKI, Wanfang Data, VIP, and CBM. Data extraction and quality assessment were performed for studies that met the inclusion criteria. The meta-analysis was performed using Review Manager 5.4 (Cochrane) and Stata v.16.0SE (College Station, TX, USA). Results: A total of 32 articles were included in this study. Analysis showed a reduction in glycated hemoglobin, fasting glucose, and postprandial glucose after the telemedicine intervention. Systolic blood pressure and self-efficacy improved significantly, but there was no significant improvement in weight, lipid metabolism, or diabetes awareness. Subgroup analysis based on the duration of intervention showed significant improvement in glycated hemoglobin at 6 months of intervention. Conclusions: Telemedicine interventions may help patients with type 2 diabetes to effectively control blood glucose and improve self-management in primary health care. There is only moderate benefit, and the benefit may not be sustained beyond 6 months. However, the evidence for the improvement in lipid metabolism is insufficient and further studies are needed.