Introduction—Aim: Adopting a lifestyle that incorporates regular physical activity confers substantial benefits to both physical and mental health and is recommended for prediabetic individuals. The aim of this study is to investigate the impact of activity tracking apps on increasing physical activity and its effect on glycemic control in people with prediabetes. Materials and Methods: This pilot study included 37 participants, 18 in the prediabetic group and 19 in the normoglycemic group matched for age and gender (mean age 53 years, 40% males). Participants used the Google Fit app for 3 months. The number of daily steps was recorded via the app, and blood and urine tests as well as body fat measurements were conducted before and following 3 months of app use. The co-primary outcome was the change in steps, and the change in HbA1c in both groups. Secondary outcomes were the change in fasting plasma glucose (FPG) (main secondary outcome), as well as lipid parameters, body mass index, visceral fat, and kidney function indices among the two groups. Results: Both groups increased the daily step count following the app intervention, without any statistically significant difference when we compared the steps change between the two groups. We found a statistically significant difference between HbA1c levels in favor of the prediabetic compared to the normoglycemic group [mean difference (MD) 0.16, 95%CI 0.04, 0.28, p-value 0.01)], following the 3-month intervention. Additionally, there was a statistically significant difference between FPG levels in favor of the prediabetic compared to the normoglycemic group (MD 9.06, 95%CI 4.16, 13.96, p-value 0.001). Conclusions: The present study suggests that the use of activity tracking apps, combined with tailored activity goals and monthly supportive phone calls, may contribute to improved glycemic control among individuals with prediabetes.