This study aims to examine the effects among college students of mindfulness on smartphone addiction before going to bed at night. We examined the mediating roles of self-control and rumination on the mindfulness–smartphone addiction path. Participants (n = 270, 59.3% females, 18–24 years old) completed self-reporting questionnaires measuring mindfulness, self-control, smartphone addiction, and rumination. In addition to the correlation analysis, we adopted a stepwise regression analysis with bootstrapping to test the mediating effects. It was found that mindfulness was inversely related to smartphone addiction before going to sleep. Most importantly, self-control and rumination significantly mediated the effects of mindfulness on smartphone addiction among college students. The findings of this study indicated that mindfulness training is beneficial to improve the ability of self-control and reduce rumination levels, thereby inhibiting the negative impact of smartphone addiction on college students before they go to sleep, and further promoting their sleep health and mental health.