The effect of adverse childhood experiences (ACEs) on depression in adulthood has been identified in many studies; however, the underlying mechanisms remain unclear. To understand the moderating effect of ACEs on depression, a moderation analysis using the interaction effect model was performed based on data obtained from the China Health and Retirement Longitudinal Study. This study found that people with ACEs had significantly lower depression scores than those without ACEs, particularly in categories such as physical abuse, emotional neglect, sibling death, parental illness/disability, parental depression, hunger, violence, and bullying. In addition, the results indicated that contact with children moderated the relationship between ACEs and depression in adulthood. Increased levels of contact with children reduced the adverse effects of parental drug abuse and the experience of starvation, but not physical abuse. This study highlights the role of family support in eliminating health disparities, which can reduce the effects of ACEs on depression in adulthood.