Social wariness and preference for solitude, two dimensions of social withdrawal, show unique associations with various socioemotional difficulties in childhood, including internalizing and peer problems. However, their early childhood predictors remain vastly undocumented. The present study aimed to examine whether early indicators of reactivity in situations of unfamiliarity such as behavioral inhibition, affect, and cortisol independently, or in interaction with emotion regulation as indexed by vagal tone, predict later social wariness and preference for solitude. Participants were 1209 children from the Quebec Newborn Twin Study. Vagal tone was assessed at 5 months, and behavioral inhibition, affect, and cortisol were assessed at 19 months in situations of unfamiliarity. Mothers, teachers, and peers evaluated social wariness and preference for solitude repeatedly from 4 to 10 years old. Findings show that three temperamental dimensions, social inhibition, nonsocial inhibition, and affect accounted for the variability in reactions to unfamiliarity. Behavioral inhibition to social unfamiliarity at 19 months predicted social wariness during the preschool years. Poor vagal regulation at 5 months exacerbated the risk associated with negative affect at 19 months to predict preference for solitude during the preschool years. Overall, results show that social wariness and preference for solitude may follow different developmental pathways.