Using longitudinal data from 21 adolescents, we assessed family aggression (via mother, father, and youth report) in early adolescence, externalizing behavior in mid-adolescence, and magnetic resonance imaging (MRI) data in late adolescence. Amygdalae were manually traced, and used as seed regions for resting state analyses. Both family aggression and subsequent externalizing behavior predicted larger right amygdala volumes and stronger amygdala-frontolimbic/ salience network connectivity and weaker amygdala-posterior cingulate connectivity. Externalizing behavior in midadolescence mediated associations between family aggression in early adolescence and resting state connectivity between the amygdala and the subgenual anterior cingulate cortex, medial prefrontal cortex, orbitofrontal cortex, and posterior cingulate cortex in late adolescence. Family adversity and adolescent behavior problems may share common neural correlates.