Understanding how and why affective responses change with age is central to characterizing typical and atypical emotional development. Prior work has emphasized the role of the amygdala and prefrontal cortex (PFC), which show age-related changes in function and connectivity. However, developmental neuroimaging research has only recently begun to unpack whether age effects in the amygdala and PFC are specific to affective stimuli or may be found for neutral stimuli as well, a possibility that would support a general, rather than affect-specific, account of amygdala-PFC development. To examine this, 112 individuals ranging from 6–23 years of age viewed aversive and neutral images while undergoing fMRI scanning. Across age, participants reported more negative affect and showed greater amygdala responses for aversive than neutral stimuli. However, children were generally more sensitive to both neutral and aversive stimuli, as indexed by affective reports and amygdala responses. At the same time, the transition from childhood to adolescence was marked by a ventral-to-dorsal shift in medial prefrontal responses to aversive, but not neutral, stimuli. Given the role that dmPFC plays in executive control and higher-level representations of emotion, these results suggest that adolescence is characterized by a shift towards representing emotional events in increasingly cognitive terms.