Binging disorders are characterized by episodes of eating large amounts of food whilst experiencing a loss of control. Recent studies suggest that the underlying causes of these binging disorders consist of a complex system of environmental cues, different processing of food stimuli, altered behavioral responding, and brain changes. We propose that task-independent volumetric and connectivity changes in the brain are highly related to altered functioning in reward sensitivity, cognitive control, and negative affect, which in turn promotes and conserves binging behavior. We here review imaging studies and show that volume and connectivity changes in the orbitofrontal cortex, inferior frontal gyrus, medial prefrontal cortex, striatum, insula and amygdala overlap with distorted brain activation associated with increased reward sensitivity, decreased cognitive control, and distorted responses to negative affect or stress seen in binging disorder. Future research integrating both task-based and task-independent neuroimaging approaches therefore shows considerable promise in clarifying binging behavior. We provide suggestions for how this integration may guide future research and inform novel brain-based treatment options in binging disorders.