Ovarian-derived estrogen can signal non-canonically at membrane-associated receptors in the brain to rapidly regulate neuronal function. Early alcohol drinking confers greater risk for alcohol use disorder in women than men, and binge alcohol drinking is correlated with high estrogen levels, but a causal role for estrogen in driving alcohol drinking has not been established. We found that female mice displayed greater binge alcohol drinking and reduced avoidance when estrogen was high during the estrous cycle than when it was low. The pro-drinking, but not anxiolytic, effect of high endogenous estrogen occurred via rapid signaling at membrane-associated estrogen receptor alpha in the bed nucleus of the stria terminalis, which promoted synaptic excitation of corticotropin-releasing factor neurons and facilitated their activity during alcohol drinking. Thus, this study demonstrates a rapid, nongenomic signaling mechanism for ovarian-derived estrogen in the brain controlling behavior in gonadally intact females.