Primary ovarian insufficiency (POI) is one of the many unintended consequences of chemotherapy faced by the growing number of female cancer survivors. While ovarian repercussions of chemotherapy have long been recognized, the acute insult phase and primary sites of damage are not well-studied, hampering efforts to design effective intervention therapies to protect the ovary. Utilizing doxorubicin (DXR) as a model chemotherapy agent, we defined the acute timeline for drug accumulation, induced DNA damage, and subsequent cellular and follicular demise in the mouse ovary. DXR accumulated first in the core ovarian stroma cells, then redistributed outwards into the cortex and follicles in a time-dependent manner, without further increase in total ovarian drug levels after four hours post-injection. Consistent with early drug accumulation and intimate interactions with the blood supply, stroma cell-enriched populations exhibited an earlier DNA damage response (measurable at 2 hours) than granulosa cells (measurable at 4 hours), as quantified by the comet assay. Granulosa cell-enriched populations were more sensitive however, responding with greater levels of DNA damage. The oocyte DNA damage response was delayed, and not measurable above background until 10–12 hours post-DXR injection. By 8 hours post-DXR injection and prior to the oocyte DNA damage response, the number of primary, secondary, and antral follicles exhibiting TUNEL (terminal deoxynucleotidyl transferase dUTP nick end labeling)-positive granulosa cells plateaued, indicating late-stage apoptosis and suggesting damage to the oocytes is subsequent to somatic cell failure. Primordial follicles accumulate significant DXR by 4 hours post-injection, but do not exhibit TUNEL-positive granulosa cells until 48 hours post-injection, indicating delayed demise. Taken together, the data suggest effective intervention therapies designed to protect the ovary from chemotherapy accumulation and induced insult in the ovary must act almost immediately to prevent acute insult as significant damage was seen in stroma cells within the first two hours.