Gynecologic cancers cause over 600,000 deaths annually in women worldwide. The development of chemoresistance after initial rounds of chemotherapy contributes to tumor relapse and death due to gynecologic malignancies. In this regard, cancer stem cells (CSCs), a subpopulation of stem cells with the ability to undergo self-renewal and clonal evolution, play a key role in tumor progression and drug resistance. Aldehyde dehydrogenases (ALDH) are a group of enzymes shown to be robust CSC markers in gynecologic and other malignancies. These enzymes also play functional roles in CSCs, including detoxification of aldehydes, scavenging of reactive oxygen species (ROS), and retinoic acid (RA) signaling, making ALDH an attractive therapeutic target in various clinical scenarios. In this review, we discuss the critical roles of the ALDH in driving stemness in different gynecologic malignancies. We review inhibitors of ALDH, both general and isoform-specific, which have been used to target CSCs in gynecologic cancers. Many of these inhibitors have been shown to be effective in preclinical models of gynecologic malignancies, supporting further development in the clinic. Furthermore, ALDH inhibitors, including 673A and CM037, synergize with chemotherapy to reduce tumor growth. Thus, ALDH-targeted therapies hold promise for improving patient outcomes in gynecologic malignancies.