Sea Island cotton is the best quality tetraploid cultivated cotton in the world, in terms of fiber quality. Glyphosate is a widely used herbicide in cotton production, and the improper use of herbicides has led to pollen abortion in sea island cotton and, consequently, to a dramatic decrease in yield; however, the mechanism remains unclear. In this study, different concentrations (0, 3.75, 7.5, 15, and 30 g/L) of glyphosate were applied to CP4-EPSPS transgenic sea island cotton Xinchang 5 in 2021 and 2022 at Korla, with 15 g/L glyphosate chosen as the suitable concentration. By comparing the paraffin sections of 2–24 mm anthers in the 15 g/L glyphosate treatment group with those in the water control group, we showed that the key period of anther abortion after glyphosate treatment was the formation and development of tetrads, which corresponded to 8–9 mm buds. Transcriptome sequencing analysis of the treated and control anthers revealed a significant enrichment of differentially expressed genes in phytohormone-related pathways, in particular abscisic acid response and regulation pathways. Additionally, after treatment with 15 g/L of glyphosate, there was a significant increase in the amount of abscisic acid in the anthers in the 8–9 mm buds. Further analysis of the differential expression of abscisic acid response and regulatory genes, an abscisic acid response gene GbTCP14 (Gbar_A11G003090) was identified, which was significantly upregulated in buds with 15 g/L glyphosate treatment than the control, and it could be a key candidate gene for the subsequent research involving male sterility induced by glyphosate in sea island cotton.