Menarche is the first occurrence of menstrual bleeding and one of the most important events of female puberty. Alarmingly, over the last several decades, the mean age at menarche (AAM) has decreased. Environmental endocrine disruptors (EEDs) are chemicals that may interfere with the endocrine system, resulting in adverse developmental, immunological, neurological, and reproductive effects in humans. Thus, the effects of EEDs on fertility and reproduction are growing concerns in modern societies. In this study, we aimed to determine the influence of genetic and environmental factors on AAM. We used data from an AAM genome-wide association study of 329,345 women to conduct a transcriptome-wide association study (TWAS) with FUSION software. As references, we determined the gene-expression levels in the hypothalamus, pituitary gland, ovaries, uterus, and whole blood. We performed Gene Ontology and Kyoto Encyclopedia of Genes and Genomes enrichment analyses using the significantly dysregulated genes identified by the TWAS. Using the STRING database, we also generated a protein–protein-interaction network to analyze common AAM-specific genes identified by the TWAS with different tissues. We performed chemical-related gene set enrichment analysis (CGSEA) and identified significant TWAS genes to uncover relationships between different chemicals and AAM. The TWAS identified 9,848 genes; among these, 1580 genes were significant (P < 0.05), and 11 genes were significant among the hypothalamus, pituitary, ovary, uterus, and whole blood. CGSEA identified 1,634 chemicals, including 120 chemicals significantly correlated with AAM. In summary, we performed a TWAS (for genetic factors) and CGSEA (for environmental factors) focusing on AAM and identified several AAM-associated genes and EEDs. The results of this study expand our understanding of genetic and environmental factors related to the onset of female puberty.