Over the years, the vaste expansion of plastic manufacturing has dramatically increased the environmental impact of microplastics [MPs] and nanoplastics [NPs], making them a threat to marine and terrestrial biota because they contain endocrine disrupting chemicals [EDCs] and other harmful compounds. MPs and NPs have deleteriouse impacts on mammalian endocrine components such as hypothalamus, pituitary, thyroid, adrenal, testes, and ovaries. MPs and NPs absorb and act as a transport medium for harmful chemicals such as bisphenols, phthalates, polybrominated diphenyl ether, polychlorinated biphenyl ether, organotin, perfluorinated compounds, dioxins, polycyclic aromatic hydrocarbons, organic contaminants, and heavy metals, which are commonly used as additives in plastic production. As the EDCs are not covalently bonded to plastics, they can easily leach into milk, water, and other liquids affecting the endocrine system of mammals upon exposure. The toxicity induced by MPs and NPs is size-dependent, as smaller particles have better absorption capacity and larger surface area, releasing more EDC and toxic chemicals. Various EDCs contained or carried by MPs and NPs share structural similarities with specific hormone receptors; hence they interfere with normal hormone receptors, altering the hormonal action of the endocrine glands. This review demonstrates size-dependent MPs’ bioaccumulation, distribution, and translocation with potential hazards to the endocrine gland. We reviewed that MPs and NPs disrupt hypothalamic-pituitary axes, including the hypothalamic-pituitary-thyroid/adrenal/testicular/ovarian axis leading to oxidative stress, reproductive toxicity, neurotoxicity, cytotoxicity, developmental abnormalities, decreased sperm quality, and immunotoxicity. The direct consequences of MPs and NPs on the thyroid, testis, and ovaries are documented. Still, studies need to be carried out to identify the direct effects of MPs and NPs on the hypothalamus, pituitary, and adrenal glands.