With the increasing global incidence of infertility, the influence of environmental factors, lifestyle habits, and nutrients on reproductive health has gradually attracted the attention of researchers. The quantity and quality of sperm play vital roles in male fertility, and both characteristics can be affected by external and internal factors. In this review, the potential role of genetic, environmental, and endocrine factors; nutrients and trace elements in male reproductive health, spermatozoa function, and fertility potency and the underlying mechanisms are considered to provide a theoretical basis for clinical treatment of infertility.