Although animal studies have raised concern that the influence of endocrine-disrupting compounds would obstruct the development of the male reproductive system, in general, exposure levels far above those found in humans have been needed to induce reproductive toxicity in animal models. Human data are inconclusive and have evoked the question whether endocrine-disrupting compounds can have any impact on hormonal function and thus health consequences when natural hormones are present. Indeed, many contaminants with hormone-like activity are much less potent than endogenous hormones themselves: 17β-oestradiol was, for instance, estimated to be 17,000 times more potent than o,p′-DDT. However, humans are exposed to a multitude of agents, and when present in sufficient number and concentration, they might in principle act collected on the actions of endogenous hormones. Whether such effects will be physiologically relevant is still not known. Nevertheless, in the worst-case scenario, there are no threshold levels below which there are no effects at all, and one target molecule is the androgen receptor. This mini review focuses on the androgen receptor gene, its link with classical endocrine disruptors and smoking, and how common genetic variants in the androgen receptor gene may influence physiological outcomes.