Many studies have reported that the contents of cigarette smoke negatively affect sperm parameters, seminal plasma, and various other fertility factors. Nevertheless, the actual effect of smoking on male fertility is not clear. The effect of smoking on semen parameters is based on the well-established biological finding that smoking increases the presence of reactive oxygen species, thereby resulting in oxidative stress (OS). OS has devastating effects on sperm parameters, such as viability and morphology, and impairs sperm function, hence reducing male fertility. However, not all studies have come to the same conclusions. This review sheds light upon the arguable association between smoking and male fertility and also assesses the impact of non-smoking routes of tobacco consumption on male infertility. It also highlights the evidence that links smoking with male infertility, including newly emerging genetic and epigenetic data, and discusses the clinical implications thereof.