Understanding the public health implications of chemical contamination of drinking water is important for societies and their decision-makers. The possible population health impacts associated with exposure to disinfection by-products (DBPs) are of particular interest due to their potential carcinogenicity and their widespread occurrence as a result of treatments employed to control waterborne infectious disease. We searched the literature for studies that have attempted quantitatively to assess population health impacts and health risks associated with exposure to DBPs in drinking water. We summarised and evaluated these assessments in terms of their objectives, methods, treatment of uncertainties, and interpretation and communication of results. In total we identified 40 studies matching our search criteria. The vast majority of studies presented estimates of generic cancer and non-cancer risks based on toxicological data and methods that were designed with regulatory, health-protective purposes in mind, and therefore presented imprecise and biased estimates of health impacts. Many studies insufficiently addressed the numerous challenges to DBP risk assessment, failing to evaluate the evidence for a causal relationship, not appropriately addressing the complex nature of DBP occurrence as a mixture of chemicals, not adequately characterising exposure in space and time, not defining specific health outcomes, not accounting for characteristics of target populations, and not balancing potential risks of DBPs against the health benefits related with drinking water disinfection. Uncertainties were often poorly explained or insufficiently accounted for, and important limitations of data and methods frequently not discussed. Grave conceptual and methodological limitations in study design, as well as erroneous use of available dose-response data, seriously impede the extent to which many of these assessments contribute to understanding the public health implications of exposure to DBPs. In some cases, assessment results may cause unwarranted alarm among the public and potentially lead to poor decisions being made in sourcing, treatment, and provision of drinking water. We recommend that the assessment of public health impacts of DBPs should be viewed as a means of answering real world policy questions relating to drinking water quality, including microbial contaminants; that they should be conducted using the most appropriate and up-to-date data and methods, and that associated uncertainties and limitations should be accounted for using quantitative methods where appropriate.