Infants and toddlers are highly sensitive to contaminants in food. Chronic exposure can lead to developmental delays, disorders of the nervous, urinary and immune systems, and to cardiovascular disease. A literature review was conducted mainly in PubMed, Google Scholar and Scopus databases, and took into consideration papers published from October 2020 to March 2021. We focused on contaminant content, intake estimates, and exposure to contaminants most commonly found in foods consumed by infants and children aged 0.5–3 years. In the review, we included 83 publications with full access. Contaminants that pose a high health risk are toxic elements, acrylamide, bisphenol, and pesticide residues. Minor pollutants include: dioxins, mycotoxins, nitrates and nitrites, and polycyclic aromatic hydrocarbons. In order to reduce the negative health effects of food contamination, it seems reasonable to educate parents to limit foods that are potentially dangerous for infants and young children. An appropriate varied diet, selected cooking techniques, and proper food preparation can increase the likelihood that the foods children consume are safe for their health. It is necessary to monitor food contamination, adhere to high standards at every stage of production, and improve the quality of food for children.