This study aimed to investigate gender differences in the association between heavy metals and hemograms including hemoglobin (Hgb), mean corpuscular volume (MCV) and mean corpuscular hemoglobin concentration (MCHC). A health survey of 2447 participants was conducted in southern Taiwan between June 2016 and September 2018. Seven heavy metals were measured: blood lead (Pb), urine nickel (Ni), urine chromium (Cr), urine manganese, urine arsenic (As), urine copper and urine cadmium (Cd). The results show that in females, Pb and Ni were significantly negatively associated with Hgb. In addition, As and Cd were significantly positively, and Pb and Ni were significantly negatively, associated with MCV, in males and females, respectively. The interactions between gender and Ni and gender and Cd in MCV were statistically significant. Further, Pb, in males, and Pb, Ni and Cr, in females, were significantly negatively associated with MCHC. In conclusion, in females, associations of red blood cell (RBC) hemograms with heavy metals such as Pb and Ni were found. In males, heavy metals such as Pb, As and Cd were found to associate with RBC hemograms. Further research is warranted to discuss the mechanism behind these associations.