Zinc (Zn) deficiency is one of the most common micronutrient disorders in cereal plants, greatly impairing crop productivity and nutritional quality. Identifying the genes associated with Zn deficiency tolerance is the basis for understanding the genetic mechanism conferring tolerance. In this study, the K22×BY815 and DAN340×K22 recombination inbred line (RIL) populations, which were derived from Zn-inefficient and Zn-efficient inbred lines, were utilized to detect the quantitative trait loci (QTLs) associated with Zn deficiency tolerance and to further identify candidate genes within these loci. The BLUP (Best Linear Unbiased Prediction) values under Zn-deficient condition (-Zn) and the ratios of the BLUP values under Zn deficient condition to the BLUP values under Zn-sufficient condition (-Zn/CK) were used to perform linkage mapping. In QTL analysis, 21 QTLs and 33 QTLs controlling the Zn score, plant height, shoot and root dry weight, and root-to-shoot ratio were detected in the K22×BY815 population and the DAN340×K22 population, explaining 5.5–16.6% and 4.2–23.3% of phenotypic variation, respectively. In addition, seventeen candidate genes associated with the mechanisms underlying Zn deficiency tolerance were identified in QTL colocalizations or the single loci, including the genes involved in the uptake, transport, and redistribution of Zn (ZmIRT1, ZmHMAs, ZmNRAMP6, ZmVIT, ZmNAS3, ZmDMAS1, ZmTOM3), and the genes participating in the auxin and ethylene signal pathways (ZmAFBs, ZmIAA17, ZmETR, ZmEIN2, ZmEIN3, ZmCTR3, ZmEBF1). Our findings will broaden the understanding of the genetic structure of the tolerance to Zn deficiency in maize.