Wheat as a staple food crop is the main source of micro- and macronutrients for most people of the world and is recognized as an attractive crop for biofortification. This study presents a comprehensive investigation of genomic regions governing grain micro- and macroelements concentrations in a panel of 135 diverse wheat accessions through a genome-wide association study. The genetic diversity panel was genotyped using the genotyping-by-sequencing (GBS) method and phenotyped in two environments during 2017–2018. Wide ranges of variation in nutrient element concentrations in grain were detected among the accessions. Based on 33,808 high-quality single nucleotide polymorphisms (SNPs), 2997 marker-element associations (MEAs) with −log10(p-value) > 3.5 were identified, representing all three subgenomes of wheat for 15-grain concentration elements. The highest numbers of MEAs were identified for Mg (499), followed by S (399), P (394), Ni (381), Cd (243), Ca (229), Mn (224), Zn (212), Sr (212), Cu (111), Rb (78), Fe (63), Mo (43), K (32) and Co (19). Further, MEAs associated with multiple elements and referred to as pleiotropic SNPs were identified for Mg, P, Cd, Mn, and Zn on chromosomes 1B, 2B, and 6B. Fifty MEAs were subjected to validation using KASIB multilocational trial at six sites in two years using 39 genotypes. Gene annotation of MEAs identified putative candidate genes that potentially encode different types of proteins related to disease, metal transportation, and metabolism. The MEAs identified in the present study could be potential targets for further validation and may be used in marker-assisted breeding to improve nutrient element concentrations in wheat grain.