Rice provides more than one fifth of daily calories for half of the world’s human population, and is a major dietary source of both essential mineral nutrients and toxic elements. Rice grains are generally poor in some essential nutrients but may contain unsafe levels of some toxic elements under certain conditions. Identification of quantitative trait loci (QTLs) controlling the concentrations of mineral nutrients and toxic trace metals (the ionome) in rice will facilitate development of nutritionally improved rice varieties. However, QTL analyses have traditionally considered each element separately without considering their interrelatedness. In this study, we performed principal component analysis (PCA) and multivariate QTL analyses to identify the genetic loci controlling the covariance among mineral elements in the rice ionome. We resequenced the whole genomes of a rice recombinant inbred line (RIL) population, and performed univariate and multivariate QTL analyses for the concentrations of 16 elements in grains, shoots and roots of the RIL population grown in different conditions. We identified a total of 167 unique elemental QTLs based on analyses of individual elemental concentrations as separate traits, 53 QTLs controlling covariance among elemental concentrations within a single environment/tissue (PC-QTLs), and 152 QTLs which determined covariation among elements across environments/tissues (aPC-QTLs). The candidate genes underlying the QTL clusters with elemental QTLs, PC-QTLs and aPC-QTLs co-localized were identified, including OsHMA4 and OsNRAMP5. The identification of both elemental QTLs and PC QTLs will facilitate the cloning of underlying causal genes and the dissection of the complex regulation of the ionome in rice.