Rice is an important source of calories and mineral nutrients for more than half of the world's population. The accumulation of essential and toxic mineral elements in rice grain affects its nutritional quality and safety. However, the patterns and processes by which different elements progressively accumulate during grain filling remain largely unknown. In the present study, we investigated temporal changes in dry matter, elemental concentrations, and the transcriptome in the grain of field-grown rice. We also investigated the effects of seed setting rate and the position of grain within rice panicle on element accumulation. Three different patterns of accumulation were observed: (i) elements including K, Mn, B, and Ca showed an early accumulation pattern; (ii) dry matter and elements including N, P, S, Mg, Cu, Zn, Mo, As, and Cd showed a mid-accumulation pattern; and (iii) elements such as Fe showed a gradual increase pattern. These different accumulation patterns can be explained by the differences in the biogeochemical behavior of the various elements in the soil, as well as differences in plant nutrient redistribution, gene expression, and the sink-source relationship. These results improve our knowledge of the dynamics of elemental accumulation in rice grain and are helpful for identification of functional genes mediating the translocation of elements to grain.