Nanostructuring has been proposed as a method to enhance radiation tolerance, but many metallic systems are rejected due to significant concerns regarding long term grain boundary and interface stability. This work utilized recent advancements in transmission electron microscopy (TEM) to quantitatively characterize the grain size, texture, and individual grain boundary character in a nanocrystalline gold model system before and after in situ TEM ion irradiation with 10 MeV Si. The initial experimental measurements were fed into a mesoscale phase field model, which incorporates the role of irradiation-induced thermal events on boundary properties, to directly compare the observed and simulated grain growth with varied parameters. The observed microstructure evolution deviated subtly from previously reported normal grain growth in which some boundaries remained essentially static. In broader terms, the combined experimental and modeling techniques presented herein provide future avenues to enhance quantification and prediction of the thermal, mechanical, or radiation stability of grain boundaries in nanostructured crystalline systems.