We present a phase-field model to simulate the microstructure evolution occurring in polycrystalline materials with a variation in the intra-granular dislocation density. The model accounts for two mechanisms that lead to the grain boundary migration: the driving force due to capillarity and that due to the stored energy arising from a spatially varying dislocation density. In addition to the order parameters that distinguish regions occupied by different grains, we introduce dislocation density fields that describe spatial variation of the dislocation density. We assume that the dislocation density decays as a function of the distance the grain boundary has migrated. To demonstrate and parameterize the model, we simulate microstructure evolution in two dimensions, for which the initial microstructure is based on real-time experimental data. Additionally, we applied the model to study the effect of a cyclic heat treatment on the microstructure evolution. Specifically, we simulated stored-energy-driven grain growth during three thermal cycles, as well as grain growth without stored energy that serves as a baseline for comparison. We showed that the microstructure evolution proceeded much faster when the stored energy was considered. A non-self-similar evolution was observed in this case, while a nearly self-similar evolution was found when the microstructure evolution is driven solely by capillarity. These results suggest a possible mechanism for the initiation of abnormal grain growth during cyclic heat treatment. Finally, we demonstrate an integrated experimental-computational workflow that utilizes the experimental measurements to inform the phase-field model and its parameterization, which provides a foundation for the development of future simulation tools capable of quantitative prediction of microstructure evolution during non-isothermal heat treatment.