Models for the microstructure evolution during hot rolling are reviewed. The basic macroscopic phenomena related to recrystallization are summarized. Constitutive models based on semi empirical equations are compared to more sophisticated models based on cellular automata, vertex and Monte-Carlo-Potts methods. The applicability of each kind of model approach for online and offline process control in steel industry is discussed. While constitutive models are still state-of-the-art for online process control, mesoscale models with a spatial representation of the microstructure can provide better predictive capabilities at the cost of long computation times. To fill this gap a new approach based on modeling the interaction of an ensemble of multiple grains is outlined and first simulation results are presented. The proposed approach allows the unified modeling of dynamic, static and metadynamic recrystallization as well as grain growth.