Grain refinement caused by deformed austenite recrystallization is an important way to enhance the property of ultra‐heavy plates during hot rolling process. In the present study, with the model coupled microstructure evolution based on Abaqus secondary development, numerical simulation of hot rolling process with different rolling parameters is carried out. The calculation result showed that gradient temperature rolling process can increase the accumulated strain in the center of plate so that 4.9–11.8 µm smaller grains can be obtained. Compared with the microscopic scale numerical simulation for grain nucleation and growth, the model above can accomplish the microstructure evolution simulation of steel plates during rolling process on macroscopic scale. The prediction of grain size can be achieved with the calculation result, which assists engineers in formulating steel plates rolling schedules.