Columnar grain structures (CCS) often distinct in steel ingots, which have to be refined and homogenized during forging. In this investigation, simulation of deformation and dynamic recrystallization of austenitic stainless steels with CCSs were carried out by macroscopic, mesoscopic (microscopic) and nanoscale simulation techniques. (1) Using molecular dynamics simulation method, the nano-CGSs model with different loading directions was simulated. The results show that the deformation stresses are anisotropic with variation of angles between the loading direction and the columnar crystal growth direction. The higher stresses present at the 0° and 90° angles due to higher dislocation density; However, the lower stresses present at the angles from 30° to 60° due to higher stacking faults and twins. (2) The cellular automata (CA) fractal rules were proposed to simulate nucleation and grain growth of dynamic recrystallization by introducing weighted variables considering Σ3 twin nucleation rate for the twinning-promoted recrystallization. The CA method of nucleation at primary columnar crystal boundaries, secondary dendrites and deformation bands was proposed to simulate the joint nucleation. (3) The coupling simulation of macroscopic thermal parameters by finite element method, solidification of columnar structures and hot deformation dynamic recrystallization by CA was realized.