On the basis of previously accumulated irreversible deformations, and, consequently, residual stresses, the process of removing residual stresses in metal workpieces under the action of low and high temperatures is simulated. Boundary value problems are solved and here are described regularities that are responsible for removing residual stresses for processing modes: high-temperature heating - cooling, high-temperature heating - holding - cooling, low-temperature heating - holding - cooling. The holding stage is modeled, taking into account the creep properties of materials under Norton creep conditions. According to the dependences of the obtained exact solutions, it is shown that it is the holding process that leads to the relaxation of residual stresses.