Shape memory alloys (SMAs) are widely used in aerospace, automobile, and other fields because of their excellent properties, such as large driving force and large deformation. A training method with a bidirectional memory effect is proposed for SMA actuators. The trained SMA units can be heated and cooled to change their shape (shorten and extend). The trained SMA is used as an actuator to drive the deformation of a structure. Due to the obvious hysteresis characteristics of SMA, a temperature-displacement hysteresis model based on the Preisach model is proposed in order to reduce the influence of hysteresis in the process of structural deformation. The F function method (FFM) is used for Preisach numerical implementation, and a PID control method is used for the precise control of structural deformation. Compared with the PID control method without hysteresis model, this method is superior to the PID control method in response speed and control accuracy. The maximum relative error of three target points in the experiment is 5.45%, which is better than the PID control method without this model. The hysteresis model can be applied to the displacement control of a SMA-based actuator.