Hysteresis and significant nonlinearities in the stress-strain-temperature characteristics of shape memory alloy (SMA) actuators prevent effective utilization of these actuators and make them difficult to control. Due to these effects, the position control of SMA actuators has been a great challenge for many industrial applications. In this study, a cascade control for position tracking using torque and position measurement of an SMA-actuated rotary actuator is considered. The effects of the SMA characteristic model on control performance are also focused when simulation consequences are directly applied in practice. Based on nonlinear and unknown dynamics of an SMA actuator, a torque regulation adaptive controller using modified Brinson model is developed that requires to approximate the parameters of the system by only measuring SMA force and actuator rotation. Although it is shown that only an approximate model of the system is sufficient to develop the proposed controller, the system dynamic is simulated using MATLAB software, and the characteristics of SMA wire is considered by both modified Brinson constitutive model and Liang and Rogers constitutive model. The controller gains are regulated for both of the mentioned models using simulation. Finally, the performance of both controllers is further evaluated experimentally, and the accuracy of the proposed controller based on the modified Brinson model is compared to the controller based on the Liang and Rogers model. It is shown that since the Brinson model has a better prediction of the SMA wire behavior, the simulation results based on the modified Brinson model have better conformity to reality.