In order to accurately control the rotation position of a pneumatic rotary actuator, the flow state of the gas and the motion state of the pneumatic rotary actuator in the pneumatic rotary actuator position servo system are analyzed in this paper. The mathematical model of the system and the experiment platform are established after that. An Adaptive Differential Evolution (ADE) algorithm which adaptively ameliorates the scaling factor and crossover probability in the process of individual evolution is proposed and applied to the parameter optimization of PD controller. The experimental platform is used to compare the controller with Differential Evolution (DE) algorithm and NCD-PID controller. Finally, the characteristics of the system are tested by increasing the inertial load. The experimental results illustrate that system using ADE-PD control strategy has greater position precision and faster response than using DE-PD and NCD-PID strategies, and shows great robustness.