Iterative Learning Control is a branch of intelligent control which combines artificial intelligence and control theory. This objective of this study aims at reducing the cyclic error of an inverse ball screw transmission system by using iterative learning control approach. Firstly, kinematic and dynamic analyses are conducted by using the vectorial loop closure and Lagrange equations, respectively. Then, system identification is performed followed by controller design. Moreover, controller parameters are optimized to minimize the error. Finally, the feasibility and the effectiveness of the proposed approach are verified by computer simulation and prototype experiment. The experimental results showed that the reducing percentage of the square error sum of the output speed is 90.64% by using PID control only. If ILC is applied additionally, the error is further reduced to 94.21%. Therefore, the proposed approach is not only feasible and but also effective.