To increase the timeliness, objectivity, and efficiency in evaluating ophthalmology residents' learning of cataract surgery, an automatic analysis system for cataract surgery videos is developed to assess performance, particularly in the capsulorhexis step on the Kitaro simulator. We utilize computer vision technologies to measure performance of this critical step including duration, size, centrality, circularity, as well as motion stability during the capsulorhexis procedure. Consequently, a grading mechanism is established based on either linear regression or non-linear classification via Support Vector Machine of those computed measures. Comparisons of expert graders to the computer vision-based approach have demonstrated the accuracy and consistency of the computerized technique.