Strabismus is a medical condition that is defined as the lack of coordination between the eyes. When Strabismus is detected at an early age, the chances of curing it are higher. The methods used to detect strabismus and measure its degree of deviation are complex and time-consuming, and they always require the presence of a physician. In this paper, we present a method of detecting strabismus and measuring its degree of deviation using videos of the patient's eye region under a cover test. Our method involves extracting features from a set of training videos (training corpora) and using them to build a classifier. A decision tree (ID3) is built using labeled cases from actual strabismus diagnosis. Patterns are extracted from the corresponding videos of patients, and an association between the extracted features and actual diagnoses is established. Matching Rules from the correlation plot are used to predict diagnoses for future patients. The classifier was tested using a set of testing videos (testing corpora). The results showed 95.9% accuracy, 4.1% were light cases and could not be detected correctly from the videos, half of them were false positive and the other half was false negative.