The use of data mining within the higher education context has, increasingly, been gaining traction.A parallel examination of the accuracy, robustness and utility of the algorithms applied to data mining is argued as a necessary step toward entrenching the use of EDM. This article provides a comparative analysis of various classification algorithms within an Open Distance Learning institution in South Africa. The study compares the performance of the ZeroR, OneR, Naïve Bayes, IBk, Simple Logistic Regression and the J48 in classifying students within a cohort over an eightyear time span. The initial results appear to show that, given the data quality and structure of the institution under study, the J48 most consistently performed with the highest levels of accuracy.