The non-parametric tree-based methods are the go-to choice in a classification setting. They are simple and very useful for interpretation especially in contexts that require a business rule. They are however not very competitive in terms of predictive power when compared to other supervised learning approaches. Combing multiple trees in order to improve prediction accuracy is the next best option. Ensemble methods are powerful prediction models but they come at a cost. The loss of interpretability on account of aggregating trees may not be feasible in every decision making scenario. Also, depending on the business goal, the class-specific performance may be crucial. The true positive rate and positive predicted value may be more important than the overall accuracy.A non-parametric approach like K-Nearest Neighbours (KNN) can be superior when we have a complicated decision boundary,. Though simple, KNN often produces a classifier that is closer to the optimal Bayes classifier. For the B-School in question which needs to classify applicants into placeableor nonplaceablebased on their past academic performance, a comparison of both the approaches is made to identify a superior performer on the positive class. A model's sensitivity is more crucial than the reduction in the overall error in the given scenario.