In this paper, a set of improvements made in drill wear recognition algorithm obtained during previous work is presented. Images of the drilled holes made on melamine faced particleboard were used as its input values. During the presented experiments, three classes were recognized: green, yellow and red, which directly correspond to a tool that is in good shape, shape that needs to be confirmed by an operator, and which should be immediately replaced, since its further use in production process can result in losses due to low product quality. During the experiments, and as a direct result of a dialog with a manufacturer it was noted that while overall accuracy is important, it is far more crucial that the used algorithm can properly distinguish red and green classes and make no (or as little as possible) misclassifications between them. The proposed algorithm is based on an ensemble of possibly diverse models, which performed best under the above conditions. The model has relatively high overall accuracy, with close to none misclassifications between indicated classes. Final classification accuracy reached 80.49% for biggest used window, while making only 7 critical errors (misclassifications between red and green classes).