Introduction White blood cells (WBCs) are immunity cells which fight against viruses and bacteria in the human body. Microscope images of captured WBCs for processing and analysis are important to interpret the body condition. At present, there is no robust automated method to segment and classify WBCs images with high accuracy. This paper aims to improve on WBCs image segmentation and classification method. Methods A triple thresholding method was proposed to segment the WBCs; meanwhile, a convolutional neural network (CNN)-based binary classification model that adopts transfer learning technique was proposed to detect and classify WBCs as a healthy or a malignant. The input dataset of this research work is the Acute Lymphoblastic Leukemia Image Database (ALL-IDB). The process first converts the captured microscope images into HSV format for obtaining the H component. Otsu thresholding is applied to segment the WBC area. A 13 × 13 kernel with two iterations was used to apply morphological opening on image to ameliorate output results. Collected cell masks were used to detect the contour of each cell on the original image. To classify WBCs into a healthy or a malignant category, characteristics and conditions of WBCs are to be examined. A transfer learning technique and pre-trained InceptionV3 model were employed to extract the features from the images for classification. Results The proposed WBCs segmentation method yields 90.45% accuracy, 83.81% of the structural similarity index, 76.25% of the dice similarity coefficient, and is computationally efficient. The accuracy of fine-tuned classifier model for training, validation and test sets are 93.27%, 92.31% and 96.15% respectively. The obtained results are high in accuracy and precision are over 96% and with lower loss value. Discussion Triple thresholding outperforms K-means clustering in segmenting smaller dataset. Pre-trained InceptionV3 model and transfer learning improve the flexibility and ability of classifier.