This paper investigates the application of deep Convolutional Neural Network (CNN) for herbal plant recognition through leaf identification. Traditional plant identification is often time-consuming due to varieties as well as similarities possessed within the plant species. This study shows that a deep CNN model can be created and enhanced using multiple parameters to boost recognition accuracy performance. This study also shows the significant effects of the multi-layer model on small sample sizes to achieve reasonable performance. Furthermore, data augmentation provides more significant benefits on the overall performance. Simple augmentations such as resize, flip and rotate will increase accuracy significantly by creating invariance and preventing the model from learning irrelevant features. A new dataset of the leaves of various herbal plants found in Malaysia has been constructed and the experimental results achieved 99% accuracy