The use of technology in everyday life is unavoidable, considering that technological advancement occurs very quickly. The current era is also known as industry 4.0. In the industry 4.0 era, there is a convergence between the industrial world and information technology. The use of modern machines in the industry makes it possible for business actors to digitize their production facilities and open up new business opportunities. One of the developments in information technology that is being widely used in its implementation is machine learning (ML) technology and its branches such as computer vision and image recognition. In this work, we propose a customized convolutional neural network-based ML model to perform image classification technique for Indonesian herb image dataset, along with the detailed review and discussion of the methods and results. In this work, we use the transfer learning method to adopt the opensource pre-trained model, namely, Xception, developed by Google.