Objective The presence of a lightweight convolutional neural network (CNN) model with a high-accuracy rate and low complexity can be useful in building an early obesity detection system, especially on mobile-based applications. The previous works of the CNN model for obesity detection were focused on the accuracy performances without considering the complexity size. In this study, we aim to build a new lightweight CNN model that can accurately classify normal and obese thermograms with low complexity sizes. Methods The DenseNet201 CNN architectures were modified by replacing the standard convolution layers with multiple depthwise and pointwise convolution layers from the MobileNet architectures. Then, the depth network of the dense block was reduced to determine which depths were the most comparable to obtain minimum validation losses. The proposed model then was compared with state-of-the-art DenseNet and MobileNet CNN models in terms of classification performances, and complexity size, which is measured in model size and computation cost. Results The results of the testing experiment show that the proposed model has achieved an accuracy of 81.54% with a model size of 1.44 megabyte (MB). This accuracy was comparable to that of DenseNet, which was 83.08%. However, DenseNet’s model size was 71.77 MB. On the other hand, the proposed model’s accuracy was higher than that of MobileNetV2, which was 79.23%, with a computation cost of 0.69 billion floating-point operations per second (GFLOPS), which approximated that of MobileNetV2, which was 0.59 GFLOPS. Conclusions The proposed model inherited the feature-extracting ability from the DenseNet201 architecture while keeping the lightweight complexity characteristic of the MobileNet architecture.