With the continuous development of intelligent refrigerators, users are having higher and higher requirements for smart management of refrigerator contents. When using traditional machine learning algorithms to deal with refrigerator ingredients classification, problems such as slow recognition speed and low accuracy would often arise. At the same time, the classification accuracy is easily affected by the location of the content. Therefore, this paper uses continuous asymmetric convolutions and depthwise separable convolutions to improve the original Inception model and builds a classification prediction network based on the improved Inception model. The steps to applying the said model is as follows: First, we put the Radio Frequency Identification (RFID) tag on the food in the refrigerator, and then we collect the antenna data RSSI received by each tag through the reader. Finally, the RSSI is preprocessed and entered into the classification network to determine the location of the label. The proposed classification network has the advantages of possessing a simple structure, easy expansion of network depth, and fewer training parameters. The experimental results show that compared with other machine learning algorithms and pure convolution networks, the lightweight network model based on the improved Inception structure demonstrates great superiority. Compared with the original Inception structure, the enhanced network model is more lightweight. The number of parameters is reduced by 50%, and the amount of float-point operations is reduced by 34%. Meanwhile, the accuracy of the lightweight model has been improved by 0.6%. Thus the improved model has better prediction performance in the classification of refrigerator content.