Food safety issues are inextricably linked to people’s lives and, in extreme cases, endanger public safety and social stability. People are becoming increasingly concerned about food safety issues in a modern society with high-quality economic development. People’s incomes are increasing day by day as the economy continues to grow, and the tourism industry has grown by leaps and bounds. However, many problems arose, such as the issue of food safety in tourism. Tourism food safety issues affect not only the development of the food industry but also the development of tourism. Food safety oversight of tourist attractions has always been a relatively concerning issue in the country, and it is also something that the general public is concerned about. It can be said that food safety supervision of tourist attractions is the most important thing in food safety supervision. In this context, it becomes an important task to evaluate the safety of tourist food. This work proposes a multiscale convolutional neural network (AMCNN) combined with neural networks and attention layers to realize the safety and quality evaluation of tourist food. The algorithm uses the lightweight Xception network as a basic model and utilizes multiscale depth-separable convolution modules of different sizes for feature extraction and fusion to extract richer food safety feature information. Furthermore, the convolutional attention module (CBAM) is embedded on the basis of the multiscale convolutional neural network, which makes the network model focus more on discriminative features.