Deep learning based real-time tourist spots detection and recognition mechanism

Abstract

More and more information on tourist spots is being represented as pictures rather than text. Consequently, tourists who are interested in a specific attraction shown in pictures may have no idea how to perform a text search to get more information about the interesting tourist spots. In the view of this problem and to enhance the competitiveness of the tourism market, this research proposes an innovative tourist spot identification mechanism, which is based on deep learning-based object detection technology, for real-time detection and identification of tourist spots by taking pictures on location or retrieving images from the Internet. This research establishes a tourist spot recognition system, which is a You Only Look Once version 3 model built in Tensorflow AI framework, and is used to identify tourist attractions by taking pictures with a smartphone's camera. To verify the possibility, a set of tourist spots in Hsinchu City, Taiwan is taken as an example. Currently, the tourist spot recognition system of this research can identify 28 tourist spots in Hsinchu. In addition to the attraction recognition feature, tourists can further use this tourist spot recognition system to obtain more information about 77 tourist spots from the Hsinchu City Government Information Open Data Platform, and then make dynamic travel itinerary planning and Google MAP navigation. Compared with other deep learning models using Faster region-convolutional neural networks or Single-Shot Multibox Detector algorithms for the same data set, the recognition time by the models using You Only Look Once version 3, Faster region-convolutional neural networks, and Single-Shot Multibox Detector algorithms are respectively 4.5, 5, and 9 s, and the mean average precision for each when IoU = 0.6 is 88.63%, 85%, and 43.19%, respectively. The performance experimental results of this research show the model using the You Only Look Once version 3 algorithm is more efficient and precise than the models using the Faster region-convolutional neural networks or the Single-Shot Multibox Detector algorithms, where You Only Look Once version 3 and Single-Shot Multibox Detector are one-stage learning architectures with efficient features, and Faster region-convolutional neural networks is a two-stage learning architecture with precise features.

ATiTHi: A Deep Learning Approach for Tourist Destination Classification using Hybrid Parametric Optimization

“…Some researchers integrate AI with mobile applications to assist with real-time analysis, such as locating scenic locations, taking pictures and identifying features, and planning trips. Chen uses YOLO v3 to more easily identify tourism attractions and serves as a tour guide by providing historical context for the scenic location in real-time during visitors [15].…”

Tourist Mobility Patterns: Faster R-CNN Versus YOLOv7 for Places of Interest Detection

“…Many researches, in the literature, deal with problems related to tourist such as: travel time prediction [6], tourist behavior analysis [7], tourist place recommendation systems [8], travel guide systems [9] and tourist spot detection [10],location recognition [11], etc.…”

An Intelligent Recommendation Method for Tourist Attractions Based on Deep Learning

“…Ultimately, the essential purpose of an image is to communicate an idea to the viewer visually. For example, when it comes to image enhancement, there are two sorts of approaches: spatial domain and frequency domain [ 5 ]. The term “spatial-domain” refers to gray-value arithmetic processing in the spatial domain.…”