Video Data Model and Retrieval Service Framework Using Geographic Information

Abstract

Along with a rapid growth in the volume of user-generated video clips, efficient video retrieval methods have become one of the most critical challenges in multimedia management. In this article, we propose a service framework using geographic information for retrieval of the videos on the web. The main idea is to describe and query videos by video-related geographic data such as video location, field of view and trajectory. Based on the point, line and polygon description for videos, we define the commonly used video retrieval methods. A video retrieval service framework and the service interfaces are designed based on the REST architecture. A prototype system is also implemented to test the services. The experiment shows that the proposed video description, retrieval methods and web services are feasible and useful. We believe that the integration of geographical video retrieval methods into existing methods will promote the geo-tagged video sharing, discovery and consumption in various web applications.

INFORSID 2018 Forum Jeunes Chercheuses Jeunes Chercheurs

“…Ce modèle est orienté "classification des vidéos" et nécessite d'autres spécifications pour être utilisé dans notre contexte. Un framework utilisant des informations géographiques pour la récupération des vidéos sur le web est présenté dans (Han et al, 2016). Les auteurs décrivent et utilisent des données géographiques liées à la vidéo, telles que la localisation vidéo, le champ de vue de la caméra et les trajectoires pour effectuer des recherches dans les vidéos.Cependant, la qualité d'images/vidéos n'est pas prise en compte.…”

Integration of Multi-Camera Video Moving Objects and GIS

“…According to different mapping methods, the information fusion methods of surveillance video and virtual scene are divided into two categories: GIS-video image fusion (image projection) [37] and GIS-video moving object fusion (object projection) [38]. The implementation forms of GIS-video image fusion, including video image linked search analysis [4] and videos that are projected to the geographic scene [33], are easy to implement but lack the ability to analyze and understand video image contents. The object projection method extracts video semantic objects from the original video through object detection.…”

“…V-GIS is a geographical environment perception and analysis platform that integrates a traditional video analysis system within GIS. Under the unified geographic reference, a geospatial data service supports surveillance image intelligence analysis and realizes image-scene integrated modeling [1], video data spatialization [2], video data management analysis [3], virtual reality (VR) fusion expression [4], and other related functions. Unlike other GIS data, videos have large data volume, sparse distribution of video moving objects (like pedestrians and vehicles), and complex spatial-temporal correlation of video moving objects from different cameras.…”

Interactive video maps: A year in the life of Earth's CO2

“…Areally georeferenced video or video enriched with geographic information, such as the field of view and trajectory information (Han, Cui, Kong, Qin, & Fu, 2015), has surveillance and intelligence applications (Lewis, Fotheringham, & Winstanley, 2011), and is collected by aerial vehicles or terrestrial cameras. Various geographic information systems provide specialized tools for georeferencing, visualizing, and analyzing spatial video (Han et al, 2015;Lewis et al, 2011), but real-time video georectification is computational expensive and with limited accuracy.…”

“…Various geographic information systems provide specialized tools for georeferencing, visualizing, and analyzing spatial video (Han et al, 2015;Lewis et al, 2011), but real-time video georectification is computational expensive and with limited accuracy. Because camera location and orientation constantly change over time, each frame must be georeferenced individually.…”