A New Tool for Collaborative Video Search via Content-based Retrieval and Visual Inspection

Abstract

We present a new approach for collaborative video search and video browsing relying on a combination of traditional, indexbased video retrieval complemented with large-scale human-based visual inspection. In particular, a traditional PC interface is used for query-based search using advanced indexing and querying methods (e.g., concept search), whereas a visualization of the database on a tablet is used for pure human-based browsing. Both parts are coupled to compensate for mutual disadvantages; human visual inspection allows for a better, more detailed analysis of the data -also bridging the semantic gap -but comes at the price of an unfiltered database -a disadvantage that is resolved by using the results from the query engine to change visualization order.

VideoAnalysis4ALL

“…Alternatively, multi-modal approaches that combine different streams of the media content have been also proposed, such as the AXES-LITE video search engine [11], which integrates algorithms for textbased, visual-concept-based and visual-similarity-based retrieval of videos; and, the interactive system of [12], which represents the visual content of a video collection with the help of over 2500 highquality pre-trained semantic concept detectors and applies text analysis on ASR and OCR data, allowing users to do multi-modal text-to-video and video-to-video search in large video collections. Many more interactive video search engines have been presented, e.g., [23], [13], [15] and [20].…”