Shot-boundary detection: unraveled and resolved?

Abstract

Abstract-Partitioning a video sequence into shots is the first step toward video-content analysis and content-based video browsing and retrieval. A video shot is defined as a series of interrelated consecutive frames taken contiguously by a single camera and representing a continuous action in time and space. As such, shots are considered to be the primitives for higher level content analysis, indexing, and classification. The objective of this paper is twofold. First, we analyze the shot-boundary detection problem in detail and identify major issues that need to be considered in order to solve this problem successfully. Then, we present a conceptual solution to the shot-boundary detection problem in which all issues identified in the previous step are considered. This solution is provided in the form of a statistical detector that is based on minimization of the average detection-error probability. We model the required statistical functions using a robust metric for visual content discontinuities (based on motion compensation) and take into account all (a priori) knowledge that we found relevant to shot-boundary detection. This knowledge includes the shot-length distribution, visual discontinuity patterns at shot boundaries, and characteristic temporal changes of visual features around a boundary. Major advantages of the proposed detector are its robust and sequence-independent performance, while there is also the possibility to detect different types of shot boundaries simultaneously. We demonstrate the performance of our detector regarding two most widely used types of shot boundaries: hard cuts and dissolves.Index Terms-Shot-boundary detection, video analysis, video databases, video retrieval.

Scalable gastroscopic video summarization via similar-inhibition dictionary selection

“…To capture the content changes in a video sequence, most existing approaches first segment the whole video into shots using shot detection methods and then select key frames from each shot [12,13]. The simplest method is to select the first/middle/last frame of each shot as key frames.…”

A Shot Boundary Detection Technique Based on Local Color Moments in YCbCr Color Space

“…The various approaches differ in the type of features used. The detection of boundaries between video shots provides a basis for almost all of the existing video segmentation and abstraction methods [1]. However, it is quite difficult to give a precise definition of a video shot transition since many factors such as camera motions may change the video content significantly.…”

Video shot segmentation using fusion of SVD and mutual information features

“…Noticing the weakness (hight sensitivity to the object and camera motions) of pixel differencing methods, many researchers suggested the use of different measures based on global information such as intensity histograms or color histograms [3], [4], [5]. The use of more complex features, such as image edges or motion vectors [6], improves the situation, but does not solve the problem completely [7].…”