Visual saliency models for summarization of diagnostic hysteroscopy videos in healthcare systems

Abstract

In clinical practice, diagnostic hysteroscopy (DH) videos are recorded in full which are stored in long-term video libraries for later inspection of previous diagnosis, research and training, and as an evidence for patients’ complaints. However, a limited number of frames are required for actual diagnosis, which can be extracted using video summarization (VS). Unfortunately, the general-purpose VS methods are not much effective for DH videos due to their significant level of similarity in terms of color and texture, unedited contents, and lack of shot boundaries. Therefore, in this paper, we investigate visual saliency models for effective abstraction of DH videos by extracting the diagnostically important frames. The objective of this study is to analyze the performance of various visual saliency models with consideration of domain knowledge and nominate the best saliency model for DH video summarization in healthcare systems. Our experimental results indicate that a hybrid saliency model, comprising of motion, contrast, texture, and curvature saliency, is the more suitable saliency model for summarization of DH videos in terms of extracted keyframes and accuracy.

Effective Video Summarization Approach Based on Visual Attention

“…This section provides a comparison between the proposed approach and 4 outstanding nonvisual attention patterns: DT [11], VSUMM [12], OV [13] and STIMO [31]. All these technologies rely on low-level features extracted from the video frames.…”

“…A model of spatial attention is designed by calculating visual salience on the basis of a description of images known as "image signature". The signature of the image may be utilized to estimate the image of the foreground [31,32]. The essential hypothesis is the foreground of a picture, which is visually more obvious compared to the background.…”

Efficient Deep CNN-Based Fire Detection and Localization in Video Surveillance Applications

“…We compared our results with four other fire detection algorithms in terms of their relevancy, dataset, and year of publication. To ensure a fair evaluation and a full overview of the performance of our approach, we considered another set of metrics (precision, recall, and F-measure [38]) as used by [35]. In a similar way to the experiments on Dataset1, we tested Dataset2 using the fine-tuned AlexNet and our proposed fine-tuned SqueezeNet model.…”

A privacy-preserving cryptosystem for IoT E-healthcare

“…The authorized users should be able to decode the encrypted data using the secret keys of a decryption algorithm. The security heavily relies on keeping the secret key confidential from attackers, and not the encryption machine as illustrated by Kirchhoff's principle [28]. Encryption is the main mechanism to ensure the security of digital images during transmission.…”