No-Reference Image Quality Assessment with Convolutional Neural Networks and Decision Fusion

Abstract

No-reference image quality assessment (NR-IQA) has always been a difficult research problem because digital images may suffer very diverse types of distortions and their contents are extremely various. Moreover, IQA is also a very hot topic in the research community since the number and role of digital images in everyday life is continuously growing. Recently, a huge amount of effort has been devoted to exploiting convolutional neural networks and other deep learning techniques for no-reference image quality assessment. Since deep learning relies on a massive amount of labeled data, utilizing pretrained networks has become very popular in the literature. In this study, we introduce a novel, deep learning-based NR-IQA architecture that relies on the decision fusion of multiple image quality scores coming from different types of convolutional neural networks. The main idea behind this scheme is that a diverse set of different types of networks is able to better characterize authentic image distortions than a single network. The experimental results show that our method can effectively estimate perceptual image quality on four large IQA benchmark databases containing either authentic or artificial distortions. These results are also confirmed in significance and cross database tests.

An Improved Method for Evaluating Image Sharpness Based on Edge Information

“…For the obtained edge widths of different edge points, the probability 𝑃 𝜔 that the edge width is 𝜔 can be calculated by Equation (2).…”

“…With the significant advantages of non-contact, flexibility, and high integration, computer vision measurement has broad application prospects in electronic semiconductors, automotive manufacturing, food packaging, film, and other industrial fields. Image sharpness is the core index to measure the quality of visual images; therefore, the research on the evaluation method of visual image sharpness is one of the key technologies to achieve visual detection [1][2][3]. Moreover, as people demand more and more sharpness in video chats, HDTV, etc., the research of a more efficient image sharpness evaluation method has become a pressing problem nowadays.…”

Deep Learning for Video Application in Cooperative Vehicle-Infrastructure System: A Comprehensive Survey

“…Image quality assessment [33] is mainly used to predict the perceptual quality of digital images, and CNN models are found to be robust to distortion [34]. Varga, Domonkos [35] proposed a depth-based no-reference image-quality assessment architecture that incorporates multiple CNN models, which effectively evaluates image quality by considering multiple image quality scores from different CNN models. This architecture was confirmed in experimental tests.…”

A Long Short-Term Memory Biomarker-Based Prediction Framework for Alzheimer’s Disease

“…The projected work proposes a ML model for the prediction of progression to Alzheimer's disease using long short-term memory in a recurrent neural network. Deep learning has revolutionized the area of image and video processing and computer vision [31]. In the proposed model, the NM and MRI biomarkers (feature vectors) are computed and passed to the RNN.…”