2023
DOI: 10.1109/tbc.2022.3191059
|View full text |Cite
|
Sign up to set email alerts
|

Why No Reference Metrics for Image and Video Quality Lack Accuracy and Reproducibility

Abstract: This article provides a comprehensive overview of no reference (NR) metrics for image quality analysis (IQA) and video quality analysis (VQA). We examine 26 independent evaluations of NR metrics (previously published) and analyze 32 NR metrics on six IQA datasets and six VQA datasets (new results). Where NR metric developers claim Pearson correlation values between 0.66 and 0.99, our measurements range from 0.0 to 0.63. None of the NR metrics we analyzed are accurate enough to be deployed by industry. Performa… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1

Citation Types

0
2
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
5
1

Relationship

0
6

Authors

Journals

citations
Cited by 10 publications
(2 citation statements)
references
References 87 publications
0
2
0
Order By: Relevance
“…The sum is calculated consistently with distortions, as in algorithm for the computation of Blind Image Quality Index [12], [15]. For comprehending and assessing vision, the measurement of natural scenes is highlighted [16]- [18]. The attribute of natural statistics is applied in NR-IQA methods, which are block-oriented, i.e.…”
Section: B Natural Scene Statistics and Metricsmentioning
confidence: 99%
“…The sum is calculated consistently with distortions, as in algorithm for the computation of Blind Image Quality Index [12], [15]. For comprehending and assessing vision, the measurement of natural scenes is highlighted [16]- [18]. The attribute of natural statistics is applied in NR-IQA methods, which are block-oriented, i.e.…”
Section: B Natural Scene Statistics and Metricsmentioning
confidence: 99%
“…The methods discussed here are ML based, whereas learning free generic methods like NIQE [41] and IL-NIQE [42] also exit. The work of M H Pinson [43] draws attention towards assessment of visual media from the perspective of consumer applications. The methods like BRISQUE [29], NIQE [41], IL-NIQE [42], etc.…”
Section: Related Workmentioning
confidence: 99%