The Modulation Transfer Function (MTF) and the Noise Power Spectrum (NPS) characterize imaging system sharpness/resolution and noise, respectively. Both measures are based on linear system theory but are applied routinely to systems employing non-linear, content-aware image processing. For such systems, MTFs/NPSs are derived inaccurately from traditional test charts containing edges, sinusoids, noise or uniform tone signals, which are unrepresentative of natural scene signals. The dead leaves test chart delivers improved measurements, but still has limitations when describing the performance of scene-dependent systems. In this paper, we validate several novel scene-and-process-dependent MTF (SPD-MTF) and NPS (SPD-NPS) measures that characterize, either: i) system performance concerning one scene, or ii) average real-world performance concerning many scenes, or iii) the level of system scene-dependency. We also derive novel SPD-NPS and SPD-MTF measures using the dead leaves chart. We demonstrate that all the proposed measures are robust and preferable for scene-dependent systems than current measures.
The Natural Scene derived Spatial Frequency Response (NS-SFR) is a novel camera system performance measure that derives SFRs directly from images of natural scenes and processes them using ISO12233 edge-based SFR (e-SFR) algorithm. NS-SFR is a function of both camera system performance and scene content. It is measured directly from captured scenes, thus eliminating the use of test charts and strict laboratory conditions. The effective system e-SFR can be subsequently estimated from NS-SFRs using statistical analysis and a diverse dataset of scenes. This paper first presents the NS-SFR measuring framework, which locates, isolates, and verifies suitable step-edges from captures of natural scenes. It then details a process for identifying the most likely NS-SFRs for deriving the camera system e-SFR. The resulting estimates are comparable to standard e-SFRs derived from test chart inputs, making the proposed method a viable alternative to the ISO technique, with potential for real-time camera system performance measurements.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.