Estimating task-based performance bounds for image reconstruction methods by use of learned-ideal observers

Abstract

Medical imaging systems are commonly assessed and optimized by use of objective measures of image quality (IQ). The performance of the Ideal Observer (IO) acting on imaging measurements has long been advocated as a figureof-merit to guide the optimization of imaging systems. For computed imaging systems, the performance of the IO acting on imaging measurements also sets an upper bound on task-performance that no image reconstruction method can transcend. As such, estimation of IO performance can provide valuable guidance when designing data-acquisition techniques by enabling the identification of designs that will not permit the reconstruction of diagnostically useful images for a specified task -no matter how advanced the reconstruction method is or plausible the reconstructed images appear. The need for such analyses is urgent because of the ubiquitous development of deep learning-based image reconstruction methods and the fact that they are often not assessed by use of objective image quality measures. However, until recently, estimation of the IO was generally intractable when clinically relevant objects and imaging conditions were assumed. In this work, for the first time, estimates of the IO acting on tomographic imaging measurements were computed with consideration of realistic object variability to establish task-based performance bounds for image reconstruction methods. This was accomplished by use of a recently developed learning-based procedure. Numerical studies that were inspired by breast Xray computed tomography were conducted to validate and demonstrate the approach. The effectiveness of the approximation method was validated on raw measurements for a signal-known-exactly and backgroundknown-exactly (SKE/BKE) binary signal detection task. A signal-known-statistically and background-knownstatistically (SKS/BKS) binary signal detection task was also addressed and the impact of the number of views on IO performance was assessed.

Application of learned ideal observers for estimating task-based performance bounds for computed imaging systems

“…Preliminary results of this work were presented at the 2023 SPIE Medical Imaging Conference and published as an SPIE Proceedings paper. 16 Fig. 10 The training process of the CNN-IO was demonstrated.…”

“…However, it has not been widely acknowledged in the recent literature that situations can exist in which incomplete and noisy tomographic measurement data will not permit the reconstruction of diagnostically useful images, no matter how advanced the reconstruction method is or plausible the reconstructed images appear. 16 Estimating the performance of the data space IO provides a means for identifying these situations. Such analyses will enable the triage of dataacquisition designs and associated image reconstruction development efforts that can never result in a required diagnostic performance, regardless of who or what will be ultimately interpreting the images.…”