Task-based evaluation of deep image super-resolution in medical imaging

[Paper]

In medical imaging, it is sometimes desirable to acquire high resolution images that reveal anatomical and physiological information to support clinical practice such as diagnosis and image-guided therapies. However, for certain imaging modalities (i.e., magnetic resonance imaging (MRI)), acquiring high resolution images can be a very time-consuming and resource-intensive process. One popular solution recently developed is to create a high resolution version of the acquired low-resolution image by use of deep image super-resolution (DL-SR) methods. It has been demonstrated in literature that deep super-resolution networks can improve the image quality measured by traditional physical metrics such as mean square error (MSE), structural similarity index metric (SSIM) and peak signal-to-noise ratio (PSNR). However, it is not clear how well these metrics quantify the diagnostic value of the generated SR images. Here, a task-based super-resolution (SR) image quality assessment is conducted to quantitatively evaluate the efficiency and performance of DL-SR methods. A Rayleigh task is designed to investigate the impact of signal length and super-resolution network complexity on s binary detection performance. Numerical observers (NOs) including the regularized Hotelling Observer (RHO), the anthropomorphic Gabor channelized observers (Gabor CHO) and the ResNet-approximated ideal observer (ResNet-IO) are implemented to assess the Rayleigh task performance. For the datasets considered in this study, little to no improvement in task performance of the considered NOs due to the considered DL-SR SR networks, despite substantial improvement in traditional IQ metrics.

Publications

  1. Kelkar, V. A., Zhang, X., Granstedt, J., Li, H., & Anastasio, M. A. (2021, February). Task-based evaluation of deep image super-resolution in medical imaging. In Medical Imaging 2021: Image Perception, Observer Performance, and Technology Assessment (Vol. 11599, p. 115990X). International Society for Optics and Photonics.
  2. Zhang, X., Kelkar, V. A., Granstedt, J., Li, H., & Anastasio, M. A. (2021). Impact of deep learning-based image super-resolution on binary signal detection. Journal of Medical Imaging, 8(6), 065501.