Pulse Sequence Dependence of a Simple and Interpretable Deep Learning Method for Detection of Clinically Significant Prostate Cancer Using Multiparametric MRI

Published:November 02, 2022DOI:


      • A simple convolutional network incorporating 3 pulse-sequences outperforms any one sequence for detecting significant prostate cancer.
      • A composite including dynamic contrast enhancement correlates with grade.
      • This model may outperform conventional assessment methods, such as PI-RADS.

      Rationale and Objectives

      Multiparametric magnetic resonance imaging (mpMRI) is increasingly used for risk stratification and localization of prostate cancer (PCa). Thanks to the great success of deep learning models in computer vision, the potential application for early detection of PCa using mpMRI is imminent.

      Materials and Methods

      Deep learning analysis of the PROSTATEx dataset.


      In this study, we show a simple convolutional neural network (CNN) with mpMRI can achieve high performance for detection of clinically significant PCa (csPCa), depending on the pulse sequences used. The mpMRI model with T2-ADC-DWI achieved 0.90 AUC score in the held-out test set, not significantly better than the model using Ktrans instead of DWI (AUC 0.89). Interestingly, the model incorporating T2-ADC- Ktrans better estimates grade. We also describe a saliency “heat” map. Our results show that csPCa detection models with mpMRI may be leveraged to guide clinical management strategies.


      Convolutional neural networks incorporating multiple pulse sequences show high performance for detection of clinically-significant prostate cancer, and the model including dynamic contrast-enhanced information correlates best with grade.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Siegel RL.
        • Miller KD.
        • Fuchs HE.
        • et al.
        Cancer statistics, 2022.
        CA: Cancer J Clin. 2022; 72: 7-33
        • Turkbey B.
        • Rosenkrantz AB.
        • Haider MA.
        • et al.
        Prostate imaging reporting and data system version 2.1: 2019 update of prostate imaging reporting and data system version 2.
        Euro Urol. 2019; 76: 340-351
        • Rosenkrantz AB.
        • Babb JS.
        • Taneja SS.
        • et al.
        Proposed adjustments to PI-RADS version 2 decision rules: impact on prostate cancer detection.
        Radiology. 2017; 283: 119-129
        • Armato SG.
        • Huisman H.
        • Drukker K.
        • et al.
        PROSTATEx Challenges for computerized classification of prostate lesions from multiparametric magnetic resonance images.
        J Med Imag. 2018; 5044501
        • Liu S
        • Zheng H.
        • Feng Y.
        • et al.
        Prostate cancer diagnosis using deep learning with 3D multiparametric MRI.
        Medical imaging 2017: computer-aided diagnosis. 10134. SPIE, Bellingham, WA2017
        • Seah JCY
        • Tang JSN
        • Kitchen A
        Detection of prostate cancer on multiparametric MRI.
        Medical imaging 2017: computer-aided diagnosis. 10134. International Society for Optics and Photonics, Bellingham, WA2017
        • Mehrtash A
        • Sedghi A.
        • Ghafoorian M.
        • et al.
        Classification of clinical significance of MRI prostate findings using 3D convolutional neural networks.
        Medical imaging 2017: computer-aided diagnosis. 10134. International Society for Optics and Photonics, Bellingham, WA2017
        • Litjens G
        • Debats O
        • Barentsz J
        • et al.
        ProstateX challenge data.
        The cancer imaging archive. 2017
        • Pellicer-Valero OJ.
        • Marenco Jiménez JL.
        • Gonzalez-Perez V.
        • et al.
        Deep learning for fully automatic detection, segmentation, and Gleason Grade estimation of prostate cancer in multiparametric Magnetic Resonance Images.
        Sci Rep. 2022; 12: 1-13
        • Selvaraju RR.
        • Cogswell M.
        • Das A.
        • et al.
        Grad-cam: Visual explanations from deep networks via gradient-based localization.
        in: Proceedings of the IEEE international conference on computer vision. 2017
        • DeLong ER.
        • DeLong DM.
        • Clarke-Pearson DL.
        Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.
        Biometrics. 1988; 44: 837-845
        • McNemar Q
        Note on the sampling error of the difference between correlated proportions or percentages.
        Psychometrika. 1947; 12: 153-157
        • Sun X
        • Xu W
        Fast implementation of DeLong's algorithm for comparing the areas under correlated receiver operating characteristic curves.
        IEEE Signal Process Letter. 2014; 21: 1389-1393
        • Vos EK.
        • Litjens GJ
        • Kobus T.
        • et al.
        Assessment of prostate cancer aggressiveness using dynamic contrast-enhanced magnetic resonance imaging at 3 T.
        Euro Urol. 2013; 64: 448-455
        • Schoots IG.
        • Barentsz JO.
        • Bittencourt LK.
        • et al.
        PI-RADS Committee position on MRI without contrast medium in biopsy-naive men with suspected prostate cancer: narrative review.
        American Journal of Roentgenology. 2021; 216: 3-19