Advertisement
Original Investigation|Articles in Press

Predicting EGFR Mutation Status in Non–Small Cell Lung Cancer Using Artificial Intelligence: A Systematic Review and Meta-Analysis

  • Author Footnotes
    1 Equal contributors.
    Hung Song Nguyen
    Footnotes
    1 Equal contributors.
    Affiliations
    International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan (H.S.N., N.N.N.)

    Department of Pediatrics, Pham Ngoc Thach University of Medicine, Ho Chi Minh City, Viet Nam (H.S.N.)

    Intensive Care Unit Department, Children's Hospital 1, Ho Chi Minh City, Viet Nam (H.S.N.)
    Search for articles by this author
  • Author Footnotes
    1 Equal contributors.
    Dang Khanh Ngan Ho
    Footnotes
    1 Equal contributors.
    Affiliations
    School of Nutrition and Health Sciences, College of Nutrition, Taipei Medical University, Taipei, Taiwan (D.K.N.H.)
    Search for articles by this author
  • Nam Nhat Nguyen
    Affiliations
    International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan (H.S.N., N.N.N.)
    Search for articles by this author
  • Huy Minh Tran
    Affiliations
    Department of Neurosurgery, Faculty of Medicine, University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh City, Viet Nam (H.M.T.)
    Search for articles by this author
  • Ka-Wai Tam
    Affiliations
    Center for Evidence-based Health Care, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan (K.-W.T.)

    Cochrane Taiwan, Taipei Medical University, Taipei City, Taiwan (K.-W.T.)

    Division of General Surgery, Department of Surgery, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan (K.-W.T.)

    Division of General Surgery, Department of Surgery, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan (K.-W.T.)
    Search for articles by this author
  • Nguyen Quoc Khanh Le
    Correspondence
    Address correspondence to: N.Q.K.L., Professional Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan.
    Affiliations
    Professional Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan (N.Q.K.L.)

    Research Center for Artificial Intelligence in Medicine, Taipei Medical University, Taipei 110, Taiwan (N.Q.K.L.)

    AIBioMed Research Group, Taipei Medical University, Taipei 110, Taiwan (N.Q.K.L.)

    Translational Imaging Research Center, Taipei Medical University Hospital, Taipei 110, Taiwan (N.Q.K.L.)
    Search for articles by this author
  • Author Footnotes
    1 Equal contributors.
Published:April 28, 2023DOI:https://doi.org/10.1016/j.acra.2023.03.040

      Rationale and Objectives

      Recent advancements in artificial intelligence (AI) render a substantial promise for epidermal growth factor receptor (EGFR) mutation status prediction in non–small cell lung cancer (NSCLC). We aimed to evaluate the performance and quality of AI algorithms that use radiomics features in predicting EGFR mutation status in patient with NSCLC.

      Materials and Methods

      We searched PubMed (Medline), EMBASE, Web of Science, and IEEExplore for studies published up to February 28, 2022. Studies utilizing an AI algorithm (either conventional machine learning [cML] and deep learning [DL]) for predicting EGFR mutations in patients with NSLCL were included. We extracted binary diagnostic accuracy data and constructed a bivariate random-effects model to obtain pooled sensitivity, specificity, and 95% confidence interval. This study is registered with PROSPERO, CRD42021278738.

      Results

      Our search identified 460 studies, of which 42 were included. Thirty-five studies were included in the meta-analysis. The AI algorithms exhibited an overall area under the curve (AUC) value of 0.789 and pooled sensitivity and specificity levels of 72.2% and 73.3%, respectively. The DL algorithms outperformed cML in terms of AUC (0.822 vs. 0.775) and sensitivity (80.1% vs. 71.1%), but had lower specificity (70.0% vs. 73.8%, p-value < 0.001) compared to cML. Subgroup analysis revealed that the use of positron-emission tomography/computed tomography, additional clinical information, deep feature extraction, and manual segmentation can improve diagnostic performance.

      Conclusion

      DL algorithms can serve as a novel method for increasing predictive accuracy and thus have considerable potential for use in predicting EGFR mutation status in patient with NSCLC. We also suggest that guidelines on using AI algorithms in medical image analysis should be developed with a focus on oncologic radiomics.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Barta J.A.
        • Powell C.A.
        • Wisnivesky J.P.
        Global epidemiology of lung cancer.
        Ann Glob Health. 2019; 85: 8
        • Sung H.
        • Ferlay J.
        • Siegel R.L.
        • et al.
        Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.
        CA Cancer J Clin. 2021; 71: 209-249
        • Ellison G.
        • Zhu G.
        • Moulis A.
        • et al.
        EGFR mutation testing in lung cancer: a review of available methods and their use for analysis of tumour tissue and cytology samples.
        J Clin Pathol. 2013; 66: 79-89
        • Volpi S.
        • Ali J.M.
        • Tasker A.
        • et al.
        The role of positron emission tomography in the diagnosis, staging and response assessment of non-small cell lung cancer.
        Ann Transl Med. 2018; 6: 10
        • Bhinder B.
        • Gilvary C.
        • Madhukar N.S.
        • et al.
        Artificial intelligence in cancer research and precision medicine.
        Cancer Discov. 2021; 11: 900-915
        • Rossi G.
        • Barabino E.
        • Fedeli A.
        • et al.
        Radiomic detection of EGFR mutations in NSCLC.
        Cancer Res. 2021; 81: 724-731
        • Gillies R.J.
        • Kinahan P.E.
        • Hricak H.
        Radiomics: images are more than pictures, they are data.
        Radiology. 2016; 278: 563-577
        • Liu Y.
        • Kim J.
        • Qu F.
        • et al.
        CT features associated with epidermal growth factor receptor mutation status in patients with lung adenocarcinoma.
        Radiology. 2016; 280: 271-280
        • Li Y.
        • Lv X.
        • Wang B.
        • et al.
        Predicting EGFR T790M mutation in brain metastases using multisequence MRI-based radiomics signature.
        Acad Radiol. 2022; https://doi.org/10.1016/j.acra.2022.12.030
        • Hou S.
        • Fan Y.
        • Wang X.
        • et al.
        Radiomics for detection of the EGFR mutation in liver metastatic NSCLC.
        Acad Radiol. 2022; https://doi.org/10.1016/j.acra.2022.06.016
        • Cao R.
        • Dong Y.
        • Wang X.
        • et al.
        MRI-based radiomics nomogram as a potential biomarker to predict the EGFR mutations in exon 19 and 21 based on thoracic spinal metastases in lung adenocarcinoma.
        Acad Radiol. 2022; 29: e9-e17
        • Mu W.
        • Jiang L.
        • Zhang J.
        • et al.
        Non-invasive decision support for NSCLC treatment using PET/CT radiomics.
        Nat Commun. 2020; 11: 5228
        • Wang C.
        • Ma J.
        • Shao J.
        • et al.
        Predicting EGFR and PD-L1 status in NSCLC patients using multitask AI system based on CT images.
        Front Immunol. 2022; 13: 813072
        • Salameh J.P.
        • Bossuyt P.M.
        • McGrath T.A.
        • et al.
        Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist.
        BMJ. 2020; 370: m2632
        • Whiting P.F.
        • Rutjes A.W.
        • Westwood M.E.
        • et al.
        QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies.
        Ann Intern Med. 2011; 155: 529-536
        • Lambin P.
        • Leijenaar R.T.H.
        • Deist T.M.
        • et al.
        Radiomics: the bridge between medical imaging and personalized medicine.
        Nat Rev Clin Oncol. 2017; 14: 749-762
        • Liu X.
        • Faes L.
        • Kale A.U.
        • et al.
        A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis.
        Lancet Digit Health. 2019; 1: e271-e297
        • Guo J.
        • Riebler A.
        • Rue H.
        Bayesian bivariate meta-analysis of diagnostic test studies with interpretable priors.
        Stat Med. 2017; 36: 3039-3058
        • Chang C.
        • Zhou S.
        • Yu H.
        • et al.
        A clinically practical radiomics-clinical combined model based on PET/CT data and nomogram predicts EGFR mutation in lung adenocarcinoma.
        Eur Radiol. 2021; 31: 6259-6268
        • Dong Y.
        • Hou L.
        • Yang W.
        • et al.
        Multi-channel multi-task deep learning for predicting EGFR and KRAS mutations of non-small cell lung cancer on CT images.
        Quant Imaging Med Surg. 2021; 11: 2354-2375
        • Hong D.
        • Xu K.
        • Zhang L.
        • et al.
        Radiomics signature as a predictive factor for EGFR mutations in advanced lung adenocarcinoma.
        Front Oncol. 2020; 10: 28
        • Jia T.Y.
        • Xiong J.F.
        • Li X.Y.
        • et al.
        Identifying EGFR mutations in lung adenocarcinoma by noninvasive imaging using radiomics features and random forest modeling.
        Eur Radiol. 2019; 29: 4742-4750
        • Jiang M.
        • Zhang Y.
        • Xu J.
        • et al.
        Assessing EGFR gene mutation status in non-small cell lung cancer with imaging features from PET/CT.
        Nucl Med Commun. 2019; 40: 842-849
        • Jiang X.
        • Ren M.
        • Shuang X.
        • et al.
        Multiparametric MRI-based radiomics approaches for preoperative prediction of EGFR mutation status in spinal bone metastases in patients with lung adenocarcinoma.
        J Magn Reson Imaging. 2021; 54: 497-507
        • Koyasu S.
        • Nishio M.
        • Isoda H.
        • et al.
        Usefulness of gradient tree boosting for predicting histological subtype and EGFR mutation status of non-small cell lung cancer on (18)F FDG-PET/CT.
        Ann Nucl Med. 2020; 34: 49-57
        • Le N.Q.K.
        • Kha Q.H.
        • Nguyen V.H.
        • et al.
        Machine learning-based radiomics signatures for EGFR and KRAS mutations prediction in non-small-cell lung cancer.
        Int J Mol Sci. 2021; 22: 17
        • Li S.
        • Ding C.
        • Zhang H.
        • et al.
        Radiomics for the prediction of EGFR mutation subtypes in non-small cell lung cancer.
        Med Phys. 2019; 46: 4545-4552
        • Li X.
        • Yin G.
        • Zhang Y.
        • et al.
        Predictive power of a radiomic signature based on (18)F-FDG PET/CT images for EGFR mutational status in NSCLC.
        Front Oncol. 2019; 9: 1062
        • Li X.Y.
        • Xiong J.F.
        • Jia T.Y.
        • et al.
        Detection of epithelial growth factor receptor (EGFR) mutations on CT images of patients with lung adenocarcinoma using radiomics and/or multi-level residual convolutionary neural networks.
        J Thorac Dis. 2018; 10: 6624-6635
        • Li Y.
        • Lu L.
        • Xiao M.
        • et al.
        CT slice thickness and convolution Kernel affect performance of a radiomic model for predicting EGFR status in non-small cell lung cancer: a preliminary study.
        Sci Rep. 2018; 8: 17913
        • Liu G.
        • Xu Z.
        • Ge Y.
        • et al.
        3D radiomics predicts EGFR mutation, exon-19 deletion and exon-21 L858R mutation in lung adenocarcinoma.
        Transl Lung Cancer Res. 2020; 9: 1212-1224
        • Liu Y.
        • Kim J.
        • Balagurunathan Y.
        • et al.
        Radiomic features are associated with EGFR mutation status in lung adenocarcinomas.
        Clin Lung Cancer. 2016; 17 (441–448.e6)
        • Lu L.
        • Sun S.H.
        • Yang H.
        • et al.
        Radiomics prediction of EGFR status in lung cancer – our experience in using multiple feature extractors and the cancer imaging archive data.
        Tomography. 2020; 6: 223-230
        • Mei D.
        • Luo Y.
        • Wang Y.
        • et al.
        CT texture analysis of lung adenocarcinoma: can radiomic features be surrogate biomarkers for EGFR mutation statuses.
        Cancer Imaging. 2018; 18: 52
        • Moreno S.
        • Bonfante M.
        • Zurek E.
        • et al.
        A radiogenomics ensemble to predict EGFR and KRAS mutations in NSCLC.
        Tomography. 2021; 7: 154-168
        • Nair J.K.R.
        • Saeed U.A.
        • McDougall C.C.
        • et al.
        Radiogenomic models using machine learning techniques to predict EGFR mutations in non-small cell lung cancer.
        Can Assoc Radiol J. 2021; 72: 109-119
        • Ninomiya K.
        • Arimura H.
        • Chan W.Y.
        • et al.
        Robust radiogenomics approach to the identification of EGFR mutations among patients with NSCLC from three different countries using topologically invariant Betti numbers.
        PLoS One. 2021; 16e0244354
        • Qin R.
        • Wang Z.
        • Qiao K.
        • et al.
        Multi-type interdependent feature analysis based on hybrid neural networks for computer-aided diagnosis of epidermal growth factor receptor mutations.
        IEEE Access. 2020; 8: 38517-38527
        • Ren M.
        • Yang H.
        • Lai Q.
        • et al.
        MRI-based radiomics analysis for predicting the EGFR mutation based on thoracic spinal metastases in lung adenocarcinoma patients.
        Med Phys. 2021; 48: 5142-5151
        • Shiri I.
        • Maleki H.
        • Hajianfar G.
        • et al.
        Next-generation radiogenomics sequencing for prediction of EGFR and KRAS mutation status in NSCLC patients using multimodal imaging and machine learning algorithms.
        Mol Imaging Biol. 2020; 22: 1132-1148
        • Silva F.
        • Pereira T.
        • Morgado J.
        • et al.
        EGFR assessment in lung cancer CT images: analysis of local and holistic regions of interest using deep unsupervised transfer learning.
        IEEE Access. 2021; 9: 58667-58676
        • Tu W.
        • Sun G.
        • Fan L.
        • et al.
        Radiomics signature: a potential and incremental predictor for EGFR mutation status in NSCLC patients, comparison with CT morphology.
        Lung Cancer. 2019; 132: 28-35
        • Wang C.
        • Ma J.
        • Shao J.
        • et al.
        Predicting EGFR and PD-L1 status in NSCLC patients using multitask AI system based on CT images.
        Front Immunol. 2022; 13813072
        • Wang S.
        • Shi J.
        • Ye Z.
        • et al.
        Predicting EGFR mutation status in lung adenocarcinoma on computed tomography image using deep learning.
        Eur Respir J. 2019; 53: 1800986
        • Weng Q.
        • Hui J.
        • Wang H.
        • et al.
        Radiomic feature-based nomogram: a novel technique to predict EGFR-activating mutations for EGFR tyrosin kinase inhibitor therapy.
        Front Oncol. 2021; 11590937
        • Wu S.
        • Shen G.
        • Mao J.
        • et al.
        CT radiomics in predicting EGFR mutation in non-small cell lung cancer: a single institutional study.
        Front Oncol. 2020; 10542957
        • Xiong J.
        • Li X.
        • Lu L.
        • et al.
        Implementation strategy of a CNN model affects the performance of CT assessment of EGFR mutation status in lung cancer patients.
        IEEE Access. 2019; 7: 64583-64591
        • Yang B.
        • Ji H.S.
        • Zhou C.S.
        • et al.
        (18)F-fluorodeoxyglucose positron emission tomography/computed tomography-based radiomic features for prediction of epidermal growth factor receptor mutation status and prognosis in patients with lung adenocarcinoma.
        Transl Lung Cancer Res. 2020; 9: 563-574
        • Yang C.
        • Chen W.
        • Gong G.
        • et al.
        Application of CT radiomics features to predict the EGFR mutation status and therapeutic sensitivity to TKIs of advanced lung adenocarcinoma.
        Transl Cancer Res. 2020; 9: 6683-6690
        • Yin G.
        • Wang Z.
        • Song Y.
        • et al.
        Prediction of EGFR mutation status based on (18)F-FDG PET/CT imaging using deep learning-based model in lung adenocarcinoma.
        Front Oncol. 2021; 11709137
        • Zhang B.
        • Qi S.
        • Pan X.
        • et al.
        Deep CNN model using CT radiomics feature mapping recognizes EGFR gene mutation status of lung adenocarcinoma.
        Front Oncol. 2020; 10598721
        • Zhang G.
        • Cao Y.
        • Zhang J.
        • et al.
        Predicting EGFR mutation status in lung adenocarcinoma: development and validation of a computed tomography-based radiomics signature.
        Am J Cancer Res. 2021; 11: 546-560
        • Zhang J.
        • Zhao X.
        • Zhao Y.
        • et al.
        Value of pre-therapy (18)F-FDG PET/CT radiomics in predicting EGFR mutation status in patients with non-small cell lung cancer.
        Eur J Nucl Med Mol Imaging. 2020; 47: 1137-1146
        • Zhang M.
        • Bao Y.
        • Rui W.
        • et al.
        Performance of (18)F-FDG PET/CT radiomics for predicting EGFR mutation status in patients with non-small cell lung cancer.
        Front Oncol. 2020; 10568857
        • Zhang T.
        • Xu Z.
        • Liu G.
        • et al.
        Simultaneous identification of EGFR, KRAS, ERBB2, and TP53 mutations in patients with non-small cell lung cancer by machine learning-derived three-dimensional radiomics.
        Cancers (Basel). 2021; 13: 1814
        • Zhao W.
        • Wu Y.
        • Xu Y.
        • et al.
        The potential of radiomics nomogram in non-invasively prediction of epidermal growth factor receptor mutation status and subtypes in lung adenocarcinoma.
        Front Oncol. 2019; 9: 1485
        • Zhao W.
        • Yang J.
        • Ni B.
        • et al.
        Toward automatic prediction of EGFR mutation status in pulmonary adenocarcinoma with 3D deep learning.
        Cancer Med. 2019; 8: 3532-3543
        • Zhu Y.
        • Guo Y.B.
        • Xu D.
        • et al.
        A computed tomography (CT)-derived radiomics approach for predicting primary co-mutations involving TP53 and epidermal growth factor receptor (EGFR) in patients with advanced lung adenocarcinomas (LUAD).
        Ann Transl Med. 2021; 9: 545
        • Chan B.A.
        • Hughes B.G.M.
        Targeted therapy for non-small cell lung cancer: current standards and the promise of the future.
        Transl Lung Cancer Res. 2015; 4: 36-54
        • Aatresh A.A.
        • Alabhya K.
        • Lal S.
        • et al.
        LiverNet: efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images.
        Int J Comput Assist Radiol Surg. 2021; 16: 1549-1563
        • Cho S.J.
        • Sunwoo L.
        • Baik S.H.
        • et al.
        Brain metastasis detection using machine learning: a systematic review and meta-analysis.
        Neuro Oncol. 2021; 23: 214-225
        • Hung T.N.K.
        • Vy V.P.T.
        • Tri N.M.
        • et al.
        Automatic detection of meniscus tears using backbone convolutional neural networks on knee MRI.
        J Magn Reson Imaging. 2023; 57: 740-749
        • Wang S.
        • Liu Z.
        • Rong Y.
        • et al.
        Deep learning provides a new computed tomography-based prognostic biomarker for recurrence prediction in high-grade serous ovarian cancer.
        Radiother Oncol. 2019; 132: 171-177
        • Gregory J.
        • Welliver S.
        • Chong J.
        Top 10 reviewer critiques of radiology artificial intelligence (AI) articles: qualitative thematic analysis of reviewer critiques of machine learning/deep learning manuscripts submitted to JMRI.
        J Magn Reson Imaging. 2020; 52: 248-254
        • Park S.H.
        • Han K.
        Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction.
        Radiology. 2018; 286: 800-809
        • Mayerhoefer M.E.
        • Materka A.
        • Langs G.
        • et al.
        Introduction to radiomics.
        J Nucl Med. 2020; 61: 488-495
        • Yan J.
        • Liu L.
        • Wang W.
        • et al.
        Radiomic features from multi-parameter MRI combined with clinical parameters predict molecular subgroups in patients with medulloblastoma.
        Front Oncol. 2020; 10558162