Advertisement

Computer-Aided Detection of Seven Chest Pathologies on Standard Posteroanterior Chest X-Rays Compared to Radiologists Reading Dual-Energy Subtracted Radiographs

Published:October 24, 2021DOI:https://doi.org/10.1016/j.acra.2021.09.016

      Rationale and Objectives

      Retrospective performance evaluation of a computer-aided detection (CAD) system on standard posteroanterior (PA) chest radiographs (PA-CXR) in detection of pulmonary nodules, infectious consolidation, pneumothorax, pleural effusion, aortic calcification, cardiomegaly and rib fractures compared to radiologists analyzing PA-CXR including dual-energy subtraction radiography (further termed as DESR).

      Materials and Methods

      PA-CXR/DESR images of 197 patients were included. All patients underwent chest CT (gold standard) within a short interval (mean 28 hours). All images were evaluated by three blinded readers for the presence of pulmonary nodules, infectious consolidation, pneumothorax, pleural effusion, aortic calcification, cardiomegaly, and rib fractures. Meanwhile PA-CXR were analyzed by a CAD software. CAD results were compared to the majority result of the three readers. Sensitivity and specificity were calculated. McNemar's test was applied to test for significant differences. Interobserver agreement was defined using Cohen's kappa (κ).

      Results

      Sensitivity of the CAD software was significantly higher (p < 0.05) for detection of infectious consolidation and pulmonary nodules (67.9% vs 26.8% and 54% vs 35.6%, respectively; p < 0.001) compared to radiologists analyzing DESR images. For the residual evaluated pathologies no statistical significant differences could be found. Overall, mean inter observer agreement between the three radiologists was moderate (k = 0.534). The best interobserver agreement could be reached for pneumothorax (k = 0.708) and pleural effusion (k = 0.699), while the worst was obtained for rib fractures (k = 0.412).

      Conclusion

      The CAD system has the potential to improve the detection of infectious consolidation and pulmonary nodules on CXR images.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Fitzmaurice C
        • Allen C
        • Barber RM
        • et al.
        Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 32 cancer groups, 1990 to 2015: a systematic analysis for the global burden of disease study.
        JAMA Oncol. 2017; 3: 524-548
        • Bradley SH
        • Abraham S
        • Callister ME
        • et al.
        Sensitivity of chest X-ray for detecting lung cancer in people presenting with symptoms: a systematic review.
        Br J Gen Pract. 2019; 69: e827-e835
        • Sone S
        • Li F
        • Yang ZG
        • et al.
        Characteristics of small lung cancers invisible on conventional chest radiography and detected by population based screening using spiral CT.
        Br J Radiol. 2000; 73: 137-145
        • Shah PK
        • Austin JH
        • White CS
        • et al.
        Missed non-small cell lung cancer: radiographic findings of potentially resectable lesions evident only in retrospect.
        Radiology. 2003; 226: 235-241
        • Austin JH
        • Romney BM
        • Goldsmith LS.
        Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially respectable lesion evident in retrospect.
        Radiology. 1992; 182: 115-122
        • Chotas HG
        • Ravin CE.
        Chest radiography: estimated lung volume and projected area obscured by the heart, mediastinum, and diaphragm.
        Radiology. 1994; 193: 403-404
        • Turkington PM
        • Kennan N
        • Greenstone MA.
        Misinterpretation of the chest x ray as a factor in the delayed diagnosis of lung cancer.
        Postgrad Med J. 2002; 78: 158-160
        • Quekel LG
        • Kessels AG
        • Goei R
        • et al.
        Detection of lung cancer on the chest radiograph: a study on observer performance.
        Eur J Radiol. 2001; 39: 111-116
        • Li F
        • Engelmann R
        • Doi K
        • et al.
        Improved detection of small lung cancers with dual-energy subtraction chest radiography.
        AJR Am J Roentgenol. 2008; 190: 886-891
        • White CS
        • Flukinger T
        • Jeudy J
        • et al.
        Use of a computer-aided detection system to detect missed lung cancer at chest radiography.
        Radiology. 2009; 252: 273-281
        • Balkman JD
        • Mehandru S
        • DuPont E
        • et al.
        Dual energy subtraction digital radiography improves performance of a next generation computer-aided detection program.
        J Thorac Imaging. 2010; 25: 41-47
        • Mahomed N
        • van Ginneken B
        • Philipsen RHHM
        • et al.
        Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children.
        Pediatr Radiol. 2020; 50: 482-491
        • Szucs-Farkas Z
        • Patak MA
        • Yuksel-Hatz S
        • et al.
        Improved detection of pulmonary nodules on energy-subtracted chest radiographs with a commercial computer-aided diagnosis software: comparison with human observers.
        Eur Radiol. 2010; 20: 1289-1296
        • Ricke J
        • Fischbach F
        • Freund T
        • et al.
        Clinical results of CsI-detector-based dual-exposure dual energy in chest radiography.
        Eur Radiol. 2003; 13: 2577-2582
        • Lee KH
        • Goo JM
        • Park CM
        • et al.
        Computer-aided detection of malignant lung nodules on chest radiographs: effect on observers' performance.
        Korean J Radiol. 2012; 13: 564-571
        • Kakeda S
        • Moriya J
        • Sato H
        • et al.
        Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system.
        AJR Am J Roentgenol. 2004; 182: 505-510
        • Vock P
        • Szucs-Farkas Z.
        Dual energy subtraction: principles and clinical applications.
        Eur J Radiol. 2009; 72: 231-237
        • Mafi JN
        • Fei B
        • Roble S
        • et al.
        Assessment of coronary artery calcium using dual-energy subtraction digital radiography.
        J Digit Imaging. 2012; 25: 129-136
        • Gilkeson RC
        • Novak RD
        • Sachs P.
        Digital radiography with dual-energy subtraction: improved evaluation of cardiac calcification.
        AJR Am J Roentgenol. 2004; 183: 1233-1238
        • Fischbach F
        • Freund T
        • Röttgen R
        • et al.
        Dual-energy chest radiography with a flat-panel digital detector: revealing calcified chest abnormalities.
        AJR Am J Roentgenol. 2003; 181: 1519-1524
        • Melendez J
        • Sánchez CI
        • Philipsen RH
        • et al.
        An automated tuberculosis screening strategy combining X-ray-based computer-aided detection and clinical information.
        Sci Rep. 2016; 6: 25265
        • Oliveira LL
        • Silva SA
        • Ribeiro LH
        • et al.
        Computer-aided diagnosis in chest radiography for detection of childhood pneumonia.
        Int J Med Inform. 2008; 77: 555-564
        • Landis JR
        • Koch GG.
        The measurement of observer agreement for categorical data.
        Biometrics. 1977; 33: 159-174
        • Qin C
        • Yao D
        • Shi Y
        • et al.
        Computer-aided detection in chest radiography based on artificial intelligence: a survey.
        Biomed Eng Online. 2018; 17: 113
        • De Boo DW
        • Prokop M
        • Uffmann M
        • et al.
        Computer-aided detection (CAD) of lung nodules and small tumors on chest radiographs.
        Eur J Radiol. 2009; 72: 218-225
        • Bley TA
        • Baumann T
        • Saueressig U
        • et al.
        Comparison of radiologist and CAD performance in the detection of CT-confirmed subtle pulmonary nodules on digital chest radiographs.
        Invest Radiol. 2008; 43: 343-348
        • Kasai S
        • Li F
        • Shiraishi J
        • et al.
        Usefulness of computer-aided diagnosis schemes for vertebral fractures and lung nodules on chest radiographs.
        AJR Am J Roentgenol. 2008; 191: 260-265
        • Li F
        • Engelmann R
        • Armato SG
        • et al.
        Computer-aided nodule detection system: results in an unselected series of consecutive chest radiographs.
        Acad Radiol. 2015; 22: 475-480
        • de Hoop B
        • De Boo DW
        • Gietema HA
        • et al.
        Computer-aided detection of lung cancer on chest radiographs: effect on observer performance.
        Radiology. 2010; 257: 532-540
        • De Boo DW
        • Uffmann M
        • Weber M
        • et al.
        Computer-aided detection of small pulmonary nodules in chest radiographs: an observer study.
        Acad Radiol. 2011; 18: 1507-1514
        • Kuhlman JE
        • Collins J
        • Brooks GN
        • et al.
        Dual-energy subtraction chest radiography: what to look for beyond calcified nodules.
        Radiographics. 2006; 26: 79-92
        • Haber M
        • Drake A
        • Nightingale J.
        Is there an advantage to using computer aided detection for the early detection of pulmonary nodules within chest X-Ray imaging?.
        Radiography (Lond). 2020; 26: e170-e178
        • Meziane M
        • Obuchowski NA
        • Lababede O
        • et al.
        A comparison of follow-up recommendations by chest radiologists, general radiologists, and pulmonologists using computer-aided detection to assess radiographs for actionable pulmonary nodules.
        AJR Am J Roentgenol. 2011; 196: W5429
        • Meziane M
        • Mazzone P
        • Novak E
        • et al.
        A comparison of four versions of a computer-aided detection system for pulmonary nodules on chest radiographs.
        J Thorac Imaging. 2012; 27: 58-64
        • de Hoop B
        • Schaefer-Prokop C
        • Gietema HA
        • et al.
        Screening for lung cancer with digital chest radiography: sensitivity and number of secondary work-up CT examinations.
        Radiology. 2010; 255: 629-637
        • Martini K
        • Blüthgen C
        • Eberhard M
        • et al.
        Impact of vessel suppressed-CT on diagnostic accuracy in detection of pulmonary metastasis and reading time.
        Acad Radiol. 2021; 28: 988-994
        • Sahiner B
        • Chan HP
        • Hadjiiski LM
        • et al.
        Effect of CAD on radiologists' detection of lung nodules on thoracic CT scans: analysis of an observer performance study by nodule size.
        Acad Radiol. 2009; 16: 1518-1530
        • Dhahbi S
        • Barhoumi W
        • Kurek J
        • et al.
        False-positive reduction in computer-aided mass detection using mammographic texture analysis and classification.
        Comput Methods Programs Biomed. 2018; 160: 75-83
        • Martini K
        • Baessler M
        • Baumueller S
        • et al.
        Diagnostic accuracy and added value of dual-energy subtraction radiography compared to standard conventional radiography using computed tomography as standard of reference.
        PLoS One. 2017; 12e0174285
        • U.S. Food and Drug Administration
        Summary of Safety and Effectiveness Data: R2 Technologies (P970058). 1998; (Available at)
        • Le EPV
        • Wang Y
        • Huang Y
        • et al.
        Artificial intelligence in breast imaging.
        Clin Radiol. 2019; 74: 357-366
        • Chan HP
        • Samala RK
        • Hadjiiski LM.
        CAD and AI for breast cancer-recent development and challenges.
        Br J Radiol. 2020; 9320190580
        • Fenton JJ
        • Xing G
        • Elmore JG
        • et al.
        Short-term outcomes of screening mammography using computer-aided detection: a population-based study of medicare enrollees.
        Ann Intern Med. 2013; 158: 580-587
        • Rao VM
        • Levin DC
        • Parker L
        • et al.
        How widely is computer-aided detection used in screening and diagnostic mammography?.
        J Am Coll Radiol. 2010; 7: 802-805
        • Ko JM
        • Nicholas MJ
        • Mendel JB
        • et al.
        Prospective assessment of computer-aided detection in interpretation of screening mammography.
        AJR Am J Roentgenol. 2006; 187: 1483-1491
        • Taplin SH
        • Rutter CM
        • Lehman CD.
        Testing the effect of computer-assisted detection on interpretive performance in screening mammography.
        AJR Am J Roentgenol. 2006; 187: 1475-1482
        • Gur D
        • Sumkin JH.
        CAD in screening mammography.
        AJR Am J Roentgenol. 2006; 187: 1474
        • Freer TW
        • Ulissey MJ.
        Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center.
        Radiology. 2001; 220: 781-786
        • Birdwell RL
        • Ikeda DM
        • O'Shaughnessy KF
        • et al.
        Mammographic characteristics of 115 missed cancers later detected with screening mammography and the potential utility of computer-aided detection.
        Radiology. 2001; 219: 192-202
        • Gromet M.
        Comparison of computer-aided detection to double reading of screening mammograms: review of 231,221 mammograms.
        AJR Am J Roentgenol. 2008; 190: 854-859
        • Jiang Y
        • Nishikawa RM
        • Schmidt RA
        • et al.
        Improving breast cancer diagnosis with computer-aided diagnosis.
        Acad Radiol. 1999; 6: 22-33
        • Lehman CD
        • Wellman RD
        • Buist DS
        • et al.
        Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection.
        JAMA Intern Med. 2015; 175: 1828-1837
        • Fenton JJ
        • Taplin SH
        • Carney PA
        • et al.
        Influence of computer-aided detection on performance of screening mammography.
        N Engl J Med. 2007; 356: 1399-1409
        • Guerriero C
        • Gillan MG
        • Cairns J
        • et al.
        Is computer aided detection (CAD) cost effective in screening mammography? A model based on the CADET II study.
        BMC Health Serv Res. 2011; 11: 11
        • Cole EB
        • Zhang Z
        • Marques HS
        • et al.
        Impact of computer-aided detection systems on radiologist accuracy with digital mammography.
        AJR Am J Roentgenol. 2014; 203: 909-916
        • Baker JA
        • Rosen EL
        • Lo JY
        • et al.
        Computer-aided detection (CAD) in screening mammography: sensitivity of commercial CAD systems for detecting architectural distortion.
        AJR Am J Roentgenol. 2003; 181: 1083-1088
        • Fenton JJ
        • Abraham L
        • Taplin SH
        • et al.
        Effectiveness of computer-aided detection in community mammography practice.
        J Natl Cancer Inst. 2011; 103: 1152-1161
        • Ribli D
        • Horváth A
        • Unger Z
        • et al.
        Detecting and classifying lesions in mammograms with Deep Learning.
        Sci Rep. 2018; 8: 4165
        • Lehman CD
        • Yala A
        • Schuster T
        • et al.
        Mammographic breast density assessment using deep learning: clinical implementation.
        Radiology. 2019; 290: 52-58
        • Akselrod-Ballin A
        • Chorev M
        • Shoshan Y
        • et al.
        Predicting breast cancer by applying deep learning to linked health records and mammograms.
        Radiology. 2019; 292: 331-342
        • Wynants L
        • Van Calster B
        • Collins GS
        • et al.
        Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal.
        BMJ. 2020; 369: m1328
        • Roberts M
        • Diggs D
        • Thorpe M
        • et al.
        Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans.
        Nature Machine Intelligence. 2021; 3: 199-217
        • Martini K
        • Blüthgen C
        • Walter JE
        • et al.
        Accuracy of conventional and machine learning enhanced chest radiography for the assessment of COVID-19 pneumonia: intra-individual comparison with CT.
        Journal of Clinical Medicine. 2020; 9: 1-12
        • Hwang EJ
        • Kim H
        • Yoon SH
        • et al.
        Implementation of a deep learning-based computer-aided detection system for the interpretation of chest radiographs in patients suspected for COVID-19.
        Korean J Radiol. 2020; 21: 1150-1160
        • Shi F
        • Wang J
        • Shi J
        • et al.
        Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-19.
        IEEE Rev Biomed Eng. 2021; 14: 4-15
        • Wang Z
        • Xiao Y
        • Li Y
        • et al.
        Automatically discriminating and localizing COVID-19 from community-acquired pneumonia on chest X-rays.
        Pattern Recognit. 2021; 110107613
        • Alhasan M
        • Hasaneen M.
        Digital imaging, technologies and artificial intelligence applications during COVID-19 pandemic.
        Comput Med Imaging Graph. 2021; 91101933
        • Abbasian Ardakani A
        • Acharya UR
        • Habibollahi S
        • et al.
        COVIDiag: a clinical CAD system to diagnose COVID-19 pneumonia based on CT findings.
        Eur Radiol. 2021; 31: 121-130
        • Attallah O
        • Ragab DA
        • Sharkas M.
        MULTI-DEEP: a novel CAD system for coronavirus (COVID-19) diagnosis from CT images using multiple convolution neural networks.
        PeerJ. 2020; 8: e10086
        • Saygılı A.
        A new approach for computer-aided detection of coronavirus (COVID-19) from CT and X-ray images using machine learning methods.
        Appl Soft Comput. 2021; 105107323
        • Shakarami A
        • Menhaj MB
        • Tarrah H.
        Diagnosing COVID-19 disease using an efficient CAD system.
        Optik (Stuttg). 2021; 241167199