Academic Radiology
Volume 16, Issue 12 , Pages 1518-1530 , December 2009

Effect of CAD on Radiologists' Detection of Lung Nodules on Thoracic CT Scans: Analysis of an Observer Performance Study by Nodule Size

  • Berkman Sahiner, PhD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • Corresponding Author InformationAddress correspondence to: B.S.
    • ,
  • Heang-Ping Chan, PhD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Lubomir M. Hadjiiski, PhD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Philip N. Cascade, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Ella A. Kazerooni, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Aamer R. Chughtai, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Chad Poopat, MD

      Affiliations

    • Department of Radiology, Henry Ford Hospital, Detroit, MI
    • ,
  • Thomas Song, MD

      Affiliations

    • Department of Radiology, Henry Ford Hospital, Detroit, MI
    • ,
  • Luba Frank, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Jadranka Stojanovska, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109
    • ,
  • Anil Attili, MD

      Affiliations

    • Department of Radiology, The University of Michigan, MIB C480A, 1500 East Medical Center Drive, Ann Arbor, MI 48109

Received 8 October 2008 ,Accepted 10 August 2009.

References 

  1. Henschke CI, Yankelevitz DF, Libby DM, et al. Survival of patients with stage I lung cancer detected on CT screening. N Engl J Med. 2006;355:1763–1771
  2. Bach PB, Jett JR, Pastorino U, et al. Computed tomography screening and lung cancer outcomes. JAMA. 2007;297:953–961
  3. Buckley JA, Scott WW, Siegelman SS, et al. Pulmonary nodules: effect of increased data sampling on detection with spiral CT and confidence in diagnosis. Radiology. 1995;196:395–400
  4. Ko JP, Naidich DP. Lung nodule detection and characterization with multislice CT. Radiol Clin North Am. 2003;41:575–597
  5. Sone S, Yang ZG, Takashima S, et al. Characteristics of small lung cancers invisible on conventional chest radiography and detected by population based screening using spiral CT. Br J Radiol. 2000;73:137–145
  6. Fischbach F, Knollmann F, Griesshaber V, Freund T, Akkol E, Felix R. Detection of pulmonary nodules by multislice computed tomography: improved detection rate with reduced slice thickness. Eur Radiol. 2003;13:2378–2383
  7. Cagnon CH, Cody DD, McNitt-Gray MF, et al. Description and implementation of a quality control program in an imaging-based clinical trial. Acad Radiol. 2006;13:1431–1441
  8. Xu DM, van Klaveren RJ, de Bock GH, et al. Limited value of shape, margin and CT density in the discrimination between benign and malignant screen detected solid pulmonary nodules of the NELSON trial. Eur J Radiol. 2008;68:347–352
  9. Veronesi G, Bellomi M, Mulshine JL, et al. Lung cancer screening with low-dose computed tomography: a non-invasive diagnostic protocol for baseline lung nodules. Lung Cancer. 2008;61:340–349
  10. Reeves AP, Kostis WJ. Computer-aided diagnosis for lung cancer. Radiol Clin North Am. 2000;38:497–509
  11. Gurcan MN, Sahiner B, Petrick N, et al. Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. Med Phys. 2002;29:2552–2558
  12. Wormanns D, Fiebich M, Saidi M, Diederich S, Heindel W. Automatic detection of pulmonary nodules at spiral CT: clinical application of a computer-aided diagnosis system. Eur Radiol. 2002;12:1052–1057
  13. Brown MS, Goldin JG, Suh RD, et al. Lung micronodules: automated method for detection at thin-section CT - initial experience. Radiology. 2003;226:256–262
  14. Suzuki K, Armato SG, Li F, et al. Massive training artificial neural network (MTANN) for reduction of false positives in computerized detection of lung nodules in low-dose computed tomography. Med Phys. 2003;30:1602–1617
  15. Armato SG, Roy AS, MacMahon H, et al. Evaluation of automated lung nodule detection on low-dose computed tomography scans from a lung cancer screening program. Acad Radiol. 2005;12:337–346
  16. Bae KT, Kim J-S, Na Y-H, et al. Pulmonary nodules: automated detection on CT images with morphologic matching algorithm—preliminary results. Radiology. 2005;236:286–293
  17. Lee JW, Goo JM, Lee HJ, et al. The potential contribution of a computer-aided detection system for lung nodule detection in multidetector row computed tomography. Investig Radiol. 2004;39:649–655
  18. Yuan R, Vos PM, Cooperberg PL. Computer-aided detection in screening CT for pulmonary nodules. AJR Am J Roentgenol. 2006;186:1280–1287
  19. Rubin GD, Lyo JK, Paik DS, et al. Pulmonary nodules on multi-detector row CT scans: performance comparison of radiologists and computer-aided detection. Radiology. 2005;234:274–283
  20. Awai K, Murao K, Ozawa A, et al. Pulmonary nodules at chest CT: effect of computer-aided diagnosis on radiologists' detection performance. Radiology. 2004;230:347–352
  21. Li F, Arimura H, Suzuki K, et al. Computer-aided detection of peripheral lung cancers missed at CT: ROC analyses without and with localization. Radiology. 2005;237:684–690
  22. Brown MS, Goldin JG, Rogers S, et al. Computer-aided lung nodule detection in CT results of large-scale observer test. Acad Radiol. 2005;12:681–686
  23. Das M, Muhlenbruch G, Mahnken AH, et al. Small pulmonary nodules: effect of two computer-aided detection systems on radiologist performance. Radiology. 2006;241:564–571
  24. Bazzocchi M, Mazzarella F, Del Frate C, et al. CAD systems for mammography: a real opportunity? A review of the literature. Radiol Med. 2007;112:329–353
  25. Chan HP, Hadjiiski LM, Zhou C, et al. Computer-aided diagnosis of lung cancer and pulmonary embolism in computed tomography—a review. Acad Radiol. 2008;15:535–555
  26. Taylor SA, Charman SC, Lefere P, et al. CT colonography: investigation of the optimum reader paradigm by using computer-aided detection software. Radiology. 2008;246:463–471
  27. Armato SG, McLennan G, McNitt-Gray MF, et al. Lung Image Database Consortium: developing a resource for the medical imaging research community. Radiology. 2004;232:739–748
  28. Henschke CI, McCauley DI, Yankelevitz DF, et al. Early lung cancer action project: overall design and findings from baseline screening. Lancet. 1999;354:99–105
  29. Swensen SJ, Jett JR, Hartman TE, et al. Lung cancer screening with CT: Mayo Clinic experience. Radiology. 2003;226:756–761
  30. Diederich S, Wormanns D, Semik M, et al. Screening for early lung cancer with low-dose spiral CT: prevalence in 817 asymptomatic smokers. Radiology. 2002;222:773–781
  31. McNitt-Gray MF, Armato SG, Meyer CR, et al. The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation. Acad Radiol. 2007;14:1464–1474
  32. Sahiner B, Hadjiiski LM, Chan HP, et al. Computerized lung nodule detection on screening CT scans: performance on juxta-pleural and internal nodules. Proc SPIE. 2006;6144:5S1–5S6
  33. Way TW, Hadjiiski LM, Sahiner B, et al. Computer-aided diagnosis of pulmonary nodules on CT scans: segmentation and classification using 3D active contours. Med Phys. 2006;33:2323–2337
  34. Ge Z, Sahiner B, Chan HP, et al. Computer aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting. Med Phys. 2005;32:2443–2454
  35. Sahiner B, Hadjiiski LM, Chan HP, et al. The effect of nodule segmentation on the accuracy of computerized lung nodule detection on CT scans: comparison on a dataset annotated by multiple radiologists. Proc SPIE. 2007;6514:65140L–65141, 65147
  36. Bunch PC, Hamilton JF, Sanderson GK, Simmons AH. A free response approach to the measurement and characterization of radiographic observer performance. J Appl Photo Engr. 1978;4:166–171
  37. Chakraborty DP. Validation and statistical power comparison of methods for analyzing free-response observer performance studies. Acad Radiol. 2008;15:1554–1566
  38. Chakraborty DP, Winter LHL. Free-response methodology: alternate analysis and a new observer-performance experiment. Radiology. 1990;174:873–881
  39. Chakraborty DP, Berbaum KS. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys. 2004;31:2313–2330
  40. Nishikawa RM, Kallergi M, Orton CG. Computer-aided detection, in its present form, is not an effective aid for screening mammography. Med Phys. 2006;33:811–814
  41. Karssemeijer N, Otten JD, Rijken H, et al. Computer aided detection of masses in mammograms as decision support. Br J Radiol. 2006;79:S123–S126
  42. Zheng B, Swensson RG, Golla S, et al. Detection and classification performance levels of mammographic masses under different computer-aided detection cueing environments. Acad Radiol. 2004;11:398–406
  43. Manning DJ, Ethell SC, Donovan T. Detection or decision errors? Missed lung cancer from the posteroanterior chest radiograph. Br J Radiol. 2004;77:231–235
  44. Karssemeijer N, Hupse A, Samulski M, et al. An interactive computer aided decision support system for detection of masses in mammograms. In:  Krupinski EA editors. 9th International Workshop on Digital Mammography. Tucson, AZ Berlin: Springer-Verlag; 2008;p. 273–278
  45. Ochs R, Angel E, Boedeker K, et al. The influence of CT dose and reconstruction parameters on automated detection of small pulmonary nodules. Proc SPIE. 2006;6144:5W1–5W8
  46. Boedeker KL, McNitt-Gray MF. Tradeoffs in noise, resolution, and dose with reconstruction filter in lung nodule detection in CT. Proc SPIE. 2005;5745:695–703
  47. MacMahon H, Austin JHM, Gamsu G, et al. Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner Society. Radiology. 2005;237:395–400
  48. Marten K, Engelke C, Seyfarth T, et al. Computer-aided detection of pulmonary nodules: influence of nodule characteristics on detection performance. Clin Radiol. 2005;60:196–206
  49. Revesz G, Kundel HL, Bonitatibus M. The effect of verification on the assessment of imaging techniques. Investig Radiol. 1983;18:194–198

 Supported by USPHS grant CA93517.

PII: S1076-6332(09)00489-9

doi: 10.1016/j.acra.2009.08.006

Academic Radiology
Volume 16, Issue 12 , Pages 1518-1530 , December 2009

Article Tools

* Image Usage & Resolution