Advertisement

Use of Attending Radiologist Reviews of Resident Clinical Performance to Predict Outcomes on the American Board of Radiology Qualifying (Core) Exam: A Call to Action

Published:August 30, 2022DOI:https://doi.org/10.1016/j.acra.2022.07.024
      Certifying exams are a part of professional life. Whether the bar exam in law, or the Certified Public Accountant (CPA) exam in accounting, or the multitude of certifying exams among the clinical disciplines of the American Board of Medical Specialties, the ability to predict which candidates will successfully pass in a particular professional discipline has long been of interest. This interest might be from a screening standpoint, in attempts to answer the question of whether a potential student or trainee will pass future exams since passage rates might reflect on the stature of a school or, in the case of medicine, a residency training program. The use of threshold values of a high stakes standardized test to select or screen applicants to schools and/or residency programs is highly controversial and complicated, and beyond the scope of this editorial other than to comment that as of 2022 the United States Medical Licensure Examination (USMLE) Step 1 will be recorded as pass/fail, without a numerical score. Alternatively, and more pertinent to medical specialties, this interest might help predict successful performance in the training program as well the candidate's potential ability to pass future exams. For physician educators, the impetus for identifying tools or methods which help to predict future performance on certifying exams is to identify learners already in graduate medical education training programs who are at risk of failing so that appropriate interventional strategies can be developed and implemented early on, when the training and learning trajectories can be altered. These implementation strategies, when successful, benefit the individual as well as the training program, which is bound by the Accreditation Council for Graduate Medical Education (ACGME) core program requirement of an 80% first time certifying exam pass rate during any three-year look back for residencies in which the certifying board holds annual exams (

      ACGME Program Requirements for Graduate Medical Education in Diagnostic Radiology. V.C.3.c Available at: https://www.acgme.org/globalassets/pfassets/programrequirements/420_diagnosticradiology_2022.pdf Accessed July 29, 2022

      ).
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

      1. ACGME Program Requirements for Graduate Medical Education in Diagnostic Radiology. V.C.3.c Available at: https://www.acgme.org/globalassets/pfassets/programrequirements/420_diagnosticradiology_2022.pdf Accessed July 29, 2022

        • Caffery T
        • Fredette J
        • Musso MW
        • et al.
        Predicting American Board of Emergency Medicine Qualifying Examination Passage Using United States Medical Licensing Examination Step Scores.
        Ochsner J. 2018; 18 (Fall): 204-208
        • Rayamajhi S
        • Dhakal P
        • Wang L
        • et al.
        Do USMLE steps, and ITE score predict the American Board of Internal Medicine Certifying Exam results?.
        BMC Med Educ. 2020; 20: 79
        • Kay C
        • Jackson JL
        • Frank M.
        The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination.
        Acad Med. 2015; 90: 100-104
        • Dougherty PJ
        • Walter N
        • Schilling P
        • et al.
        Do scores of the USMLE Step 1 and OITE correlate with the ABOS Part I certifying examination?: a multicenter study.
        Clin Orthop Relat Res. 2010; 468: 2797-2802
        • Picarsic J
        • Raval JS
        • Macpherson T.
        United States Medical Licensing Examination step 1 two-digit score: a correlation with the American Board of Pathology first-time test taker pass/fail rate at the University of Pittsburgh Medical Center.
        Arch Pathol Lab Med. 2011; 135: 1349-1352
        • Ost SR
        • Wells D
        • Goedecke PJ
        • et al.
        Relationship between standardized test scores and board certification exams in a combined internal medicine/pediatrics residency program.
        Cureus. 2021; 13: e13567
        • Sutton E
        • Richardson JD
        • Ziegler C
        • et al.
        Is USMLE Step 1 score a valid predictor of success in surgical residency?.
        Am J Surg. 2014; 208 (discussion 1034): 1029-1034https://doi.org/10.1016/j.amjsurg.2014.06.032
        • Patel MD
        • Tomblinson CM
        • Benefield T
        • et al.
        The relationship between US medical licensing examination step scores and ABR Core examination outcome and performance: a multi-institutional study.
        J Am Coll Radiol. 2020; 17: 1037-1045
        • Patel MD
        • Benefield T
        • Hunt KN
        • et al.
        USMLE Step 3 scores have value in predicting ABR core examination outcome and performance: a multi-institutional study.
        Acad Radiol. 2021; 28: 726-732
        • Calisi N
        • Gondi KT
        • Asmar J
        • et al.
        Predictors of success on the ABR core examination.
        J Am Coll Radiol. 2019; 16 (Pt A): 1193-1200
        • Patel MD
        • Hunt KN
        • Benefield T
        • et al.
        The relationship between ACR diagnostic radiology in-training examination scores and ABR core examination outcome and performance: a multi-institutional study.
        J Am Coll Radiol. 2020; 17: 1663-1669
        • Horn Jr., GL
        • Herrmann S
        • Masood I
        • et al.
        Predictors for failing the American Board of Radiology Core Examination.
        AJR Am J Roentgenol. 2019; 213: 485-489
      2. Horn GL, Masood I, Heymann J, et al. Attending reviews of residents correlate with ABR qualifying (core) examination failure. Acad Radiol 2022;29:1729–1732.

        • Nickerson JP
        • Koski C
        • Anderson JC
        • et al.
        Correlation between radiology ACGME case logs values and ABR core exam pass rate.
        Acad Radiol. 2020; 27: 269-273
        • Agarwal V
        • Bump GM
        • Heller MT
        • et al.
        Resident case volume correlates with clinical performance: finding the sweet spot.
        Acad Radiol. 2019; 26: 136-140