Advertisement

Attending Reviews of Residents Correlate with ABR Qualifying (Core) Examination Failure

Published:February 27, 2022DOI:https://doi.org/10.1016/j.acra.2022.01.002

      Rationale and Objectives

      Since the American Board of Radiology (ABR) instituted the new system of board certification, there has been much discussion as to the test's validity. We decided to evaluate if subjective evaluation of resident performance correlated with ABR Qualifying (Core) Examination performance at this single institution.

      Materials and Methods

      Data regarding resident evaluation scores by attending physicians and passage of board examinations was gathered regarding residents who had taken the ABR Qualifying (Core) Examination from 2013 through 2019 for a total of 42 residents, eight of whom failed the ABR Qualifying (Core) Examination on their first attempt. A univariate analysis comparing scores with resident passage or failure of the ABR Qualifying (Core) Examination on the first attempt and analyses correcting for class year only and class year and number of evaluations was performed.

      Results

      The non-weighted average evaluation score of years 1, 2, and 3 was 80.24% for those who failed the ABR Qualifying (Core) Examination and 83.71 % for those who passed. On univariate analysis along with analyses correcting for class year only and class year along with number of evaluations, there was a statistically significant correlation with decreased evaluation scores averaged over the three years of residency and failure of the ABR Qualifying (Core) Examination (p = 0.0102, p = 0.003, and p = 0.0043). The statistical significance held for the average numerical score in each individual year of training in all analyses except for year 1 of the univariate analysis (p = 0.1264).

      Conclusion

      At the studied institution, there was a statistically significant correlation between lower subjective faculty evaluation scores and failure of the ABR Qualifying (Core) Examination.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      REFERENCES

        • Agarwal V
        • Bump GM
        • Heller MT
        • et al.
        resident case volume correlates with clinical performance: finding the sweet spot.
        Acad Radiol. 2019; 26: 136-140
        • Nickerson JP
        • Koski C
        • Anderson JC
        • Beckett B
        • Jackson VP
        Correlation between radiology ACGME case logs values and abr core exam pass rate.
        Acad Radiol. 2020; 27: 269-273
        • Horn GL
        • Herrmann S
        • Masood I
        • Andersen CR
        • Nguyen QD
        Predictors for failing the american board of radiology core examination.
        AJR Am J Roentgenol. 2019; 213: 485-489
        • Calisi N
        • Gondi KT
        • Asmar J
        • Singhal H
        • Andresen K
        Predictors of success on the ABR core examination.
        J Am Coll Radiol. 2019; 16: 1193-1200
        • Patel MD
        • Tomblinson CM
        • Benefield T
        • et al.
        The Relationship between US medical licensing examination step scores and ABR core examination outcome and performance: a multi-institutional study.
        J Am Coll Radiol. 2020; 17: 1037-1045
        • Patel MD
        • Benefield T
        • Hunt KN
        • et al.
        USMLE Step 3 scores have value in predicting ABR Core Examination outcome and performance: a multi-institutional study.
        Acad Radiol. 2021; 28: 726-732
        • Patel MD
        • Hunt KN
        • Benefield T
        • et al.
        The relationship between ACR Diagnostic Radiology In-Training examination scores and ABR Core Examination outcome and performance: a multi-institutional study.
        J Am Coll Radiol. 2020; 17: 1663-1669
        • Kerridge WD
        • Gunderman RB
        The validity and timing of the ABR Core Exam.
        Acad Radiol. 2016; 23: 1176-1179
        • Berland LL
        • Berland NW
        • Berland MW.
        ABR Psychometric Testing: Analysis of Validity and Effects.
        J Am Coll Radiol. 2018; 15: 905-910
        • Berland LL
        • Heitkamp DE
        • Ryu RK
        Predictors of failing the american board of radiology core examination.
        AJR Am J Roentgenol. 2020; 214: W72
        • Hauer KE
        • Vandergrift J
        • Hess B
        • et al.
        Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013-2014.
        JAMA. 2016; 316: 2253-2262