Advertisement

Artificial Intelligence Curriculum Needs Assessment for a Pediatric Radiology Fellowship Program: What, How, and Why?

      Rationale and Objectives

      Artificial intelligence (AI) holds enormous potential for improvements in patient care, efficiency, and innovation in pediatric radiology practice. Although there is a pressing need for a radiology-specific training curriculum and formalized AI teaching, few resources are available. The purpose of our study was to perform a needs assessment for the development of an AI curriculum during pediatric radiology training and continuing education.

      Materials and Methods

      A focus group study using a semistructured moderator-guided interview was conducted with radiology trainees’ and attending radiologists’ perceptions of AI, perceived competence in interpretation of AI literature, and perceived expectations from radiology AI educational programs. The focus group was audio-recorded, transcribed, and thematic analysis was performed.

      Results

      The focus group was held virtually with seven participants. The following themes we identified: (1) AI knowledge, (2) previous training, (3) learning preferences, (4) AI expectations, and (5) AI concerns. The participants had no previous formal training in AI and variability in perceived needs and interests. Most preferred a case-based approach to teaching AI. They expressed incomplete understanding of AI hindered its clinical applicability and reiterated a need for improved training in the interpretation and application of AI literature in their practice.

      Conclusion

      We found heterogeneity in perspectives about AI; thus, a curriculum must account for the wide range of these interests and needs. Teaching the interpretation of AI research methods, literature critique, and quality control through implementation of specific scenarios could engage a variety of trainees from different backgrounds and interest levels while ensuring a baseline level of competency in AI.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Academic Radiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Slanetz PJ
        • Daye D
        • Chen P-H
        • et al.
        Artificial intelligence and machine learning in radiology education is ready for prime time.
        J Am Coll Radiol. 2020; 17: 1705-1707https://doi.org/10.1016/j.jacr.2020.04.022
        • Obermeyer Z
        • Emanuel EJ
        Predicting the future - big data, machine learning, and clinical medicine.
        N Engl J Med. 2016; 375: 1216-1219https://doi.org/10.1056/NEJMp1606181
        • Kruskal JB
        • Berkowitz S
        • Geis JR
        • et al.
        Big data and machine learning-strategies for driving this bus: a summary of the 2016 Intersociety Summer Conference.
        J Am Coll Radiol. 2017; 14: 811-817https://doi.org/10.1016/j.jacr.2017.02.019
        • Jha S
        • Topol EJ
        Adapting to artificial intelligence: radiologists and pathologists as information specialists.
        JAMA. 2016; 316: 2353-2354https://doi.org/10.1001/jama.2016.17438
        • Recht M
        • Bryan RN
        Artificial intelligence: threat or boon to radiologists?.
        J Am Coll Radiol. 2017; 14: 1476-1480https://doi.org/10.1016/j.jacr.2017.07.007
        • Collado-Mesa F
        • Alvarez E
        • Arheart K
        The role of artificial intelligence in diagnostic radiology: a survey at a single radiology residency training program.
        J Am Coll Radiol. 2018; 15: 1753-1757https://doi.org/10.1016/j.jacr.2017.12.021
        • Dikici E
        • Bigelow M
        • Prevedello LM
        • et al.
        Integrating AI into radiology workflow: levels of research, production, and feedback maturity.
        J Med Imaging (Bellingham). 2020; 7016502https://doi.org/10.1117/1.JMI.7.1.016502
        • Forney MC
        • McBride AF
        Artificial intelligence in radiology residency training.
        Semin Musculoskelet Radiol. 2020; 24: 74-80https://doi.org/10.1055/s-0039-3400270
        • Paranjape K
        • Schinkel M
        • Nannan Panday R
        • et al.
        Introducing artificial intelligence training in medical education.
        JMIR Med Educ. 2019; 5: e16048https://doi.org/10.2196/16048
      1. RSNA Regional Spotlight Courses. https://www-rsna-org.proxy.library.upenn.edu/education/regional-meetings-spotlight-courses. Accessed 18 Jan 2022

      2. ASNR/ASFNR AI workshop - ASNR. https://www.asnr.org/research/asnr-study-groups/artificial-intelligence/asnr-asfnr-ai-workshop/. Accessed 18 Jan 2022

      3. Top Artificial Intelligence Courses Online - Updated [January 2022 ] | Udemy. https://www.udemy.com/topic/artificial-intelligence/. Accessed 18 Jan 2022

      4. AI & Deep Learning Bundle | StackSkills. https://stackskills.com/p/ai-deep-learning-bundle. Accessed 18 Jan 2022

      5. AI For Everyone | Coursera. https://www.coursera.org/learn/ai-for-everyone. Accessed 18 Jan 2022

      6. ABR. https://www.theabr.org/diagnostic-radiology/initial-certification/core-exam. Accessed 18 Jan 2022

        • Bailey JE
        • Ladner J
        • Balfe D
        • et al.
        ACGME Program Requirements for Graduate Medical Education in Diagnostic Radiology.
        Radiology Program Requirements. 2021; (Accessed 2 Dec 2021)
        • Lindqwister AL
        • Hassanpour S
        • Lewis PJ
        • et al.
        AI-RADS: an artificial intelligence curriculum for residents.
        Acad Radiol. 2021; 28: 1810-1816https://doi.org/10.1016/j.acra.2020.09.017
        • Sawatsky AP
        • Ratelle JT
        • Beckman TJ
        Qualitative research methods in medical education.
        Anesthesiology. 2019; 131: 14-22https://doi.org/10.1097/ALN.0000000000002728
      7. Patton MQ (2012) The nature of qualitative inquiry. In: SAGE Publications 2014 (ed) Qualitative Research & Evaluation Methods: Integrating Theory and Practice, Michael Quinn Patton - Google Libros. p 29

        • Burns N
        Standards for qualitative research.
        Nurs Sci Q. 1989; 2: 44-52https://doi.org/10.1177/089431848900200112
        • Grant J
        Learning needs assessment: assessing the need.
        BMJ. 2002; 324: 156-159https://doi.org/10.1136/bmj.324.7330.156
        • Cleland JA
        The qualitative orientation in medical education research.
        Korean J Med Educ. 2017; 29: 61-71https://doi.org/10.3946/kjme.2017.53
        • Velez-Florez MC
        • Reid JR
        • Gokli A
        The value of qualitative inquiry in medical education research: evaluation of three successful publications.
        Pediatr Radiol. 2021; 51: 1284-1289https://doi.org/10.1007/s00247-021-05002-1
        • Palinkas LA
        • Horwitz SM
        • Green CA
        • et al.
        Purposeful sampling for qualitative data collection and analysis in mixed method implementation research.
        Adm Policy Ment Health. 2015; 42: 533-544https://doi.org/10.1007/s10488-013-0528-y
      8. A framework for identifying implementation factors across contexts: The Consolidated Framework for Implementation Research (CFIR) | Resource Details | National Collaborating Centre for Methods and Tools. https://www.nccmt.ca/knowledge-repositories/search/210. Accessed 18 Jan 2022

        • Braun V
        • Clarke V
        Using thematic analysis in psychology.
        Qual Res Psychol. 2006; 3: 77-101https://doi.org/10.1191/1478088706qp063oa
        • O'Brien BC
        • Harris IB
        • Beckman TJ
        • et al.
        Standards for reporting qualitative research: a synthesis of recommendations.
        Acad Med. 2014; 89: 1245-1251https://doi.org/10.1097/ACM.0000000000000388
        • Kiger ME
        • Varpio L
        Thematic analysis of qualitative data: AMEE Guide No. 131.
        Med Teach. 2020; 42: 846-854https://doi.org/10.1080/0142159X.2020.1755030
        • Glaser B
        • Strauss A
        The discovery of grounded theory: strategies for qualitative research.
        Routledge: England, UK, 2000
        • Moore MM
        • Slonimsky E
        • Long AD
        • et al.
        Machine learning concepts, concerns and opportunities for a pediatric radiologist.
        Pediatr Radiol. 2019; 49: 509-516https://doi.org/10.1007/s00247-018-4277-7
        • Chan S
        • Siegel EL
        Will machine learning end the viability of radiology as a thriving medical specialty?.
        Br J Radiol. 2019; 9220180416https://doi.org/10.1259/bjr.20180416
        • Richardson ML
        • Garwood ER
        • Lee Y
        • et al.
        Noninterpretive uses of artificial intelligence in radiology.
        Acad Radiol. 2021; 28: 1225-1235https://doi.org/10.1016/j.acra.2020.01.012
        • Ahuja AS
        The impact of artificial intelligence in medicine on the future role of the physician.
        PeerJ. 2019; 7: e7702https://doi.org/10.7717/peerj.7702