Abstract
Background:
After graduation, physicians should be able to provide professional and safe services without the need for supervision by their clinical professors, mandating a competency-based medical education (CBME) approach.Objectives:
This study aimed to develop a national model of entrustable professional activities (EPAs) based on our experiences in the Department of Anesthesiology and Critical Care (DACC), Shahid Beheshti University of Medical Sciences (SBMU).Methods:
The primary EPA design plan was designed in a 10-step model as a career roadmap for the project. The texts were prepared according to a consensus-based approach. On the other hand, the texts were reviewed and revised by a broad team of faculty in a daily workshop.Results:
The final product included 14 topics for EPA as the first round of targeting topics for anesthesiology residents. The texts were developed using previous studies and were standardized considering national standards.Conclusions:
We described a clear path toward designing and implementing EPAs in anesthesiology residency programs to improve the quality of the graduated residents. Though the basic theory is the same, each country needs its formula for implementing the process.Keywords
Medical Education Anesthesiology Residency Program Competency-based Medical Education Entrustable Professional Activity
1. Background
After graduation, physicians should be able to provide professional and safe services without the need for supervision by their clinical professors (1). However, this is not always achieved as desired. The distance from the desired situation to the real situation is mainly due to the lack of competent medical education, mandating a competency-based medical education (CBME) approach (2, 3). A practical explanation of CBME is that professional qualifications are not acquired after a fixed period (e.g., 4 years of residency); they require a change not only in the knowledge and attitudes of the trainees but also in their professional behavior (4-6); however, the outcome of training has the central role than its time length (7). This approach requires a practical and systematic method along with guaranteeing the content of training, especially in terms of professional capabilities. The main required competencies (i.e., the 6 main core competencies) are the required infrastructure in the CBME approach.
Entrustable professional activities (EPAs) are a relatively novel concept in medical education. Starting in 2005, it developed too many fields of medical education (8-10), including anesthesiology, to ensure appropriate milestones of clinical training (11-13). However, due to the diversity and the culture of health care in each country, a national model needs to be designed; this model should be based on the international forum, adding the national experiences (14). EPAs are the cornerstones of CBME.
2. Objectives
In the current study, we sought to develop a national model of EPAs based on the experiences in the Department of Anesthesiology and Critical Care (DACC), Shahid Beheshti University of Medical Sciences (SBMU).
3. Methods
This research project was approved by the Research Ethics Committee, Research Deputy, SBMU, Tehran, Iran (code: IR.SBMU.RETECH.REC.1400.1040). However, the primary EPA design plan was proposed in 2019 with the following steps as a career roadmap for the project:
(1) The joint task force (JTF) was developed, including DACC, SBMU faculty members, Medical Education Program Development specialists, and Faculty of Medical Education, SBMU; (2) the joint task force took part in the whole process and held 20 consensus sessions added, with extra sessions preparing the drafts; (3) adopting the global approaches used for this goal, including the Iranian modifications to cope with national goals by JTF; (4) prioritizing the most common topics in the clinical education of residents through a Delphi method; all titles derived from competencies were listed by National Anesthesiology Board; (5) a multi-step table was defined, using the Accreditation Council for Graduate Medical Education (ACGME) 6 core competencies approach, to create the structure of each EPA; the main topics in the above table were “specification”, “relevant competency domain(s)”, “required knowledge content”, “minimum required skills”, “attitudes and experience”, “sources of information to assess progress”, and “expected entrustment or supervision level” (1, 15, 16); (6) the drafts of EPAs were prepared by each of the JTF members alone or in combination with other colleagues according to their field of expertise; (7) the drafts were discussed and critically appraised egarding both content and the format of EPAs in the same JTF in further sessions; (8) a 1-day 8-hour workshop was designed to discuss the concept and the content of prepared EPAs within the department to involve all the 67 faculty members of the department as stakeholders; (9) in the follow-up, 5 of the 20 sessions were held to assess the validity and appropriateness of EPA drafts; (10) the revised drafts were circulated among the members of the department, and feedback was used to update the drafts.
The above approach led the project to the primary EPA design plan, which was used as a career roadmap for the project. Then, the texts were developed based on previous experiences in international studies and thrived, reviewed, and revised by a broad team of faculty in a daily workshop according to a consensus-based approach.
4. Results
Using previous studies, the current project resulted in 14 topics for EPA as the first round of targeting topics for anesthesiology residents (Table 1); they were standardized considering national standards.
List of Entrustable Professional Activity Topics
| No | Title of Entrustable Professional Activities | Postgraduate Year Assigned to Entrustable Professional Activities |
|---|---|---|
| 1 | One-lung ventilation using a double-lumen tube | 2 and 3 |
| 2 | Lung ventilation using a bronchial blocker | 2 and 3 |
| 3 | Preoperative patient evaluation | 1, 2, 3, and 4 |
| 4 | Patient evaluation and preparation for regional anesthesia of the lower limb in orthopedic surgery | 2, 3, and 4 |
| 5 | Maintenance of patients during regional anesthesia in lower limb orthopedic surgery | 1, 2 and 3 |
| 6 | Patient evaluation and preparation for regional anesthesia of the upper limb in orthopedic surgery | 1 and 2 |
| 7 | Maintenance of patients during regional anesthesia in upper limb orthopedic surgery | 1, 2 and 3 |
| 8 | Anesthesia considerations in elective craniotomy | 2 and 3 |
| 9 | Tasks to be considered in massive blood transfusion | 1, 2 and 3 |
| 10 | General anesthesia in the elective cesarean section without underlying disease | 1, 2 and 3 |
| 11 | Advanced cardiopulmonary resuscitation in adults | 1 and 2 |
| 12 | Diagnosis and treatment of respiratory complications in postanesthesia care unit (PACU) | 1, 2 and 3 |
| 13 | Spinal Anesthesia tasks for elective surgeries in adult patients | 1, 2 and 3 |
| 14 | Mask ventilation in the pediatric patient (from neonates up to 14 years) | 2, 3 and 4 |
Despite the core concept of EPA, which is to move from a “time-based” to an “ability-based” learning system, in our Delphi rounds, we decided that each title of EPA should be assessed in specific postgraduate year (PGY) groups of trainees. It means that the earliest a trainee assessed for “one-lung ventilation using a double-lumen tube” is in their PGY2; however, assessing for “general anesthesia in the elective cesarean section without any underlying disease” could take place as soon as the first year of training, based on the rotations and abilities of an individual trainee.
A primary scale called “the Entrustment Scale” was designed to assess the trainee based on the previous models, starting from level 1, which needed the highest support starting from “level 1” and leading to “level 5”; this scale indicated a level-matched approach that could define the appropriate competency and entrustment. To “entrust” the trainee with each “topic”, 2 different examiners in 2 different situations should score the trainee as “level 5”.
Although the initial issues were too general, after difficulties in drafting, they became smaller subgroups. Based on the experience gained in preparing the initial drafts, the group decided to prepare a booklet from this initial draft and use it as a pilot.
5. Discussion
In this study, we described a clear path toward designing and implementing EPAs in anesthesiology residency programs to improve the quality of the graduated residents. However, this study was the first step in developing a list of EPAs in a developing country for anesthesiology residents. However, this is the pilot phase and mandates more steps. The results of this study demonstrated that using a list of essential EPAs for implementing CBME could be easily performed in an academic department, at least as a primary one. However, our study just demonstrated the method of developing the list; however, the results of this approach should be assessed in future studies.
Competency-based medical education is based on a competency-gaining approach without conventional time limits (2, 17); however, this approach mandates creating step-by-step blocks and milestones to create the competency of the trainee.
We are now designing a global system for the whole university, including 9 educational hospitals, to assess the trainees for the above EPAs. Analysis of the final results could take a few years, but over this period, other competencies are also evolving as EPAs by the same group of academics.
There is no doubt that the integration of EPAs into the anesthesiology residency education is a “must” and a basic need for implementing “Competency-based medical training in anesthesiology” (3, 11-13). However, the methodology must be clarified. The current study has described a clear path toward quality improvement in this approach, describing the potential obstacles and the most common paths. Though the basic theory is the same, each country needs its formula to implement the process (11). This study could address a practical formula to improve the quality of “Anesthesiology Residency” programs in Iran.
Acknowledgements
References
-
1.
Cate OT. A primer on entrustable professional activities. Korean J Med Educ. 2018;30(1):1-10. [PubMed ID: 29510603]. [PubMed Central ID: PMC5840559]. https://doi.org/10.3946/kjme.2018.76.
-
2.
Cate OT. Competency-Based Postgraduate Medical Education: Past, Present and Future. GMS J Med Educ. 2017;34(5):Doc69. [PubMed ID: 29226237]. [PubMed Central ID: PMC5704607]. https://doi.org/10.3205/zma001146.
-
3.
Kealey A, Naik VN. Competency-Based Medical Training in Anesthesiology: Has It Delivered on the Promise of Better Education? Anesth Analg. 2022;135(2):223-9. [PubMed ID: 35839492]. https://doi.org/10.1213/ANE.0000000000006091.
-
4.
O'Dowd E, Lydon S, O'Connor P, Boland J, Offiah G, Byrne D. The development of a framework of entrustable professional activities for the intern year in Ireland. BMC Med Educ. 2020;20(1):273. [PubMed ID: 32811490]. [PubMed Central ID: PMC7433170]. https://doi.org/10.1186/s12909-020-02156-8.
-
5.
Dabbagh A, Gandomkar R, Farzanegan B, Jaffari A, Massoudi N, Mirkheshti A, et al. Residency Education Reform Program in Department of Anesthesiology and Critical Care: An Academic Reform Model. Anesth Pain Med. 2021;11(3). e113606. [PubMed ID: 34540632]. [PubMed Central ID: PMC8438708]. https://doi.org/10.5812/aapm.113606.
-
6.
Ritchie KC, Sjaus A, Munro A, George RB. An interpretive phenomenological analysis of formative feedback in anesthesia training: the residents' perspective. BMC Med Educ. 2020;20(1):493. [PubMed ID: 33287808]. [PubMed Central ID: PMC7720595]. https://doi.org/10.1186/s12909-020-02402-z.
-
7.
Moll-Khosrawi P, Ganzhorn A, Zollner C, Schulte-Uentrop L. Development and validation of a postgraduate anaesthesiology core curriculum based on Entrustable Professional Activities: a Delphi study. GMS J Med Educ. 2020;37(5):Doc52. [PubMed ID: 32984511]. [PubMed Central ID: PMC7499458]. https://doi.org/10.3205/zma001345.
-
8.
de Graaf J, Bolk M, Dijkstra A, van der Horst M, Hoff RG, Ten Cate O. The Implementation of Entrustable Professional Activities in Postgraduate Medical Education in the Netherlands: Rationale, Process, and Current Status. Acad Med. 2021;96(7S):S29-35. [PubMed ID: 34183599]. https://doi.org/10.1097/ACM.0000000000004110.
-
9.
Colbert-Getz JM, Lappe K, Northrup M, Roussel D. To What Degree Are the 13 Entrustable Professional Activities Already Incorporated Into Physicians' Performance Schemas for Medical Students? Teach Learn Med. 2019;31(4):361-9. [PubMed ID: 30873878]. https://doi.org/10.1080/10401334.2019.1573146.
-
10.
Carraccio C, Englander R, Gilhooly J, Mink R, Hofkosh D, Barone MA, et al. Building a Framework of Entrustable Professional Activities, Supported by Competencies and Milestones, to Bridge the Educational Continuum. Acad Med. 2017;92(3):324-30. [PubMed ID: 26959225]. https://doi.org/10.1097/ACM.0000000000001141.
-
11.
Woodworth GE, Marty AP, Tanaka PP, Ambardekar AP, Chen F, Duncan MJ, et al. Development and Pilot Testing of Entrustable Professional Activities for US Anesthesiology Residency Training. Anesth Analg. 2021;132(6):1579-91. [PubMed ID: 33661789]. https://doi.org/10.1213/ANE.0000000000005434.
-
12.
Kinney DA, Gaiser RR. Entrustable Professional Activities: Base Hit or Homerun? Anesth Analg. 2021;132(6):1576-8. [PubMed ID: 34032661]. https://doi.org/10.1213/ANE.0000000000005529.
-
13.
Schartel SA. Another Milestone in Anesthesiology Education. Anesth Analg. 2021;133(2):349-52. [PubMed ID: 34257196]. https://doi.org/10.1213/ANE.0000000000005574.
-
14.
Weissenbacher A, Bolz R, Stehr SN, Hempel G. Development and consensus of entrustable professional activities for final-year medical students in anaesthesiology. BMC Anesthesiol. 2022;22(1):128. [PubMed ID: 35488205]. [PubMed Central ID: PMC9052481]. https://doi.org/10.1186/s12871-022-01668-8.
-
15.
Jonker G, Hoff RG, Ten Cate OT. A case for competency-based anaesthesiology training with entrustable professional activities: an agenda for development and research. Eur J Anaesthesiol. 2015;32(2):71-6. [PubMed ID: 24945750]. https://doi.org/10.1097/EJA.0000000000000109.
-
16.
Wisman-Zwarter N, van der Schaaf M, Ten Cate O, Jonker G, van Klei WA, Hoff RG. Transforming the learning outcomes of anaesthesiology training into entrustable professional activities: A Delphi study. Eur J Anaesthesiol. 2016;33(8):559-67. [PubMed ID: 27270884]. https://doi.org/10.1097/EJA.0000000000000474.
-
17.
Whitcomb ME. Transforming Medical Education: Is Competency-Based Medical Education the Right Approach? Acad Med. 2016;91(5):618-20. [PubMed ID: 26675191]. https://doi.org/10.1097/ACM.0000000000001049.