Assessment of Surgical Teams’ Teamwork Skills in Pediatric Surgery: A Cross-sectional Study

authors:

avatar Hamed Parnikh ORCID 1 , avatar Reza Kalantari ORCID 2 , * , avatar Elham Alaei 3 , avatar Zahra Ahmadi Khajoogh 4 , avatar Seyede Fatemeh Nourani 5 , avatar Zahra Movahednia 6

Department of Operating Room, School of Paramedicine, Arak University of Medical Sciences, Arak, Markazi, Iran
Department of Ergonomics, Faculty of Public Health, Shiraz University of Medical Sciences, Shiraz, Iran
Emam Reza Hospital, Ardal University of Medical Sciences, Shahrekord, Iran
Sina Hospital, Marageh University of Medical Sciences, Marageh, Iran
Mazandaran University of Medical Sciences, Sari, Iran
Depertment of Operating Room, Behbahan Faculty of Medical Sciences, Behbahan, Iran

how to cite: Parnikh H, Kalantari R, Alaei E, Ahmadi Khajoogh Z, Nourani S F, et al. Assessment of Surgical Teams’ Teamwork Skills in Pediatric Surgery: A Cross-sectional Study. Med Surg Nurs J. 2022;11(2):e134001. https://doi.org/10.5812/msnj-134001.

Abstract

Background:

The operating room is a high-risk environment in which practitioners with different educational backgrounds work together to provide safe care for surgical patients. The surgical team needs to use teamwork skills for safe performance and error prevention. Pediatric surgery is a very sensitive surgery type that needs special psychological skills.

Objectives:

This study aimed to assess surgical teams’ teamwork skills in pediatric surgery.

Methods:

This cross-sectional study was conducted on 154 surgical teams working in the pediatric operating rooms of two public hospitals in Shiraz, Iran, during the summer of 2021 using convenience sampling. The data were collected by the Mayo High-Performance Teamwork Scale. An operating room technologist collected the data by observing surgeries. Descriptive statistics were used for the analysis of the data. The data were analyzed using SPSS software (version 22).

Results:

The mean value of the teamwork score was 1.57 ± 0.20 (out of 2). The total teamwork score was 25.20 ± 3.31 (out of 32). The majority of items had a score of more than average. The team members had the highest score in recognizing a leader. The studied surgical teams had low scores in verbalizing their activities and repeating back the instructions.

Conclusions:

The overall teamwork score in the studied teams in the pediatric operating rooms was at an acceptable level. However, the studied teams did not do well in team communication behaviors. Interventions, such as educating, standardizing communications, and implementing a pediatric surgical safety checklist, can improve team communication skills.

1. Background

The operating room is a complex environment in which errors can take place (1). Operating rooms are the most common places in hospitals in which adverse events take place (41%) (2). This risky environment is the most commonplace for occurring surgical patient harm (3), with about 10% of surgery-related complications (4). Multidisciplinary team dynamics in the operating room are challenging, which can cause adverse events (5). It is important to pay attention to operating room adverse events and their primary roots (6).

Defect in nontechnical skills is the main reason for operating room adverse events (7). Nontechnical skills are cognitive and interpersonal skills that contribute to safe task performance and complement technical skills (8). Teamwork is one of the vital nontechnical skills for operating room practitioners (6), which can be defined as the interaction of two or more professionals about cognitions, attitudes, and behaviors that contributes to achieving shared goals (9). All surgical team members should have good knowledge and skills in teamwork to secure team performance (10). Failure in teamwork skills is the main contributor to adverse events in operating rooms (11). Defects in teamwork are not rare in operating rooms and can threaten patients’ safety (12). Therefore, operating room teamwork is essential for preventing errors, achieving good patient outcomes, and optimizing workflow during surgery (13).

Teamwork in the operating room has been studied in previous studies. This concept has been previously studied in several surgery types. In a study, Kalantari et al. reported higher-than-average teamwork levels in surveying orthopedic surgeries (6). In another study, teamwork scores were good in urological surgery (14). However, no study has been conducted on surgical teams’ teamwork skills in pediatric surgery; however, this type of surgery is one of the most sensitive surgery types, which needs special psychological skills (15). Recently, only one study has been conducted to determine the feasibility of teamwork assessment and improvement methods in pediatric operating rooms (5). As successful surgery depends on effective teamwork (16), it is important to assess teamwork in surgical teams to be aware of the strengths and weaknesses and increase their teamwork capabilities.

2. Objectives

This study aimed to assess surgical teams’ teamwork skills in pediatric surgery.

3. Methods

This cross-sectional study was conducted on 154 surgical teams in the same number of surgeries in the pediatric operating rooms of two public hospitals in Shiraz, Iran, during the summer of 2021 using convenience sampling. All of the pediatric surgeries within the mentioned time which were allowed were studied (154 out of 164). In this way, selection bias was prevented. This study was approved by the Ethics Committee of Shiraz University of Medical Sciences. The inclusion criterion was a willingness to participate in the study; therefore, a total of 473 operating room practitioners participated in the study. The composition of the studied teams was different, at least in one member; therefore, the same teams were not studied again (14 surgeries excluded).

The data collection tool was the Mayo High-Performance Teamwork Scale (MHPTS). This tool included 16 items and was designed by Malec et al. based on crew resource management principles. Items 1 - 8 should always be rated; nevertheless, items 9-16 might be marked as “not applicable” regarding the operating room and surgery situations. Each item could be rated on a four- or three-point rating scale from “never” (score of 0) to “consistently” (score of 2). This tool was already used in simulated scenarios and showed enough validity and reliability (17). The mean score of each item and all the items can be calculated. Higher scores show better teamwork skills. A score of lower than 1 shows poor teamwork skills.

Before data collection, the MHPTS was translated into the Persian language. Accordingly, the standard forward-backward translation method was used. The scale was translated into Persian by two independent experts in human factors and operating room technology; then, the tool was back-translated into English. Finally, a coordinator prepared the Persian version of the MHPTS by comparing and adapting the translations. The content validity of the tool was conducted by content validity index (CVI) and content validity ratio (CVR). The items were given to 20 operating room practitioners, including operating room nurses, anesthesiologists, and surgeons. The CVI and CVR of all the items were at an acceptable level. The concurrent validity of the tool was examined by the intraclass correlation coefficient (ICC) and Pearson correlation coefficient. For this purpose, two observers (including experts in operating room nursing and human factors) observed 10 surgeries and rated the surgical teams separately. The values of the Pearson correlation coefficient and ICC were 0.902 and 0.911, respectively. The reliability of the tool was examined by internal consistency. The Cronbach’s alpha was calculated, and this index for the tool was 0.79. All of the items had a Cronbach’s alpha of higher than 0.7.

The MHPTS in this study was used as an observational tool, as all the research team members confirmed that the items were observable. After asking for the necessary permissions, the data were collected by an experienced operating room technologist via observation. He entered the operating room and presented himself to the surgical team members before the surgery. After explaining the study aims and asking the surgical team members to sign an informed consent form, he stayed in the room and observed the behaviors of the surgical team members till the end of surgery. Then, he rated the surgical teams’ teamwork skills. The data were analyzed by descriptive statistics using SPSS software (version 22).

4. Results

The mean values of age and work experience were 34.52 ± 9.86 and 11.02 ± 8.12 years, respectively. The mean value of teamwork skills for the studied surgical teams was 1.57 ± 0.20 (out of 2). The total score of the items was 25.20 ± 3.31 (out of 32). The majority of the items had a score higher than average. The team members had the highest score in recognizing a leader (1.87 out of 2). The team members did not do well in items 5 and 6, including verbalizing their activities (0.59 out of 2) and repeating back the instructions (0.68 out of 2). Table 1 shows the scores of each item separately.

Table 1.

Mean Scores of Mayo High-Performance Teamwork Scale Skills’ Items (Total Score: 32)

Item NumberDescriptionMean ± Standard Deviation
1A leader is clearly recognized by all team members.1.87 ± 0.43
2The team leader assures the maintenance of an appropriate balance between command authority and team member participation.1.62 ± 0.63
3Each team member demonstrates a clear understanding of his or her role.1.84 ± 0.36
4The team prompts each other to attend to all significant clinical indicators throughout the procedure/intervention.1.58 ± 0.58
5When team members are actively involved with the patient, they verbalize their activities aloud.0.59 ± 0.67
6Team members repeat back or paraphrase instructions and clarifications to indicate that they heard them correctly.0.68 ± 0.76
7Team members refer to established protocols and checklists for the procedure/intervention.1.70 ± 0.52
8All members of the team are appropriately involved and participate in the activity.1.82 ± 0.40
9Disagreements or conflicts among team members are addressed without a loss of situation awareness.1.40 ± 0.62
10When appropriate, roles are shifted to address urgent or emergent events.1.72 ± 0.48
11When directions are unclear, team members acknowledge their lack of understanding and ask for repetition and clarification.1.48 ± 0.68
12Team members acknowledge, in a positive manner, statements directed at avoiding or containing errors or seeking clarification.1.31 ± 0.70
13Team members call attention to actions that they feel could cause errors or complications.1.85 ± 0.37
14Team members respond to potential errors or complications with procedures that avoid the errors or complications.1.77 ± 0.43
15When statements directed at avoiding or containing errors or complications do not elicit a response to avoid or contain the error, team members persist in seeking a response.1.65 ± 0.50
16Team members ask each other for assistance before or during periods of task overload.1.86 ± 0.35

Table 2 shows the detailed scores for each item based on the rating scale. Items number 5 and 6 had the lowest percentage of consistency; however, item number 1 had the highest percentage in behavior consistency.

Table 2.

Frequency and Percentage of Teamwork Scores for Each Item a

Item NumberNever or RarelyInconsistentlyConsistentlyNot Applicable
16 (3.9)7 (4.5)141 (91.6)0
213 (8.4)32 (20.8)109 (78)0
3024 (15.6)130 (84.4)0
47 (4.5)50 (32.5)90 (63)0
579 (51.3)59 (38.3)16 (10.4)0
677 (50)49 (31.8)28 (18.2)0
75 (3.2)35 (22.8)114 (74)0
81 (0.6)25 (16.2)128 (81.3)0
911 (7.1)69 (44.8)74 (48.1)0
105 (3.2)21 (13.6)122 (79.2)6 (3.9)
1117 (11)45 (29.2)92 (59.7)0
1221 (13.6)64 (41.6)69 (44.8)0
131 (0.6)21 (13.6)132 (85.8)0
141 (0.6)32 (20.8)121 (78.6)0
152 (1.3)49 (31.8)103 (66.9)0
161 (0.6)18 (11.7)134 (87)1 (0.6)

5. Discussion

The results showed that the studied surgical teams had good teamwork skills. However, in some of the items, the studied surgical teams had low scores due to poor team communication skills. The result of good teamwork skills in this study is consistent with the results of several previous studies on surgical teams (7, 14, 18). In recent years, special attention has been paid to nontechnical skills, such as teamwork, in the operating room, as good levels of these skills have a critical role in preventing surgical adverse events (8). Therefore, hospital managers and operating room staff might be aware of teamwork benefits in providing safe patient care. This could be the reason for the good teamwork skills in this study. Moreover, the high sensitivity of pediatric surgeries could be another reason for these results. Patient safety culture in the studied pediatric surgical care units was acceptable (19). Reported positive attitudes toward the use of surgical safety checklists in pediatric surgeries (20) also show that operating room staff does well in showing their nontechnical skills in these operating rooms. Several studies have shown some poor teamwork skills in operating room practitioners in Iran (21-24). However, all of these studies were conducted at the individual level and on different surgery types than pediatric.

The studied teams had a low mean score in two items, including verbalizing their activities and repeating back the instructions. It seems that they did not do well in behaviors that were related to team communication. Clinical communication is known as a complex issue (25). In a previous study, it was revealed that verbal communication problems, such as not responding, are not rare and happen during surgeries (26). Low scores in these behaviors can be due to the importance of silence in the operating room, as several team members might need to be silent to stay focused. Trying to prevent the dispersion of oral bacteria can be another reason. However, the necessary information should be exchanged in an operating room to avoid errors. Probably, the teams with familiar members ignore some essential communications, which can cause problems in surgery. The use of standardized communication can be helpful in improving the scores in the related items. Implementing a pediatric surgical safety checklist is a useful way in this regard (27). Repeating back the instructions is more expected from surgical nurses; therefore, improving their communication skills can also help (28).

Improved teamwork skills are important in operating rooms. The benefits include shorter delays, improved effectiveness, less job stress, and more patient satisfaction (29). The surgical teams of the studied pediatric surgeries had good teamwork skills. Interventions, such as retraining courses, can help maintain the overall teamwork level. Educational programs and setting policies related to communication (26) can be helpful in improving communication.

This study had limitations. As all of the observations were made during pediatric surgeries, the results are not generalizable to other types of surgery.

5.1. Conclusions

The overall teamwork score in the studied teams in the pediatric operating rooms was at a good level. However, the studied teams did not do well in team communication behaviors. Interventions, such as educating, standardizing communications, and implementing the pediatric surgical safety checklist, can improve team communication skills.

References

  • 1.

    Weller J, Boyd M. Making a Difference Through Improving Teamwork in the Operating Room: A Systematic Review of the Evidence on What Works. Curr Anesthesiol Rep. 2014;4(2):77-83. https://doi.org/10.1007/s40140-014-0050-0.

  • 2.

    de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17(3):216-23. [PubMed ID: 18519629]. [PubMed Central ID: PMC2569153]. https://doi.org/10.1136/qshc.2007.023622.

  • 3.

    Zegers M, de Bruijne MC, de Keizer B, Merten H, Groenewegen PP, van der Wal G, et al. The incidence, root-causes, and outcomes of adverse events in surgical units: implication for potential prevention strategies. Patient Saf Surg. 2011;5:13. [PubMed ID: 21599915]. [PubMed Central ID: PMC3127749]. https://doi.org/10.1186/1754-9493-5-13.

  • 4.

    Nepogodiev D, Martin J, Biccard B, Makupe A, Bhangu A, National Institute for Health Research Global Health Research Unit on Global S. Global burden of postoperative death. Lancet. 2019;393(10170):401. [PubMed ID: 30722955]. https://doi.org/10.1016/S0140-6736(18)33139-8.

  • 5.

    Kerrick L. TeamSTEPPS In A Pediatric Operating Room. Student Publications; 2021.

  • 6.

    Kalantari R, Zakerian SA, Mahmodi Majdabadi M, Zanjirani Farahani A, Meshkati M, Garosi E. Assessing the teamwork among surgical teams of hospitals affiliated to social security organizations in Tehran City. J Hospital. 2016;15(3):21-9.

  • 7.

    Kalantari R, Zanjirani Farahani A, Garosi E, Badeli H, Jamali J. Translation and Psychometric Properties of the Persian Version of Oxford Non-technical Skills 2 System: Assessment of Surgical Teams' Non-technical Skills in Orthopedic Surgery Wards. Arch Bone Jt Surg. 2019;7(2):173-81. [PubMed ID: 31211196]. [PubMed Central ID: PMC6510912].

  • 8.

    Flin R, O’Connor P, Crichton M. Safety at the sharp end: a guide to non-technical skills. CRC Press; 2017. https://doi.org/10.1201/9781315607467.

  • 9.

    Weaver SJ, Feitosa J, Salas E, Seddon R, Vozenilek JA. The theoretical drivers and models of team performance and effectiveness for patient safety. Improving patient safety through teamwork and team training. New York: Oxford University Press; 2013. p. 3-26.

  • 10.

    Alonso A, Dunleavy D. Building teamwork skills in healthcare: the case for communication and coordination competencies. Improving patient safety through teamwork and team training. Oxford, UK: Oxford University Press; 2012. p. 41-58.

  • 11.

    Hu YY, Arriaga AF, Peyre SE, Corso KA, Roth EM, Greenberg CC. Deconstructing intraoperative communication failures. J Surg Res. 2012;177(1):37-42. [PubMed ID: 22591922]. [PubMed Central ID: PMC4539247]. https://doi.org/10.1016/j.jss.2012.04.029.

  • 12.

    Yule S, Flin R, Paterson-Brown S, Maran N. Non-technical skills for surgeons in the operating room: a review of the literature. Surgery. 2006;139(2):140-9. [PubMed ID: 16455321]. https://doi.org/10.1016/j.surg.2005.06.017.

  • 13.

    Wiegmann DA, ElBardissi AW, Dearani JA, Daly RC, Sundt T3. Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery. 2007;142(5):658-65. [PubMed ID: 17981185]. https://doi.org/10.1016/j.surg.2007.07.034.

  • 14.

    Undre S, Sevdalis N, Healey AN, Darzi A, Vincent CA. Observational teamwork assessment for surgery (OTAS): refinement and application in urological surgery. World J Surg. 2007;31(7):1373-81. [PubMed ID: 17487527]. https://doi.org/10.1007/s00268-007-9053-z.

  • 15.

    Harris TB, Sibley A, Rodriguez C, Brandt ML. Teaching the psychosocial aspects of pediatric surgery. Semin Pediatr Surg. 2013;22(3):161-6. [PubMed ID: 23870211]. https://doi.org/10.1053/j.sempedsurg.2013.05.005.

  • 16.

    Borrill CS, Carletta J, Carter A, Dawson JF, Garrod S, Rees A, et al. The effectiveness of health care teams in the National Health Service: final report for the Department of Health. Birmingham, England: University of Aston; 2000.

  • 17.

    Malec JF, Torsher LC, Dunn WF, Wiegmann DA, Arnold JJ, Brown DA, et al. The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simul Healthc. 2007;2(1):4-10. [PubMed ID: 19088602]. https://doi.org/10.1097/SIH.0b013e31802b68ee.

  • 18.

    Hull L, Arora S, Kassab E, Kneebone R, Sevdalis N. Assessment of stress and teamwork in the operating room: an exploratory study. Am J Surg. 2011;201(1):24-30. [PubMed ID: 21167362]. https://doi.org/10.1016/j.amjsurg.2010.07.039.

  • 19.

    Poley MJ, van der Starre C, van den Bos A, van Dijk M, Tibboel D. Patient safety culture in a Dutch pediatric surgical intensive care unit: an evaluation using the Safety Attitudes Questionnaire. Pediatr Crit Care Med. 2011;12(6):e310-6. [PubMed ID: 21572367]. https://doi.org/10.1097/PCC.0b013e318220afca.

  • 20.

    Norton EK, Singer SJ, Sparks W, Ozonoff A, Baxter J, Rangel S. Operating Room Clinicians' Attitudes and Perceptions of a Pediatric Surgical Safety Checklist at 1 Institution. J Patient Saf. 2016;12(1):44-50. [PubMed ID: 25010191]. https://doi.org/10.1097/PTS.0000000000000120.

  • 21.

    Kalantari R, Zamanian Z, Hasanshahi M, Jamali J, Faghihi A, Niakan MH, et al. An observational study to assess circulating nurses' non-technical skills. J Perioper Pract. 2022:17504589221117700. [PubMed ID: 36062532]. https://doi.org/10.1177/17504589221117673.

  • 22.

    Kalantari R, Zamanian Z, Hasanshahi M, Faghihi SA, Jamali J, Niakan H. The Effect of Educational Intervention on the Improvement of Nontechnical Skills in Circulating Nurses. Biomed Res Int. 2021;2021:5856730. [PubMed ID: 34692835]. [PubMed Central ID: PMC8536428]. https://doi.org/10.1155/2021/5856730.

  • 23.

    Hasanshahi M, Kalantari R, Zamanian Z, Gheysari S, Bakhshi E. Assessment of Non-Technical Skills in Iranian Orthopedic Surgeons: An Observational Study. J Adv Med Biomed Res. 2020;28(129):191-7. https://doi.org/10.30699/jambs.28.129.191.

  • 24.

    Gholami M, Zamanian Z, Kalantari R, Hasanshahi M, Hosseinzadeh Roknabadi E, Gheysari S. Assessment of anesthetist’s non-technical skills in Iranian hospitals. J Health Sci Surveill Syst. 2018;6(4):207-11. https://doi.org/10.30476/jhsss.2020.84392.1034.

  • 25.

    Miller A, Weinger MB, Buerhaus P, Dietrich MS. Care coordination in intensive care units: communicating across information spaces. Hum Factors. 2010;52(2):147-61. [PubMed ID: 20942247]. https://doi.org/10.1177/0018720810369149.

  • 26.

    Garosi E, Kalantari R, Zanjirani Farahani A, Zuaktafi M, Hosseinzadeh Roknabadi E, Bakhshi E. Concerns About Verbal Communication in the Operating Room: A Field Study. Hum Factors. 2020;62(6):640-53. [PubMed ID: 31306042]. https://doi.org/10.1177/0018720819858274.

  • 27.

    Norton EK, Rangel SJ. Implementing a pediatric surgical safety checklist in the OR and beyond. AORN J. 2010;92(1):61-71. [PubMed ID: 20619773]. https://doi.org/10.1016/j.aorn.2009.11.069.

  • 28.

    Kalantari R, Zamanian Z, Jamali J, Faghihi A, Hasanshahi M, Gheysari S. Reviewing the Existing Observational Tools for Assessment of Circulating Nurses' Nontechnical Skills. Preprint. J Pediatr Surg Nurs. 2021. https://doi.org/10.1097/jps.0000000000000325.

  • 29.

    Kaissi A, Johnson T, Kirschbaum MS. Measuring teamwork and patient safety attitudes of high-risk areas. Nurs Econ. 2003;21(5):211-8. 207. [PubMed ID: 14618970].