Investigating Emergency Department Nurses’ Educational Needs and Exploring Strategies to Meet Challenges Against Management of These Needs: A Qualitative Study

authors:

avatar Farnoush Azizi ORCID 1 , 2 , avatar Behnam Honarvar ORCID 2 , * , avatar Zahra Molazem ORCID 3 , 1 , avatar Azar Kazemi ORCID 4 , avatar Banafsheh Tehranineshat 5

Department of Nursing, School of Nursing and Midwifery, Shiraz University of Medical Sciences, Shiraz, Iran
Health Policy Research Center, Institute of Health, Shiraz University of Medical Sciences, Shiraz, Iran
Community Based Psychiatric Care Research Center, Shiraz University of Medical Sciences, Shiraz, Iran
Department of Medical Informatics, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
Department of Nursing, Faculty of Nursing and Midwifery, Hormozgan University of Medical Sciences, Bandar Abbas, Iran

How To Cite Azizi F, Honarvar B, Molazem Z, Kazemi A, Tehranineshat B. Investigating Emergency Department Nurses’ Educational Needs and Exploring Strategies to Meet Challenges Against Management of These Needs: A Qualitative Study. Shiraz E-Med J. 2023;24(3):e122875. https://doi.org/10.5812/semj-122875.

Abstract

Background:

Nurses who are occupied in emergency departments play a critical role in health services provision and patient care. Considering the importance of providing appropriate and immediate care in emergency departments, nurses need to acquire sufficient skills and up-to-date knowledge.

Objectives:

This study aimed to identify the educational needs of nurses working in the emergency department and explore strategies to meet challenges against the elimination of these needs.

Methods:

This qualitative study was conducted using a content analysis approach. This study selected the emergency departments of two large educational hospitals affiliated with Shiraz University of Medical Sciences, Shiraz, southern Iran. This study was conducted on 15 emergency department nurses selected via purposive sampling with maximum variation within January 2020 and March 2021.The data were collected by performing 15 in-depth, semi-structured interviews (11 face-to-face and 4 telephone interviews due to the coronavirus disease 2019 pandemic) and making field notes. Then, the recorded interviews were transcribed verbatim and analyzed using the qualitative content analysis approach proposed by Graneheim and Lundman. The consolidated criteria for reporting qualitative studies (COREQ) was used to report the findings of this study.

Results:

Three main themes, namely the need for comprehensive and continuous education, challenges of managing educational needs, and strategies to meet educational needs, were extracted following data analysis.

Conclusions:

Clarifying the educational needs of nurses and exploring strategies to solve these challenges can be effective by providing continuous practical training and adopting effective teaching-learning strategies to promote nurses’ education and improve their performance in clinical skills. Accordingly, the provision of appropriate infrastructure for mobile health applications and utilization of mobile-based educational applications in emergency departments have to be taken into account by hospital managers and health policymakers.

1. Background

The emergency department is an environment for the provision of immediate and non-scheduled care services. The combination of non-scheduled care services, increased referrals to the emergency department, and limited resources for emergency practices results in challenging conditions in this environment (1). This can, in turn, increase the length of stay, reduce patient satisfaction, and endanger patient safety (2). In addition, the complexity of the emergency department, including patients with complicated conditions, high-risk individuals, and the number of patients, increases over time (3, 4) Nurses in the emergency department are at the frontline of hospital services since they are in direct contact with patients suffering from serious disorders and with victims of injuries and violence. Therefore, they need advanced knowledge and skills to manage such patients (5).

Emergency department nurses’ performance in precise decision-making and prioritization of care depends on a combination of theoretical knowledge, previous experiences, and cognitive fields. Working in this department also requires expertise in using technologies and facilities, awareness of social challenges, the ability to work with pre-hospital healthcare providers, and advanced knowledge regarding all age groups and medical and surgical fields (6). As a result, similar to other experts, nurses have to keep their knowledge up to date to ensure that they can provide the best care for their patients and societies. In other words, professional nursing performance requires lifelong learning (7).

A needs assessment has been considered the first step for the determination of nurses’ educational needs and the development of education (8). The results of a qualitative study by Jho and Kang on evaluating emergency department nurses’ educational needs and clinical skills indicated that nurses prefer to learn new knowledge, evidence-based practice, clinical nursing skills, and research methods (9). Learning Needs Assessment is a systematic strategy for evaluating what individuals or groups have to learn (10). The results of a study on self-perceived educational needs by emergency nurses indicated that most nurses did not have sufficient competency, skills, and knowledge. It was concluded that nurses need educational development to improve their basic, intermediate, and advanced skills (5).

The emergency care system in developing countries is primitive, compared to developed countries, which leads to the aggravation of problems caused by overcrowding and insufficient preparation of nurses for emergency care (8). However, due to unmet educational needs, nurses face challenges in providing safe and high-quality care to patients in the emergency departments; however, these challenges have rarely been investigated (11). Considering these issues and no study performed on clarifying the educational needs of nurses working in the emergency department, it is necessary to conduct a qualitative study to gain insight and a deep understanding of emergency department nurses’ educational needs and strategies to meet challenges against the elimination of these needs.

2. Objectives

This study aimed at explaining emergency department nurses’ educational needs and challenges against the elimination of these needs. In addition, from the perspective of nurses, it was attempted to explore strategies to meet these educational needs.

3. Methods

3.1. Study Design

Conventional content analysis was used to investigate nurses’ educational needs and challenges, along with strategies to meet these needs, from their perspective. This method is used for the collection of new and rich data and subjective content interpretation through a classified coding process to extract themes and patterns (12). Therefore, it was decided to use qualitative interviews for data collection to explore the main respondents’ personal insights. The consolidated criteria for reporting qualitative studies (COREQ) was used to report the findings of this study (Appendix 1 in Supplementary File).

3.2. Participants

This study was conducted on 15 nurses working in the emergency departments of two educational referral hospitals affiliated with Shiraz University of Medical Sciences, Shiraz, southwest of Iran, using purposive sampling (13) within January 2020 to March 2021. The inclusion criteria were willingness to participate in this study, at least a bachelor’s degree in nursing, and working experience for at least one year in the emergency department of the hospital. The participants were ensured they could withdraw from the study at any stage. The nurses with a variety of employment statuses, job tenures, and educational levels were enrolled. Purposive sampling continued until data saturation, where no new data were obtained. Categories were developed based on the similarities in the obtained codes. Immediately after each interview, the recording was listened to and transcribed word by word. Then, the data were analyzed, and the next interview was decided.

3.3. Data Collection

The data were collected via holding semi-structured interviews and taking field notes. Before the interviews, the participants were given information about the research team, background, objectives, and questions. Informed consent was obtained from each subject; however, they were provided with the opportunity to ask their questions. Then, they attended individual interviews. In total, 15 in-depth, semi-structured interviews were conducted by the first author (F.A.), who was a female nursing instructor (with a master’s degree, master of public health) in the emergency department.

Considering the coronavirus disease 2019 (COVID-19) pandemic and its associated lockdowns, four interviews were conducted through phone contacts. For these interviewees, primary information and informed consent forms were sent via e-mail or WhatsApp application. The interviewees were supposed to be interviewed whenever they felt comfortable. Each interview was conducted in a quiet room in the School of Nursing or the conference hall of the hospital and lasted up to 40 - 65 minutes. After each interview, the researcher referred to the emergency department and took notes from her observations about nurses’ educational needs, challenges, and strategies to meet these challenges and needs. The observations were made in morning, evening, and night work shifts, and each observation session lasted around 2 - 5 hours. The interviews were begun with a general question, and further questions were asked based on the participants’ responses. The main question was, “What is one of your working days in the emergency department like? Please describe your experience while focusing on your educational needs”. Then, the following questions were asked:

While working at a patient’s bedside, what educational needs do you feel?

What are the challenges to meeting educational needs, in your opinion?

What are the strategies to meet these educational needs?

How would you like your educational needs to be eliminated?

All the interviews were recorded by a recorder and were immediately transcribed by the researcher.

3.4. Data Analysis

The present study used the conventional content analysis method suggested by Graneheim and Lundman. All transcripts were read several times; accordingly, the researcher was immersed in the data, developed an overall understanding, and identified the underlying meanings. The words, sentences, and paragraphs containing key points related to the nurses’ educational needs and strategies to meet challenges against the elimination of educational needs were defined as meaning units. Then, each condensed unit was labeled with a code, and the codes with similar meanings were assigned to a category. In this way, subcategories were created. Based on the qualitative content meanings and nurses’ descriptions, the subcategories were combined, and categories were created. After all, nine categories and three main themes were obtained. Data analysis was performed simultaneously and continued until reaching data saturation, when the new data did not show any new information (14). The research team and two qualitative research experts examined the codes to verify that the data were saturated. Data analysis was conducted using MAXQDA software (version 10).

3.5. Rigor

The criteria suggested by Lincoln et al. were used (15) to validate data analysis. Credibility was determined through prolonged engagement with the data (14 months), member checking, peer debriefing, and integration of different individuals (i.e., nurses with different ages, genders, educational levels, and job tenures), times (i.e., data collection from the nurses working in different work shifts), and places (i.e., different hospitals). Dependability and confirmability were determined by integrating methods (i.e., semi-structured interviews and observation) and audit trials, including correct interviewing techniques and accuracy in note-taking and analysis. Finally, transferability was ensured via the complete and accurate description of the intended phenomenon, participants’ characteristics, data collection methods, and data analysis, together with the provision of examples of participants’ statements (12).

3.6. Ethical Considerations

This study was approved by the Ethics Committee of Shiraz University of Medical Sciences (IR.SUMS.REC.1398.308). Before the interviews, the participants were provided with information about the study objectives, voluntary participation, data collection methods, reasons for recording the data, roles of researchers and participants, confidentiality of their data, and anonymity. Then, the participants were asked to complete informed consent forms for participating in the study. The participants were also ensured that they could withdraw from the study at any stage.

4. Results

The participants included 15 nurses aged 24 - 43 years who worked at the emergency departments of Namazi and Faghihi hospitals in Shiraz. Table 1 shows the participants’ demographic characteristics. Data analysis resulted in the development of three main themes, including the need for comprehensive and continuous education, strategies to meet educational needs, and challenges against the management of educational needs. Moreover, 9 categories and 36 subcategories were identified (Table 2). An example of coding and development of subcategories, categories, and themes is shown in Table 3.

Table 1.

Demographic Characteristics of the Participants

Participants IDGenderAge, yEducational LevelWorking Experience in the Emergency Department, y
P1Female28Bachelor’s degree5
P2Female31Bachelor’s degree7
P3Female37Bachelor’s degree13
P4Female24Bachelor’s degree1
P5Female26Bachelor’s degree3
P6Male38Bachelor’s degree12
P7Female41Bachelor’s degree6
P8Female29Master’s degree3
P9Male33Master’s degree7
P10Female24Bachelor’s degree2
P11Male31Bachelor’s degree9
P12Female26Bachelor’s degree3
P13Female35Master’s degree3
P14Female43Bachelor’s degree11
P15Male34Bachelor’s degree3
Table 2.

Main Themes, Categories, and Subcategories That Emerged in This Study

ThemesCategoriesSubcategories
Need for comprehensive and continuous educationTraining routine care in the emergency departmentNeed for clinical skills education
Need for education regarding drugs and sera
Need for education regarding disease diagnosis
Need for nursing care education
Need for education regarding accurate documentation in the emergency department
Patient safety managementNeed for infection control principles education
Need for training about comprehensive patient assessment
Need to learn teamwork and interprofessional collaboration
Need for continuous educationNeed for in-person retraining programs
Need for virtual retraining programs
Challenges against the management of educational needsOrganizational barriersHigh workload, Numerous work shifts
Lack of educational facilities
Prohibition of using cell phones in the ward
Lack of enough space in the emergency department
Noise pollution
Personal barriersExcessive fatigue of emergency department nurses
Low self-confidence
Low level of motivation
Strategies to meet educational needsParticipation of nurses in physicians’ clinical roundsPhysician-nurse information exchange during patient visits
Motivate to learn more by participating in physicians’ rounds
Monitoring, evaluation, and feedback systemEvaluation of nurses’ learning after training
Managers’ attention to the educational needs of nurses
Repeat training if needed
Giving feedback to individuals ignoring individual educational needs
Developing the infrastructure to use the mobile health applicationsUnderstanding the importance of mobile health by hospital managers
Designing a simple educational application
Academic education application
Training nurses about mobile health applications
Using mobile-basedspecialized educational health applicationsDrug education application
Para-clinical education application
Patient education application
Educational application regarding common emergency disorders
Educational application regarding clinical procedures
Educational application on COVID-19
Table 3.

An Example of Coding and Development of Subcategories, Categories, and Themes

ThemesCategoriesSubcategoriesCoding
Need forcomprehensive and continuous educationTraining routine care in the emergency departmentNeed for clinical skills educationNeed for education regarding, airway management and suctioning
Need for education regarding cardiopulmonary resuscitation procedure
Need for education regarding nasogastric tube placement
Need for education regarding peripheral pediatric intravenous catheters insertion
Need for education regarding electrocardiogram interpretation
Need for infusion pump devices training
Need for defibrillator training
Need for education regarding the interpretation of arterial blood gas
Need for education regarding drugs and seraNeed for education regarding new drugs
Need for education regarding chemotherapy drugs
Need for education regarding medications used in pediatric emergency
Need for education regarding sera compounds and their uses
Need for education regarding the antidote of common drugs and poisons
Need for education regarding disease diagnosisNeed for education regarding common heart diseases
Need for education regarding diseases requiring emergency surgery
Need for education regarding the diagnosis of common pediatric emergency disease
Need for education regarding the diagnosis of stroke disease
Need for education regarding the diagnosis of diabetic ketoacidosis
Need for education regarding the diagnosis of coronavirus diseases
Need for education regarding the diagnosis of syncope disease
Need for nursing care educationNeed for nursing care education of patients’ revival after cardiopulmonary resuscitation
Need for nursing care education of diabetic ketoacidosis patients
Need for nursing care education of patients under mechanical ventilation
Need for nursing care education of patients with gastrointestinal bleeding
Need for nursing care education for stroke patients
Need for nursing care education of chronic obstructive pulmonary disease patients
Need for nursing care education of patients with ostomy
Need for education regarding accurate documentation in the emergency departmentNeed for education regarding the documentation of nursing notes based on guideline
Need for education regarding accurate documentation in patient education
Need for education regarding correctly recording information in the triage form
Need for education regarding the correct documentation of nursing errors
Patient safety managementNeed for infection control principles educationNeed for education regarding the principles of isolation of patients with weakened immune systems
Need for infection control and prevention education in facing patients with coronavirus
Need for education regarding the control of hospital infections
Need for training about comprehensive patient assessmentNeed for education, regarding the importance of assessing the patient’s signs and symptoms
Need for education regarding the assessment of religious and cultural issues of patients
Need for education regarding the importance of the patient’s medical history
Need for learning teamwork and interprofessional collaborationNeed to learn to exchange patient information with care team members
Communication skills and compatibility training with other members of the treatment team
Need to learn to exchange patient information during shift handover
Need for continuous educationNeed for in-person retraining programsNeed for holding in-person training workshops on clinical skills
Need for holding learner-centered practical workshops
Need for bedside teaching
Need for virtual retraining programsNeed for online educational workshops
Need for mobile-based educational programs
Need for training through simulation

4.1. Need for Comprehensive and Continuous Education

In this study, the need for comprehensive and continuous education comprised three categories of training routine care in the emergency department, management of patient safety, and the need for continuous training, which were highly interrelated.

4.1.1. Training the Routine Care in the Emergency Department

The subcategories of training routine care in the emergency department consisted of the need for clinical skills education, education regarding drugs and sera, education regarding disease diagnosis, nursing care education, and education regarding accurate documentation in the emergency department. All the study participants believed that comprehensive nursing knowledge was needed for working in the emergency department. Nevertheless, some participants emphasized that although the emergency department was quite complicated, there was no preclinical education for the nurses working in this department. Since patients with different ages and diseases refer to the emergency departments, physicians and nurses working in these wards have to receive training regarding their profession accordingly, which will be effective in the promotion of patient care, enhancement of satisfaction among patients and their families, and reduction of mortality rate.

“I think training on COVID-19 is a significant issue. There is little information. We have to know the symptoms indicating the improvement or worsening of the condition to be able to take appropriate measures soon.” (Participant 3)

Another nurse stated that:

“I sometimes have problems in calculating the medications that have to be injected through the syringe pump, or I do not know the duration of injection of some new drugs; I need to receive training in this regard. Another educational need is about the accurate principles of suction.” (Participant 15)

4.1.2. Patient Safety Management

According to most of the participants, it was essential to train nurses on the principles of infection control, especially in the emergency departments, which is the key point for patients entering the hospitals. The participants also believed that training about comprehensive patient assessment and learning teamwork and collaboration with different occupations involved in patient care and treatment could lead to the improvement of patient care and patient safety.

“Sometimes, especially in emergency conditions, we encounter various signs and symptoms in patients that confuse us. We need to be trained about the priorities of measures we can take in these situations.” (Participant 12)

According to another participant:

“Consulting with people who are involved in the care and treatment of the patients helps not to miss information about the patient’s condition and greatly contributes to the treatment of patients; however, unfortunately, training teamwork and its implementation is weak.” (Participant 5)

4.1.3. Need for Continuous Education

From the participants’ viewpoints, professional performance in the emergency departments depended on having a professional team with up-to-date knowledge and being competent in clinical practice. The subcategories of this category included the need for in-person and virtual retraining programs for nurses working in the emergency department. Most nurses stated that they did not have up-to-date knowledge, skills, and procedures about many diseases and routinely performed what they had previously learned. Therefore, these pieces of training were recommended to be updated periodically. Considering in-person retraining programs, most nurses preferred participating in learner-centered practical workshops. Concerning virtual retraining programs, on the other hand, the utilization of mobile phone potentials and educational applications was noted.

“Numerous beneficial tasks can be developed to train personnel using mobile phones. For example, WhatsApp groups can be created, in which educational materials can be shared by head nurses.” (Participant 9)

According to another participant:

“Holding in-person workshops is beneficial for training and eliminating learning deficiencies, and it is better to provide practical work opportunities for all personnel in the workshops.” (Participant 12)

4.2. Challenges Against Management of Educational Needs

Before mentioning the educational needs, most participants referred to the challenges against the management of their educational needs that, included personal and organizational barriers. In this context, almost all nurses stated that high workload, numerous work shifts, lack of educational facilities, prohibition of using cell phones in the ward, lack of enough space, noise pollution, excessive fatigue, and low self-confidence and motivation prevented the elimination of their educational needs. The removal of educational obstacles can provide the ground for eliminating nurses’ educational needs, eventually improving the quality of care for patients.

4.2.1. Organizational Barriers

The majority of the participants pointed to organizational barriers as a major obstacle to the removal of educational needs. High workload, numerous work shifts, lack of educational facilities, prohibition of using cell phones in the ward, lack of space, and much ambient noise were extracted as the subcategories of organizational barriers. The elimination of these barriers could result in lower stress levels and greater appropriate opportunities for learning at patients’ bedsides and increase appropriate conditions for training and willingness to learn. It could also enhance the nurses’ interest in learning.

Some participants felt uncomfortable and hopeless due to the overcrowding of the department and lack of attention to their educational needs. One of the nurses in this regard said:

“The emergency department is very crowded so that we do not have time to learn what we do not know, and managers do not pay attention to it.” (Participant 1)

Another nurse stated that:

“Sometimes, it is necessary to use a mobile phone, for example, to calculate the dose of medicine or search for medical information; however, because the use of mobile phones is prohibited in the department, we cannot use it easily.” (Participant 13)

Most participants emphasized that the number of patients admitted to the emergency department exceeded the capacity of the ward, which prevented the elimination of educational needs. Crowdedness and high levels of noise were also mentioned as obstacles to the elimination of educational needs and training of clinical skills.

“There are stretchers, beds, and patients even in the corridors. If it were not the case, there would be a ground for information exchange and training among colleagues at patients’ bedsides.” (Participant 2)

4.2.2. Personal Barriers

High fatigue levels, low self-confidence, and poor motivation among emergency department nurses were among the personal barriers to removing educational needs. In this regard, some nurses stated that they were not willing to participate in workshops and meet their educational needs due to high fatigue levels and lack of motivation resulting from the high workload. Furthermore, low self-confidence and a lack of knowledge about working in the emergency department prevented them from asking their questions and removing their educational needs.

“It is true that workshops may be beneficial, but individuals are not willing to take part in these workshops due to fatigue.” (Participant 6)

Another nurse stated that:

“I do not have enough knowledge about some necessary measures in the emergency department; my self-confidence is so low that I feel ashamed to ask the head nurse or my colleagues about things I do not know.” (Participant 10)

4.3. Strategies to Meet Educational Needs

The exchange of information between nurses during patient visits, motivating learning by attending physicians’ clinical rounds, managers’ attention to nurses’ educational needs, evaluation of nurses’ learning after training, and managers’ understanding of the benefits of mobile-based educational applications were recommended as solutions to eliminating needs and barriers. Furthermore, using academic and practical educational applications, which are easy to use, was among other strategies expressed by the nurses to meet their educational needs. This theme consisted of some categories, namely the participation of nurses in physicians' clinical rounds, using monitoring, evaluation, and feedback system, developing the required infrastructure for using mobile health applications and using mobile-based specialized educational health applications.

4.3.1. Participation of Nurses in Physicians’ Clinical Rounds

Based on the experiences of the participants, the exchange of information between nurses and physicians during patient visits could be a good strategy to meet their educational needs, including knowledge about diseases, medications, and patient care protocols. In addition, they mentioned that the participation of nurses in the physicians’ clinical rounds at the patient’s bedside could increase their motivation to learn and consequently contribute to eliminating their educational needs.

“Many times, we learn about new drugs or changes in a patient’s condition during physicians’ clinical rounds, and this helps to meet our educational needs.” (Participant 7)

4.3.2. Monitoring, Evaluation, and Feedback System

Emergency department nurses believed that nursing managers’ supervision and attention to the educational needs of nurses, accurate evaluation of nurses’ learning, and provision of feedback could be an important strategy to meet educational needs. Based on the experiences of the participants, paying attention to the evaluation of the knowledge of nurses and giving feedback to them, especially those who are indifferent to their educational needs, by supervisors, hospital education authorities, and nurses in charge of training personnel in the ward, was one of the important strategies to overcome the educational needs of nurses.

“Our head nurse pays attention to our educational needs and helps us to learn.” (Participant 1)

Another participant said:

“When dealing with individuals who neglect their educational needs, they take this issue seriously and try to overcome their educational needs.” (Participant 15)

Most of the nurses stated that according to the nature of the educational content, holding a practical or written test and giving feedback based on the test results could eliminate their educational needs.

“After the ventilator workshop, the teacher conducted a practical test, and anyone who made more than two mistakes had to repeat the course; this strategy was excellent.” (Participant 11)

4.3.3. Development of the Infrastructure to Use Mobile Health Application

Most of the participants believed that the capabilities of mobile technology should also be used in hospitals. According to the participants’ experiences, the use of mobile health technologies could help educate both nurses and patients. The participants also stated that understanding the importance of mobile health applications by managers and using easy-to-use educational applications could be a strategy to meet the educational needs of emergency department nurses. One of the nurses acknowledged that:

“By using an educational application on my mobile phone, I was teaching a stroke patient about discharge instructions. However, the supervisor warned me not to use the content of this application, although it was useful.” (Participant 2)

Some nurses stated that due to the crowdedness of the emergency department and shortage of time, training nurses about mobile health applications could give them a sense of independence, contribute to time management, and increase accuracy in the workplace.

The experience of one of the nurses in this regard was as follows:

“The preceptor taught me about how to work with injectable drugs application. From then on, I calculate drug doses, such as heparin, and teach the drug instructions to the patient quickly and more accurately.” (Participant 5)

4.3.4. Using Mobile-Based Specialized Educational Health Applications

Based on the experiences of some participants, due to the high workload of nurses and shortage of time, the use of mobile health applications as an available tool could contribute to meeting the educational needs of nurses.

“By using a mobile application during nasogastric tube placement, I could manage some of my educational needs.” (Participant 14)

Concerning her experience of using the application for COVID-19, another nurse working in the pediatric emergency department stated:

“In a situation where we did not have much medical information about managing COVID-19 patients, I used a foreign mobile health application on patient care tips.” (Participant 8).

Based on the experience of four of the participants, emergency department nurses’ use of an educational application to strengthen psychological skills, especially in crisis situations, such as the COVID-19 epidemic, could adequately remove their need for workshops related to stress management and self-mastery.

“I was using an educational application on strengthening psychological skills, and I learned a lot about coping with stress and positive thinking.” (Participant 4)

5. Discussion

One of the findings of this study was the need for comprehensive and continuous education for all nurses who occupy the emergency departments of hospitals. In this context, the need for training in clinical skills, drugs, sera, disease diagnosis, nursing care, documentation, and patient safety management was claimed as the main educational need for emergency nurses. In sum, the findings of this study indicated that emergency department nurses need virtual or face-to-face retraining as a continuing educational program. Furthermore, using technologies, such as mobile health applications, can help trainees to be educated and use their knowledge faster at patients’ bedside, especially in work-overloaded times.

Farahmand Rad et al. performed a study on emergency department workers and found no significant difference between face-to-face and virtual training groups regarding practical test scores. However, the face-to-face training group had better post-test scores than the virtual training group in all skills. Farahmand Rad et al. also concluded that according to the nature of the subject matter, the skills which wanted to be trained, and the conditions of the learners, both methods can be used in education (16). Similarly, other studies demonstrated that continuing education was crucial to nurses (17, 18), and nursing education was among the predictors of patient outcomes (19).

In another study, nurses perceived that they were qualified in basic skills, such as the assessment of breathing or circulation and administration of oxygen; nevertheless, approximately more than half of nurses emphasized that they need to learn other clinical practices, such as electrocardiogram interpretation, shock management, and intubation (5). Another study showed a lack of continuity in nursing educational programs based on occupational needs. The authors suggested proper training concerning the use of medical equipment (20). Retraining clinical skills could help nurses retain their knowledge and promote their clinical practice (18), thereby improving their self-confidence (21).

The results of the current study revealed that patient safety management is one of the educational needs of emergency department nurses, which consisted of some categories, namely the need for infection control principles education, the need for training in comprehensive patient assessment, and the need for learning teamwork and interprofessional collaboration. Another study showed that emergency department personnel were exposed to a wide range of stressors, including workload, time shortage, insufficient personnel, and lack of teamwork, which endangered patient safety (22). Patient safety results from the interaction of system components; therefore, training teamwork and interprofessional collaboration should be performed as a necessary prelude to patient safety and as a process that is formed organizationally in relationships among colleagues (23).

The results of Boeira et al.’s study showed that failure to teach nursing students about the principles of infection prevention and control could reduce the quality of care and patient safety. The aforementioned study concluded that there is a need to review the educational programs of nursing students and include their educational needs in the curricula (24). Similarly, another study demonstrated that a comprehensive and rapid assessment of patients was the basis of effective nursing care, which required good cooperation between health workers. It was also revealed that this strategy promoted patient safety; therefore, patient outcomes would be improved (25). Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS) aims at introducing a patient safety culture based on interdisciplinary communication, patient condition monitoring, and patient support. A study showed that training TeamSTEPPS led to a reduction in the occurrence of adverse events caused by poor cooperation among personnel and had a positive effect on the personnel’s satisfaction and morale (26).

The present study’s results indicated that some personal, structural, and organizational characteristics might prevent nurses from meeting their educational needs. According to the nurses’ perspectives, high workload, numerous work shifts, lack of training equipment, and prohibition of mobile use in the department were the major organizational obstacles to education. These findings are in line with the findings of a study regarding the barriers to sufficient training among nurses (27). In this context, time constraints, workload, lack of vacation for education, and numerous work shifts were the indicators of inadequate staffing in organizations, which had a negative impact on participation in continuing education (17, 27). Financial constraints and costs of courses were yet other barriers limiting training among nurses (28). A lack of organizational support was also a major barrier to nurses’ continuation of education (29). Studies showed that electronic learning might overcome some of these barriers and, consequently, be effective in enhancing learning among nurses (30). Nevertheless, organizational support is required to deal with barriers to continuing education among nurses (29).

In the current study, a lack of physical space and overcrowding were observed as some of the other organizational obstacles to training nurses. Shahhosseini and Hamzehgardeshi et al. (27) revealed that other structural barriers, such as geographical distance from sites of continuous education, might limit education. Moreover, in some cases, specialized continuous educational programs were limited or not available (31). Generally, emergency nurses are exposed to high workloads, a lack of nursing staff, and many work shifts as organizational barriers, which can lead to exhaustion and burnout (32). On the other hand, the lack of education might affect nurse-patient communication (33).

Exhaustion and family obligations were also mentioned by Baxter et al. (17) as personal barriers to continuing education. Another study indicated that non-participation in education was associated with lower occupational satisfaction (28). In the current investigation, personal factors, such as exhaustion, low self-confidence to participate, and embarrassment for asking questions in classes, were perceived by the nurses as barriers to participation in continuous education, which are consistent with the findings of previous studies.

Another finding of the present study was related to strategies to meet educational needs. This theme consisted of some categories, including the participation of nurses in physicians’ clinical rounds, using monitoring, evaluation, and feedback system, developing the required infrastructure for using mobile health applications, and using mobile-based specialized educational health applications. Studying nurses’ experiences showed that participation in the physicians’ clinical rounds at the bedside contributed to information exchange between the physician and the nurse and enhanced the motivation for learning. Alcantara found that structured and standardized multidisciplinary rounds had the potential to change bedside care and led to an accurate, timely, and more integrated patient care process, thereby resulting in the increased quality of patient care, positive patient experiences of received care, and reduced costs (34).

Based on the experience of participants, monitoring, evaluation, and feedback by head nurses and nursing managers could facilitate the elimination of personnel’s educational needs. The results of another study showed that head nurses could play a potential, dynamic, and strong facilitating role in training clinical nurses with insufficient knowledge and skills (11). The results of another study demonstrated that nursing managers spent little time on nurses’ direct training; however, it is one of their traditional tasks. The evidence in this study demonstrated that nursing managers are not directly engaged in the daily training of nurses, and they should also assess the individual learning needs of clinical staff. Their major role is to guide and facilitate nurses’ learning by changing the processes and encouraging the professional development of individuals. It is also emphasized that training should focus on the role of nursing managers as mentors and preceptors (35). The results of another study on the strengthening supervision during clinical practice model indicated that strengthening the supervision of hospital ward supervisors in practice led to the acquisition of cognitive and clinical skills, self-confidence, autonomy, and a greater ability to reason in many nursing students (20).

Developing the infrastructure and using mobile-based specialized educational health applications was another proposed strategy to meet the educational needs of nurses, especially younger nurses. Generally, mobile applications have been observed to be effective in continuing learning among nurses (36). Another study demonstrated that educational managers should adapt to new technology changes and focus on the benefits of mobile devices as an educational tool to effectively teach theoretical topics and practical skills (37). Overall, creating a global infrastructure for mobile medical applications is essential to provide “common standards and guidelines” and has been proposed as a repository for shared resources and best practices (30).

In the present study, the nurses believed that mobile applications should be scientific, easy to use, applicable on all smartphones, and free for all nurses. Nikpeyma et al. showed that one of the features of mobile-based educational programs was the possibility of updating the applications installed on mobile devices. This means that some nursing training programs, care plans, or/and clinical guidelines can be updated, and students can have access to the newest and most up-to-date information (37). In the nursing profession, the potential capabilities of mobile health can be used for both patient care and the education of clinical nurses. In other words, mobile health has considerable potential for both education and practice (38). Moreover, other studies have indicated that mobile-based education can have financial benefits since it is a shared resource, and individuals do not need to travel or ask for days off to participate in classes (36).

The outbreak of COVID-19 has made all aspects of nursing education challenging (39, 40). In this regard, online education (40) and mobile health-based learning have been mentioned as a solution to reduce challenges and make education flexible and innovative. Training regarding COVID-19 has been proposed by interviewees as an emergency need for nurses. Moreover, mobile health-based applications facilitate service provision by healthcare providers during epidemics and pandemics when healthcare centers and hospitals face critical conditions and increased workloads (41). In this respect, clinical and para-clinical skills, clinical procedures, and mental skills have been needed training explained by emergency nurses. Nonetheless, nurses’ educational needs and clinical information have been changing rapidly (42). Therefore, to prevent substandard care, the information provided through mobile applications must be updated, and evidence-based information must be provided for continuing learning (43). The ubiquity of mobile health increases the possibility of education among staff nurses (44) and subsequently improves their basic and advanced skills, eventually exerting a great impact on the quality of care, self-efficacy, and occupational satisfaction (45).

Although mobile-based education lacks discussion during training on specialized courses (46), using mobile health as a learning assistant can have positive effects on the improvement of nurses’ specialized clinical knowledge, especially in terms of tests interpretation (47), and increase their tendency to complete courses and participate in future training (46). In this study, two participants mentioned impaired concentration while working as the negative consequence of using mobile health. In a systematic review of the impact of mobile technology on teamwork and communication in hospitals, it was revealed that the small screen size of mobile phones, the cost of buying smartphones in developing countries, the short life of mobile batteries, disturbance of other colleagues, and interruptions by coworkers or family members were reported as the negative impacts of mobile use in the healthcare settings (48). However, considering the progress in health technologies, ensuring patient safety, and supporting innovation in development, using mobile health and medical applications is essential (49).

5.1. Implications for Practice

The findings of this study can help hospital and nursing managers to pay more attention to the educational needs of hospital emergency nurses while noticing barriers and challenges. Considering the high workload and lack of time for emergency nurses, the implementation of innovative strategies to meet educational needs, such as using mobile-based educational applications while being available, can lead to increasing nurses’ knowledge and dealing with challenges. In turn, by providing nurses’ educational needs, the improvement of quality of services, positive outcomes for patients, and nurses’ increased satisfaction will be expected.

5.2. Limitations and Recommendations

The most important limitation of this study was the emergency nurses’ restricted time to participate in the interviews. The nurses’ high workload and numerous tasks made the data collection phase too long. Another study limitation was related to the low generalizability of the results due to the nature of the qualitative design of this study. Furthermore, due to the COVID-19 pandemic that caused the emergency department to become crowded, four nurses were not interviewed in a face-to-face manner. As a recommendation, it is proposed to carry out similar studies on nurses who occupy other parts of hospitals and perform interventional and cost-benefit studies on using mobile-based educational and consultation applications.

5.3. Conclusions

The emergency department nurses’ perceived needs were categorized into three themes, including the need for comprehensive and continuous education, the challenges against the management of training needs, and strategies to meet training needs. Furthermore, it is required to test the advantage and disadvantages of technologies, especially mobile health applications, which are used for the education of nurses.

Acknowledgements

References

  • 1.

    McHugh C, Krinsky R, Sharma R. Innovations in Emergency Nursing: Transforming Emergency Care Through a Novel Nurse-Driven ED Telehealth Express Care Service. J Emerg Nurs. 2018;44(5):472-7. [PubMed ID: 29631785]. https://doi.org/10.1016/j.jen.2018.03.001.

  • 2.

    Wang H, Robinson RD, Bunch K, Huggins CA, Watson K, Jayswal RD, et al. The inaccuracy of determining overcrowding status by using the national ED overcrowding study tool. Am J Emerg Med. 2014;32(10):1230-6. [PubMed ID: 25176566]. https://doi.org/10.1016/j.ajem.2014.07.032.

  • 3.

    Woo BFY, Lee JXY, Tam WWS. The impact of the advanced practice nursing role on quality of care, clinical outcomes, patient satisfaction, and cost in the emergency and critical care settings: a systematic review. Hum Resour Health. 2017;15(1):1-22. [PubMed ID: 28893270]. [PubMed Central ID: PMC5594520]. https://doi.org/10.1186/s12960-017-0237-9.

  • 4.

    Jennings N, McKeown E, O'Reilly G, Gardner G. Evaluating patient presentations for care delivered by emergency nurse practitioners: a retrospective analysis of 12 months. Australas Emerg Nurs J. 2013;16(3):89-95. [PubMed ID: 23953091]. https://doi.org/10.1016/j.aenj.2013.05.005.

  • 5.

    Dulandas R, Brysiewicz P. A description of the self-perceived educational needs of emergency nurses in Durban, KwaZulu-Natal, South Africa. Afr J Emerg Med. 2018;8(3):84-8. [PubMed ID: 30456154]. [PubMed Central ID: PMC6223605]. https://doi.org/10.1016/j.afjem.2018.03.001.

  • 6.

    Ashton RA, Morris L, Smith I. A qualitative meta-synthesis of emergency department staff experiences of violence and aggression. Int Emerg Nurs. 2018;39:13-9. [PubMed ID: 29326038]. https://doi.org/10.1016/j.ienj.2017.12.004.

  • 7.

    Tyer-Viola LA, Timmreck E, Bhavani G. Implementation of a continuing education model for nurses in Bangladesh. J Contin Educ Nurs. 2013;44(10):470-6. [PubMed ID: 23964673]. https://doi.org/10.3928/00220124-20130816-07.

  • 8.

    Rominski S, Bell SA, Yeboah D, Sarna K, Hartney H, Oteng R. Skills and educational needs of accident and emergency nurses in Ghana: an initial needs analysis. Afr J Emerg Med. 2011;1(3):119-25. [PubMed ID: 29276670]. [PubMed Central ID: PMC5739334]. https://doi.org/10.1016/j.afjem.2011.08.004.

  • 9.

    Jho MY, Kang Y. Perceptions of Continuing Nursing Education in Korea. J Contin Educ Nurs. 2016;47(12):566-72. [PubMed ID: 27893920]. https://doi.org/10.3928/00220124-20161115-10.

  • 10.

    Pilcher J. Learning Needs Assessment: Not Only for Continuing Education. J Nurses Prof Dev. 2016;32(4):185-91. [PubMed ID: 27434315]. https://doi.org/10.1097/NND.0000000000000245.

  • 11.

    Wolf L, Perhats C, Delao A, Burchill CN, Clark P, Callihan M, et al. Role and Training of Emergency Department Charge Nurses: A Mixed Methods Analysis of Processes, Needs, and Expectations. J Emerg Nurs. 2022;48(4):390-405. [PubMed ID: 35660060]. https://doi.org/10.1016/j.jen.2022.03.009.

  • 12.

    Speziale HS, Streubert HJ, Carpenter DR. Qualitative research in nursing: Advancing the humanistic imperative. Lippincott Williams & Wilkins; 2011.

  • 13.

    Elo S, Kääriäinen M, Kanste O, Pölkki T, Utriainen K, Kyngäs H. Qualitative Content Analysis. SAGE Open. 2014;4(1):215824401452263. https://doi.org/10.1177/2158244014522633.

  • 14.

    Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105-12. [PubMed ID: 14769454]. https://doi.org/10.1016/j.nedt.2003.10.001.

  • 15.

    Lincoln YS, Guba EG, Pilotta JJ. Naturalistic inquiry. Int J Intercult Relat. 1985;9(4):438-9. https://doi.org/10.1016/0147-1767(85)90062-8.

  • 16.

    Farahmand Rad R, Sadrabad AZ, Nouraei R, Khatony A, Bashiri H, Bozorgomid A, et al. Comparative study of virtual and face-to-face training methods on the quality of healthcare services provided by Kermanshah pre-hospital emergency staff (EMS): randomized educational Intervention trial. BMC Med Educ. 2022;22(1):203. [PubMed ID: 35337312]. [PubMed Central ID: PMC8957122]. https://doi.org/10.1186/s12909-022-03277-y.

  • 17.

    Baxter P, DiCenso A, Donald F, Martin-Misener R, Opsteen J, Chambers T. Continuing education for primary health care nurse practitioners in Ontario, Canada. Nurse Educ Today. 2013;33(4):353-7. [PubMed ID: 22889580]. https://doi.org/10.1016/j.nedt.2012.07.018.

  • 18.

    Oh SI, Han SS. [A study on the sustainable effects of reeducation on cardiopulmonary resuscitation on nurses' knowledge and skills]. Taehan Kanho Hakhoe Chi. 2008;38(3):383-92. Korean. [PubMed ID: 18604147]. https://doi.org/10.4040/jkan.2008.38.3.383.

  • 19.

    Aiken LH, Cimiotti JP, Sloane DM, Smith HL, Flynn L, Neff DF. Effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments. J Nurs Adm. 2012;42(10 Suppl):S10-6. [PubMed ID: 22976889]. [PubMed Central ID: PMC6764437]. https://doi.org/10.1097/01.NNA.0000420390.87789.67.

  • 20.

    Sykepleier SSN, Engelien RI, Johansson IS. Veiledningsmodell for sykepleierstudenter i sykehjem — en evalueringsstudie. Nord J Nurs Res. 2008;28(3):42-5. https://doi.org/10.1177/010740830802800310.

  • 21.

    Lee M, Lee H, Jo M. A study on the effects of retraining of core nursing skills: Focused on senior-year nursing students. Ann Romanian Soc Cell Biol. 2021:831-6.

  • 22.

    Flowerdew L, Brown R, Russ S, Vincent C, Woloshynowych M. Teams under pressure in the emergency department: an interview study. Emerg Med J. 2012;29(12). e2. [PubMed ID: 22186010]. https://doi.org/10.1136/emermed-2011-200084.

  • 23.

    Pedersen AHM, Rasmussen K, Grytnes R, Nielsen KJ. Collaboration and patient safety at an emergency department - a qualitative case study. J Health Organ Manag. 2018;32(1):25-38. [PubMed ID: 29508665]. https://doi.org/10.1108/JHOM-09-2016-0174.

  • 24.

    Boeira ER, Souza A, Pereira MS, Vila V, Tipple AFV. Infection control and patient safety measures addressed in nursing pedagogical projects. Rev Esc Enferm USP. 2019;53. e03420. [PubMed ID: 30726337]. https://doi.org/10.1590/S1980-220X2017042303420.

  • 25.

    Salvatierra GG, Bindler RC, Daratha KB. Rapid Response Teams: Is it Time to Reframe the Questions of Rapid Response Team Measurement? J Nurs Scholarsh. 2016;48(6):616-23. [PubMed ID: 27668841]. https://doi.org/10.1111/jnu.12252.

  • 26.

    Jones F, Podila P, Powers C. Creating a culture of safety in the emergency department: the value of teamwork training. J Nurs Adm. 2013;43(4):194-200. [PubMed ID: 23528684]. https://doi.org/10.1097/NNA.0b013e31828958cd.

  • 27.

    Shahhosseini Z, Hamzehgardeshi Z. The facilitators and barriers to nurses' participation in continuing education programs: a mixed method explanatory sequential study. Glob J Health Sci. 2014;7(3):184-93. [PubMed ID: 25948439]. [PubMed Central ID: PMC4802097]. https://doi.org/10.5539/gjhs.v7n3p184.

  • 28.

    Penz K, D'Arcy C, Stewart N, Kosteniuk J, Morgan D, Smith B. Barriers to participation in continuing education activities among rural and remote nurses. J Contin Educ Nurs. 2007;38(2):58-66. quiz 67-8, 93. [PubMed ID: 17402377]. https://doi.org/10.3928/00220124-20070301-03.

  • 29.

    Chong MC, Francis K, Cooper S, Abdullah KL, Hmwe NT, Sohod S. Access to, interest in and attitude toward e-learning for continuous education among Malaysian nurses. Nurse Educ Today. 2016;36:370-4. [PubMed ID: 26455411]. https://doi.org/10.1016/j.nedt.2015.09.011.

  • 30.

    Badiei M, Gharib M, Zolfaghari M, Mojtahedzadeh R. Comparing nurses' knowledge retention following electronic continuous education and educational booklet: a controlled trial study. Med J Islam Repub Iran. 2016;30:364. [PubMed ID: 27493908]. [PubMed Central ID: PMC4972056].

  • 31.

    Kahsay DT, Pitkajarvi M. Emergency nurses knowledge, attitude and perceived barriers regarding pain Management in Resource-Limited Settings: cross-sectional study. BMC Nurs. 2019;18:56. [PubMed ID: 31832015]. [PubMed Central ID: PMC6873521]. https://doi.org/10.1186/s12912-019-0380-9.

  • 32.

    Moukarzel A, Michelet P, Durand AC, Sebbane M, Bourgeois S, Markarian T, et al. Burnout Syndrome among Emergency Department Staff: Prevalence and Associated Factors. Biomed Res Int. 2019;2019:6462472. [PubMed ID: 30800675]. [PubMed Central ID: PMC6360614]. https://doi.org/10.1155/2019/6462472.

  • 33.

    Al-Kalaldeh M, Amro N, Qtait M, Alwawi A. Barriers to effective nurse-patient communication in the emergency department. Emerg Nurse. 2020;28(3):29-35. [PubMed ID: 32285654]. https://doi.org/10.7748/en.2020.e1969.

  • 34.

    Alcantara A. MDR matters! Improving primary nurse participation in multidisciplinary rounds. University of San Francisco; 2018.

  • 35.

    Duffield C, Wood LM, Franks H, Brisley P. The role of nursing unit managers in educating nurses. Contemp Nurse. 2001;10(3-4):244-50. [PubMed ID: 11855119]. https://doi.org/10.5172/conu.10.3-4.244.

  • 36.

    Smith SD, Thompson CE, Sims S. Adapting a Nurse-Managed Mobile Simulation Program to Meet Rural Health Nursing Continuing Education Needs. J Contin Educ Nurs. 2020;51(2):82-6. [PubMed ID: 31978246]. https://doi.org/10.3928/00220124-20200115-07.

  • 37.

    Nikpeyma N, Zolfaghari M, Mohammadi A. Barriers and facilitators of using mobile devices as an educational tool by nursing students: a qualitative research. BMC Nurs. 2021;20(1):1-11. [PubMed ID: 34753476]. [PubMed Central ID: PMC8579623]. https://doi.org/10.1186/s12912-021-00750-9.

  • 38.

    Doswell WM, Braxter B, DeVito Dabbs A, Nilsen W, Klem ML. mHealth: Technology for nursing practice, education, and research. J Nurs Educ Pract. 2013;3(10). https://doi.org/10.5430/jnep.v3n10p99.

  • 39.

    Galibourg A, Peters OA, Diemer F, Nasr K, Maret D. Continuing endodontic education and COVID-19: before, during and after? Int Endod J. 2020;53(11):1598-9. [PubMed ID: 32779736]. [PubMed Central ID: PMC7405148]. https://doi.org/10.1111/iej.13368.

  • 40.

    Vital Wave Consulting. mHealth for development: the opportunity of mobile technology for healthcare in the developing world. Washington Dc, USA: UN Foundation; 2009.

  • 41.

    Pai RR, Alathur S. Mobile health intervention and COVID-19 pandemic outbreak: insights from Indian context. Int J Health Gov. 2020;26(1):42-50. https://doi.org/10.1108/ijhg-04-2020-0043.

  • 42.

    Kvas A, Seljak J. Continuing education and self-assessment of knowledge of nurse leaders. J Contin Educ Nurs. 2013;44(8):342-9. quiz 350-1. [PubMed ID: 23758069]. https://doi.org/10.3928/00220124-20130603-07.

  • 43.

    Phillippi JC, Wyatt TH. Smartphones in nursing education. Comput Inform Nurs. 2011;29(8):449-54. [PubMed ID: 21107240]. https://doi.org/10.1097/NCN.0b013e3181fc411f.

  • 44.

    Scott KM, Baur L, Barrett J. Evidence-Based Principles for Using Technology-Enhanced Learning in the Continuing Professional Development of Health Professionals. J Contin Educ Health Prof. 2017;37(1):61-6. [PubMed ID: 28252469]. https://doi.org/10.1097/CEH.0000000000000146.

  • 45.

    Xu J, Qian X, Yuan M, Wang C. Effects of mobile phone App-based continuing nursing care on self-efficacy, quality of life, and motor function of stroke patients in the community. Acta Neurol Belg. 2023;123(1):1-8. [PubMed ID: 33728581]. https://doi.org/10.1007/s13760-021-01628-y.

  • 46.

    Liu X, Cheng J, Huang S. Mobile Phone Training Platform for the Nursing Staff in the Emergency Department. Telemed J E Health. 2019;25(1):66-70. [PubMed ID: 29742034]. https://doi.org/10.1089/tmj.2017.0317.

  • 47.

    Baccin CRA, Dal Sasso GTM, Paixao CA, de Sousa PAF. Mobile Application as a Learning Aid for Nurses and Nursing Students to Identify and Care for Stroke Patients: Pretest and Posttest Results. Comput Inform Nurs. 2020;38(7):358-66. [PubMed ID: 32427611]. https://doi.org/10.1097/CIN.0000000000000623.

  • 48.

    Martin G, Khajuria A, Arora S, King D, Ashrafian H, Darzi A. The impact of mobile technology on teamwork and communication in hospitals: a systematic review. J Am Med Inform Assoc. 2019;26(4):339-55. [PubMed ID: 30689893]. [PubMed Central ID: PMC7647195]. https://doi.org/10.1093/jamia/ocy175.

  • 49.

    Barton AJ. The regulation of mobile health applications. BMC Med. 2012;10:1-4. [PubMed ID: 22569114]. [PubMed Central ID: PMC3364852]. https://doi.org/10.1186/1741-7015-10-46.