Comparative Study of Evaluating the Clinical Competence of Emergency Nurses Using Self-assessments and Assessment by Head Nurses

authors:

avatar Motahareh Musavi Ghahfarokhi ORCID 1 , * , avatar Elina Mehrafruz 2 , avatar Arman Radmehr 3 , avatar Maryam Kiarsi ORCID 2 , avatar Marzieh Beigom Bigdeli Shamloo ORCID 2

MCS, RN, Department of Nursing, Abadan University of Medical Sciences, Abadan, Iran
M.Sc. of Nursing, Dezful University of Medical Sciences, Dezful, Iran
M.Sc. of Management, Dezful University of Medical Sciences, Dezful, Iran

how to cite: Musavi Ghahfarokhi M, Mehrafruz E , Radmehr A, Kiarsi M, Beigom Bigdeli Shamloo M. Comparative Study of Evaluating the Clinical Competence of Emergency Nurses Using Self-assessments and Assessment by Head Nurses. J Adv Immunopharmacol. 2021;1(2):e115391. https://doi.org/10.5812/tms.115391.

Abstract

Background:

Clinical competency is the ability of nurses to play a professional role in a clinical environment, in terms of the quality of the services provided.

Objectives:

The present study aimed to compare the clinical competence of emergency department nurses using self-assessments and evaluations by head nurses.

Methods:

A descriptive-analytical study was conducted from July to September 2019. The census method was used to select 70 nurses working in the emergency departments of three hospitals. Data was collected by using self-assessment questionnaires and evaluations by head nurses. The instrument was a clinical competency questionnaire with questions related to seven functional fields and 73 skills.

Results:

The viewpoints of nurses and head nurses on the clinical competencies of nurses were assessed at a moderate level in the majority of domains. Nurses defined their clinical competencies at a significantly higher level than the head nurses (P < 0.05).

Conclusions:

Based on the results, it is assumed that using more than one method and simultaneously applying multiple methods in an assessment will provide more accurate results about nurses’ clinical competence.

1. Background

Healthcare providers, as the most important element of the healthcare system, are directly responsible for the maintenance and the promotion of health in human society (1). Nurses are important members of healthcare provision teams and comprise the most significant proportion of hospital staff (2). Nursing is a professional activity, given the multiplicity and complexity of the role, which requires a sense of responsibility, tact, accuracy. Any lack or inadequacy of clinical skills or professional ethics training will certainly have a significant impact on the quality and quantity of health services (3).

Nursing competency is the complex integration of knowledge that includes professional judgments, skills, values, and attitudes. It involves an ingenious, practical skill set that combines different factors and issues in complex ways that are specific to each circumstance (3). Various factors, such as rapid changes in health monitoring systems and increase society’s expectations of receiving high-quality services has caused special attention to be given to the adaptability and clinical competency of people working in health-related professions (4).

The role of nursing instructors in terms of theoretical teaching, clinical experience, professional growth, and the quality assurance of nursing care are among the factors that influence nursing professionalism (5). Therefore, it is important to ensure the clinical competency of nurses (6). Self-assessments are used extensively in educational programs that have adopted a problem-based, self-directed approach. Professionals, such as nurses, require self-regulation to maintain their professional competence. Nurses need to develop self-assessment skills to determine their level of knowledge and identify knowledge gaps, as doing so helps them remain competent and safe in their practice (7). On one hand, head nurses are competent professionals who need management skills because they are working in close contact with patients and health care groups. Therefore, they are responsible for assessing and supervising the providers of direct patient care in a clinical department, and for creating a supportive environment for professional practice (8). Flott and Lindon (2016) considered the role of the environment as one of the indicators affecting clinical competence, emphasized the difference between the degree of clinical competence and the frequency of using skills in different departments and hospitals (8). Hassankhani et al. (2018) indicated that nurses in the emergency department have a lower perceived level of competence for performing the skills within the domains of effective management of rapidly changing situations and administering and monitoring therapeutic interventions (9).

2. Objectives

The lack of high-quality studies on nurses’ clinical competency criteria in emergency departments, especially in Iran has motivated this study. The present study aimed to compare the clinical competence of evaluating emergency nurses using self-assessments and assessment by head nurses.

3. Methods

In this descriptive-analytical study, all staff nurses working in emergency departments of three hospitals affiliated to Dezful University of Medical Sciences, were studied from July to September 2019. Generally, from 90 nurses working in emergency department, 70 nurses were selected using census method based on entrance conditions. The inclusion criteria for the study were as follows: (1) providing written consent; (2) having a bachelor’s or master’s degree in nursing and having at least two years of work experience in emergency.

The research environment was the emergency departments of hospitals including Dezful (Ganjaviyan), Gotvand (Karun), and Shoush (Nezam-Mafi). After obtaining of permission from the Ethics Committee, we coordinated with nursing directors to prepare a list of permanent nurses in their department. Nurses from all emergency departments in each hospital who fulfilled the inclusion criteria were included in the study. In the next step, two supervisors from nursing faculties held an introduction meeting for participants to explain the study’s objectives, ensure the confidentiality of personal information and obtain written informed consent.

After the anonymous questionnaires were distributed among the nurses, the questionnaires were sent to head nurses. The participants were given one week to fill out and return the questionnaires. If the questionnaire was not returned after the specified period, the subject was excluded from the study. Also, questionnaires were coded and given to the head nurses. They were asked to complete them under their supervision during one week.

The data collection tool was a two-part questionnaire. The first part was related to respondents’ demographic information, such as their age, gender, degree, marital status, field of study, employment status, work experience in an emergency department. The second part of the questionnaire was a nurse competence scale (NCS), which assessed the nurses’ clinical competency. The NCS is based on Benner’s theory as provided by Meretoja et al. (2004) and consists of 73 items that measure nurses’ self-perceived competence in seven categories. These categories include the fields of patient support and assistance (7 skills), education and guidance (16 skills), diagnostic actions (7 skills), managing clinical situations (8 skills), therapeutic measures (10 skills), quality assurance (6 skills), and occupational and organizational tasks (19 skills) (10).

Self-perceived competence was measured through a visual analog scale (from 0 - 100, with 0 being a very low level of competence and 100 being a very high level of competence). Frequency of use was measured through a 4-point Likert-type scale (0 = not applicable in my work, 1 = used very seldom, 2 = used occasionally, 3 = used very often in my work). The original NCS methodology breaks the self-assessed level of competence into four overlapping integer groups: 0 to 25 is low, 25 to 50 is quite good, 50 to 75 is good, and 75 to 100 is very good.

The reliability of this tool was estimated by Meretoja et al. (2004) as having a Cronbach’s alpha of 0.79 to 0.99. Furthermore, its internal consistency was reported as being between 0.79 and 0.91 (10). To compensate for the nurse's lack of English language knowledge, we used a translated form of the questionnaire. In a pilot study, the questionnaires were distributed among 30 nurses. The reliability of the translated questionnaire was between 0.70 and 0.85 in all seven areas, which is an acceptable level. This questionnaire was distributed to 11 members of the nursing faculty which confirmed its content validity. The tool’s reliability was calculated using Cronbach’s alpha. Likewise, the questionnaire was distributed among 30 nurses, and its reliability was calculated as 0.96.

In this study, each nurse was asked to identify their level of competence on a visual analogue scale (VAS) (0 - 100), on which values 0 - 25, 26 - 50, 51 - 75, and 76 - 100 represent weak, moderate, good, and excellent levels of competence, respectively. Moreover, nurses’ clinical competence was ranked in four levels based on the frequency of actual use in clinical practice (0  =  not applicable in my work, 1  =  used very seldom, 2  =  used occasionally, 3  =  used very often in my work).

3.1. Data Analysis

The data were analyzed using SPSS software version 16. Additionally, the descriptive statistics including frequency, mean, and standard deviation were used to describe the demographic characteristics of the subjects and evaluate the clinical competencies. Furthermore, the inferential statistics including independent t-test was employed to compare clinical competency by self-assessment and assessment by the head nurse.

4. Results

Majority of the nurses were female, under 30 years old, single, Bachelor's degree, work experience of more than 5 years (Table 1).

Table 1.

Sociodemographic Characteristics of Nurses

VariablesFrequency%
Sex
Female5578.6
Male1521.4
Age
< 304767.1
30 - 392028.6
40 - 4934.3
Marital status
Married3448.6
Single3651.4
Work place
Dezful3347.1
Gotvand2028.6
Shoush1724.3
Education level
Bachelor6288.6
Master811.4
Work experience in ER (y)
< 55274.3
5 - 101420.0
> 1045.7

The level of using the skills in clinical practice determined the minimum of nurses in field of quality assurance and maximum of nurses in field of occupational tasks in self– assessment and minimum of nurses in field of patient support and assistant and maximum of them in field of education and guides (Table 2).

Table 2.

The Assessment Level of Nurses’ Clinical Competency Using Self-assessment and Assessment by Head Nurses a

Clinical Competencies AreasNurse's Self-assessmentAssessment by Head Nurses
Patient support and assistance
Used very seldom17 (24.3)31 (44.3)
Used occasionally50 (71.4)36 (51.4)
used very often3 (4.3)3 (4.3)
Education and guidance
Used very seldom8 (11.4)5 (7.1)
Used occasionally49 (70.0)57 (81.4)
used very often13 (18.6)8 (11.4)
Diagnostic measures
Used very seldom1 (1.4)3 (4.3)
Used occasionally29 (41.4)41 (58.6)
used very often40 (57.1)26 (37.1)
managing clinical situations
Used very seldom1 (1.4)2 (2.9)
Used occasionally30 (42.9)40 (57.1)
used very often39 (55.7)28 (40.0)
Therapeutic measures
Used very seldom2 (2.9)5 (7.1)
Used occasionally48 (68.6)51 (72.9)
used very often20 (28.6)14 (20.0)
Quality assurance
Used very seldom32 (45.7)27 (38.6)
Used occasionally35 (50.0)42 (60.0)
used very often3 (4.38)1 (1.48)
Occupational tasks
Used very seldom9 (12.9)12 (17.1)
Used occasionally51 (72.9)51 (72.9)
used very often10 (14.3)7 (10.0)
Total clinical competencies
Used very seldom2 (2.9)3 (4.3)
Used occasionally58 (82.9)62 (88.6)
used very often10 (14.3)5 (7.1)

The overall mean competence obtained in self–assessment was significantly greater than that calculated by head nurse assessment (P < 0.05). The nurses considered themselves more competent in the categories of occupational tasks. While the head nurses considered them to be more competent in the categories of education and guides (Table 3).

Table 3.

The Comparison of the Mean Score of Nurses Clinical Competency with Two Methods of Self-assessment and Assessment Performed by Head Nurses

Competency AreaNursesHead NursesSignificance
Patient support and assistance7.70 ± 1.896.39 ± 2.140.016
Education and guidance25.14 ± 7.1323.57 ± 5.830.43
Diagnostic measures14.25 ± 3.4011.66 ± 3.380.08
Managing clinical situations16.55 ± 3.9012.60 ± 3.260.001
Therapeutic measures18.30 ± 4.8115.96 ± 4.390.12
Quality assurance6.04 ± 2.596.30 ± 1.720.69
Occupational tasks28.85 ± 8.1122.66 ± 6.700.046
The average mean score for the total competencies116.85 ± 26.5299.18 ± 21.980.001

Pearson correlation test indicated direct relationship between the clinical competence of nurses with age, level of education, and work experience in the emergency department (Table 4).

Table 4.

The Relationship Between Clinical Competence of Nurses with Demographic Characteristics in Self-assessment Method

Demographic VariablesNurses’ Clinical Competence
rSignificance
Gender0.040.73
Age0.2450.034
Marital status0.0840.47
Education level0.2420.042
Work experience in emergency0.3040.008
Employment status0.1560.18

5. Discussion

The present study compared nurses’ clinical competency via self-assessments and assessments performed by head nurses in the emergency departments of hospitals affiliated with Dezfoul University of Medical Sciences. The results indicated that the nurses of emergency departments assess their clinical competence at a significantly higher level than their head nurses in the categories of patient support and assistance, diagnostic measures, managing clinical situations, and occupational tasks.

The Flott and Lindon (2016) suggest that people tend to give themselves higher scores than others do when assessing their performance (8). The present study is not an exception to this rule, as the nurses estimated their clinical competency rating as being higher than the estimations given by head nurses. Similarly, in the studies of Mahdavisaeb et al. (2016) and Kajander-Unkuri et al. (2016), nurses assigned higher scores to their clinical competencies than their managers and mentors did (11, 12). Contrary to these studies, Adib Hajbaghery and Eshraghi Arani (2018) showed that the clinical competence scores given by head nurses were higher than those given by the nurses themselves. In this regard, low expectation of head nurses related to nurses as well as supporting their nurses is recommended (13).

In the present study, most nurses assessed their clinical competence as being at a good level in the category of diagnostic measures. Meanwhile, for managing clinical situations, support and assistance, education and guidance, therapeutic measures, and occupational tasks, most nurses scored themselves at a moderate level. Finally, most nurses scored themselves within the weak level in the field of quality assurance.

Hassankhani et al. (2018) found that the overall competency of emergency nurses indicated a good level of perceived competence (9). Valdez-Delgado et al. (2019) have suggested that higher competency levels in nurses in terms of management; decision making; and continuity of care, education, and cultural sensitivity, are related to shorter waiting times for patients (14). Factors related to the work environment and the use of problem-solving skills in critical situations could result in the improvement of managerial capabilities and diagnostic measures among nurses in emergency departments (15).

The lowest self-assessment score obtained was related to the quality assurance field. These findings are similar to the results presented by Faraji et al. (2019) (16). Thus, it is necessary to train nurses how to use new research findings in a clinical setting and to observe improvements among the nurses working in emergency departments because this matter is connected to the four areas of expertise (i.e., the use of clinical research, the assessment of patient care, the use of research findings in nursing care, and the ability to identify areas related to care), all of which need to be upgraded and evaluated (17).

From the head nurses’ perspectives, the highest clinical competence is related to the management of clinical situations, while the lowest competencies are related to support and assistance and quality assurance. In terms of managing clinical situations, the results presented here are consistent with those of Mahdavisaeb (2016) (11). This contradiction in our study may be due to the novice nurses’ low levels of experience from the head nurses’ perspective. On the other hand, head nurses assessed the field of support and assistance as being at a low level in comparison to the nurses’ self-assessments. Oppositely, Mahdavisaeb et al. (2016) found that the field of support and assistance had the highest level of agreement between self-assessments and the head nurses’ assessments (11).

Based on the results, significant relationships were observed between the mean self-assessment of nurses with age, education level, and work experience in an emergency department.

Although Karami et al. (4) found no significant relationship between the mean self-assessment of nurses with marital status and education level, their results indicate that the mean score of the professional competency of married nurses was higher than that of single nurses. Regarding this matter, professional promotion and nursing competency appear to be affected by personal, socio-economic, and cultural factors (18). Limited experience in the emergency department, the young age of the majority of nurses, and insufficient experience in dealing with the patients are among the reasons for lower competency from the head nurses’ perspective.

5.1. Limitations

Some limitations of the present study are related to the low reliability of self-evaluation methods, as this kind of evaluation can be affected by the specific characteristics of individual evaluators. Furthermore, nurses’ awareness that they would be assessed by head nurses might have changed their behavior during the study period. Therefore, indirect assessment methods should be used in future studies. Due to the influences of various external and internal factors (e.g., the special conditions of emergency departments), the findings of our study cannot be generalized to other contexts. Finally, the sample size was small in order to our study was limited to emergency departments.

5.2. Conclusion

The clinical competencies of nurses were evaluated as being at a moderate level in most areas based on nurses’ and head nurses’ assessments. It is assumed that using more than one method and simultaneously applying multiple methods in an assessment will provide more accurate results about nurses’ clinical competence. However, self-assessments lead to more awareness and attention among nurses about their own clinical competencies. In addition, the assessments by head nurses make nurses more aware of their weaknesses and strengths in different areas of clinical competence from the head nurses viewpoints. Hence, they will try to improve weaknesses in their professional competencies.

References

  • 1.

    Poursadeqiyan M, Arefi MF, Khaleghi S, Moghaddam AS, Mazloumi E, Raei M, et al. Investigation of the relationship between the safety climate and occupational fatigue among the nurses of educational hospitals in Zabol. J Educ Health Promot. 2020;9:238. [PubMed ID: 33209930]. [PubMed Central ID: PMC7652069]. https://doi.org/10.4103/jehp.jehp_309_20.

  • 2.

    Fukada M. Nursing competency: Definition, structure and development. Yonago Acta Med. 2018;61(1):1-7. [PubMed ID: 29599616]. [PubMed Central ID: PMC5871720].

  • 3.

    Farokhzadian J, Nayeri ND, Borhani F, Zare MR. Nurse leaders' attitudes, self-efficacy and training needs for implementing evidence-based practice: Is it time for a change toward safe care? Br J Med Med Res. 2015;7(8):662-71. [PubMed ID: 26877975]. [PubMed Central ID: PMC4751982]. https://doi.org/10.9734/BJMMR/2015/16487.

  • 4.

    Karami A, Farokhzadian J, Foroughameri G. Nurses' professional competency and organizational commitment: Is it important for human resource management? PLoS One. 2017;12(11). e0187863. [PubMed ID: 29117271]. [PubMed Central ID: PMC5678726]. https://doi.org/10.1371/journal.pone.0187863.

  • 5.

    Gunay U, Kilinc G. The transfer of theoretical knowledge to clinical practice by nursing students and the difficulties they experience: A qualitative study. Nurse Educ Today. 2018;65:81-6. [PubMed ID: 29547811]. https://doi.org/10.1016/j.nedt.2018.02.031.

  • 6.

    Kantanen K, Kaunonen M, Helminen M, Suominen T. Leadership and management competencies of head nurses and directors of nursing in Finnish social and health care. J Res Nurs. 2017;22(3):228-44. https://doi.org/10.1177/1744987117702692.

  • 7.

    Elhami S, Ban M, Mousaviasl S. Self-evaluation of nurses clinical competency based on benner theory. World Fam Med J/Middle East J Fam Med. 2018;16(3):186-92. https://doi.org/10.5742/mewfm.2018.93329.

  • 8.

    Flott EA, Linden L. The clinical learning environment in nursing education: A concept analysis. J Adv Nurs. 2016;72(3):501-13. [PubMed ID: 26648579]. https://doi.org/10.1111/jan.12861.

  • 9.

    Hassankhani H, Hasanzadeh F, Powers KA, Dadash Zadeh A, Rajaie R. Clinical skills performed by Iranian emergency nurses: Perceived competency levels and attitudes toward expanding professional roles. J Emerg Nurs. 2018;44(2):156-63. [PubMed ID: 28755762]. https://doi.org/10.1016/j.jen.2017.06.007.

  • 10.

    Meretoja R, Leino-Kilpi H, Kaira AM. Comparison of nurse competence in different hospital work environments. J Nurs Manag. 2004;12(5):329-36. [PubMed ID: 15315489]. https://doi.org/10.1111/j.1365-2834.2004.00422.x.

  • 11.

    Mahdavisaeb F, Roohani M, Hanifi N, Kamali K. [Comparison of critical care nurses'clinical competency using self-assessment method and assessment by head nurses, Zanjan 2014]. Prev Care Nurs Midwifery J. 2016;6(1):72-82. Persian.

  • 12.

    Kajander-Unkuri S, Leino-Kilpi H, Katajisto J, Meretoja R, Räisänen A, Saarikoski M, et al. Congruence between graduating nursing students’ self-assessments and mentors’ assessments of students’ nurse competence. Collegian. 2016;23(3):303-12. https://doi.org/10.1016/j.colegn.2015.06.002.

  • 13.

    Adib Hajbaghery M, Eshraghi Arani N. [Assessing nurses’ clinical competence from their own viewpoint and the viewpoint of head nurses: A descriptive study]. Iran J Nurs Res. 2018;31(111):52-64. Persian. https://doi.org/10.29252/ijn.31.111.52.

  • 14.

    Valdez-Delgado K, Barba M, Kulyen A, Colston P, Boyer S, Mann-Salinas E. 1002: Evolution of an evidence-based competency assessment program for specialty nursing. Crit Care Med. 2018;46(1):485. https://doi.org/10.1097/01.ccm.0000529009.61144.72.

  • 15.

    Abd El-Hay SA, El Mezayen SE, Ahmed RE. Effect of concept mapping on problem solving skills, competence in clinical setting and knowledge among undergraduate nursing students. J Nurs Educ Pract. 2018;8(8):34. https://doi.org/10.5430/jnep.v8n8p34.

  • 16.

    Faraji A, Karimi S, Ghobadi A, Abdi A. Evaluation of the clinical competency level among nurses working in Kermanshah University of Medical Sciences affiliated hospitals. Int J BioMed Public Health. 2019;2(1):1-7.

  • 17.

    Ramirez E, Schumann L, Agan D, Hoyt KS, Wilbeck J, Tyler D, et al. Beyond competencies: Practice standards for emergency nurse practitioners-A model for specialty care clinicians, educators, and employers. J Am Assoc Nurse Pract. 2018;30(10):570-8. [PubMed ID: 30320710]. https://doi.org/10.1097/JXX.0000000000000139.

  • 18.

    Mirlashari J, Qommi R, Nariman S, Bahrani N, Begjani J. Clinical competence and its related factors of nurses in neonatal intensive care units. J Caring Sci. 2016;5(4):317-24. [PubMed ID: 28032076]. [PubMed Central ID: PMC5187552]. https://doi.org/10.15171/jcs.2016.033.