Abstract
Background:
Because of the long duration of the coronavirus disease 2019 (COVID-19) pandemic, people may suffer greatly from the common burnout caused by this virus.Objectives:
Considering the psychological consequences of COVID-19, this study investigated the validity and reliability of the Persian version of the COVID-19 Burnout Scale (COVID-19-BS).Methods:
The Persian version of the COVID-19-BS was prepared through forward translation, reconciliation, and back-translation. The method of the study was descriptive (psychometric). The statistical population included all students of Ahvaz Jundishapur University of Medical Sciences, Iran, from October 2020 to November 2020. Using the convenience sampling method, 251 students were selected. All participants completed the COVID-19 Anxiety Syndrome Scale (C-19ASS), the Compassion Scale (CS), and the COVID-19-BS. Convergent validity, divergent validity, and confirmatory factor analysis (CFA) were used to evaluate the validity. Data analysis was performed using SPSS version 25 and LISREL 8.5 software.Results:
The findings supported the single-factor structure of COVID-19-BS and a good internal consistency of the scale. Internal consistency obtained by Cronbach’s alpha method for the total score of C-19ASS was 0.72, indicating a good internal consistency. The COVID-19-BS had a positive and significant correlation with the C-19ASS (P = 0.01, r = 0.37) and a negative and significant correlation with the CS (P = 0.01, r = -0.41), indicating the convergent and divergent validity of this scale (P <0.01).Conclusions:
The present psychometric study complements the cross-cultural literature of this instrument. The COVID-19-BS showed good validity and reliability, and it can be useful in assessing the burnout caused by COVID-19 in the Iranian population. This scale seems to be a useful and practical tool for assessing COVID-19 burnout in research and clinical settings.Keywords
1. Background
Coronavirus disease 2019 (COVID-19) has spread exponentially across all continents over several months (1). Due to high mortality and infection, COVID-19 can lead to numerous psychological problems, including depression, fear, stress, anxiety (2), and possibly burnout. Recent research has shown that people in quarantine experience a variety of psychological problems such as stress, fear, and failure (3). So far, there is uncertainty about when and how the pandemic might continue despite the facilities and ease of COVID-19 measures, including wearing a face mask in public places and maintaining social distance (4).
Therefore, the uncertainty associated with COVID-19 and the length of time we should stay home can make a considerable difference in our daily lives. Such alters in daily life caused by COVID-19 can increase the levels of stress, anxiety, burnout, fear, and failure (2, 5). Stressful living conditions have notable adverse effects on psychological functioning and mental health and lead to mental problems such as social deprivation, mental confusion, anxiety, and depression (2). Extreme stress can lead to a broad range of psychological and psychosocial problems, including emotional disorders, burnout, and anxiety. Understanding how people react in stressful situations such as COVID-19 pandemic can be helpful in creating and developing interventions (6).
On a broader level, burnout has been found to be associated with a wide range of mental health problems and well-being indicators, such as increased anxiety, memory impairment, alcohol consumption, depression, sleep problems, and neck and back pain (7). Burnout is defined as a state of extreme fatigue that results from hard, unmotivated, and uninteresting work. In one study, 14.9% of students had burnout syndrome, and 57.7% were at risk for this syndrome (8). COVID-19 burnout studies have been performed primarily on health care professionals. The study of health care professionals showed a positive and significant relationship between stress and burnout (9). Another research examining the relation between stress disorders, anxiety, and burnout during the COVID-19 pandemic found that physicians and nurses experienced psychological problems, including burnout (10).
Maintaining positive mental health is just as important as physical health in the event of a COVID-19 pandemic. In this regard, evaluating the effect of COVID-19 on the mental health of individuals is an important topic for research during the pandemic. To achieve this goal, there is a need for valid and reliable epidemiological assessment tools. Because of the long duration of the COVID-19 pandemic, people might greatly suffer from the common burnout caused by the disease. However, no scale is available that directly indicates the experience of burnout during this pandemic. Hence, unlike the previous scale developed by Talaee et al. (5), there is a need for a scale that can be easily applied to the general populations.
In order to expand research on COVID-19 and evaluate its psychological consequences, such as burnout, it is important to have reliable and valid instruments to measure it. The present study can help increase knowledge about the cultural effects of burnout caused by COVID-19. Also, standardizing the COVID-19 Burnout Scale (COVID-19-BS) in societies with different cultures can contribute to its external validity (11, 12).
2. Objectives
Considering the psychological consequences of COVID-19, the present study was conducted to investigate the psychometric properties of the Persian version of the COVID-19-BS.
3. Methods
3.1. Subjects and Methods
The population of this descriptive (psychometric) study included all students of Ahvaz Jundishapur University of Medical Sciences, Iran, from October 2020 to November 2020. Using the convenience sampling method, 251 students were selected. According to the minimum sample size in the confirmatory factor analysis (CFA) based on Kline (13), which is 200 people, 251 people were selected.
The inclusion criteria were willingness to participate in the study and being at least 18 years old. Due to the COVID-19 pandemic, data collection was done using online social networks, including WhatsApp and Telegram. During the research, in case of any event that violated the continuation of the research, the cooperation with the volunteer was terminated. Also, the participants were free to withdraw from the study at any stage. Participation in the study was completely free, and participants did not pay any fees.
The COVID-19-BS was developed based on instructions and guidelines for cross-cultural adaptation of instruments (14). Initially, the original version of the COVID-19-BS was translated from English into Persian by four PhD students in clinical psychology. Any differences in translations were resolved by agreement. In the next step, the translated Persian version was translated into English by two fluent mental health specialists in both English and Persian. The final translation of the COVID-19-BS was reviewed by the authors. Then, in a pilot study, the COVID-19-BS was performed on 22 students of Ahvaz Jundishapur University of Medical Sciences, and the existing problems were corrected. Finally, the scale was used to evaluate all samples. In the pilot study, students did not report any problems, and Cronbach’s alpha was 0.73 on a population of 22.
3.2. Ethical Consideration
This study was approved by the Ethics Committees of Ahvaz Jundishapur University of Medical Sciences (IR.AJUMS.REC.1399.897).
3.3. Measures
3.3.1. The COVID-19 Anxiety Syndrome Scale
A short tools for reliably identifying the characteristics of COVID-19-related anxiety syndrome. This scale has nine items that measure two dimensions, including perseveration Anxiety Syndrome Scale (C-19ASS-P) and avoidance (C-19ASS-A). Participants respond to each statement on a five-point Likert scale from one (not at all) to 5 (nearly every day) (15). Cronbach’s alpha was for the perseveration dimension was 0.86, and for the avoidance dimension was 0.77 (15).
3.3.2. The COVID-19 Burnout Scale
This scale consists of ten items and is adapted from the short version of Malach-Pines burnout (16). Each item is graded on a five-point Likert from 1 (never) to 5 (always). The total score can be calculated by adding ten items, and scores are from 10 to 50. A higher score demonstrates a higher level of burnout associated with COVID-19. The scale also has a very high internal consistency and has good psychometric properties (4).
3.3.3. The Compassion Scale
This scale is a 16-item scale that measures compassion for others and is based on the Neff model of compassion for oneself. It measures the four dimensions of mindfulness, a sense of common humanity, kindness, and lessened indifference. This scale has very desirable psychometric properties (reliability, convergent validity, structural validity, and internal consistency) (17). Cronbach’s alpha for this scale obtained in various studies was between 0.86 to 0.89 (17).
3.4. Statistical Analysis
Data were analyzed using SPSS version 25. For reliability, COVID-19-BS was evaluated using internal consistency by calculating Cronbach’s alpha coefficient. Cronbach’s alpha above 0.70 indicates good internal consistency (18). The validity of COVID-19-BS scale was evaluated using two methods of CFA and convergent and divergent validity. CFA was used to assess the validity of the COVID-19-BS structure. The one-factor structure of COVID-19-BS was tested as proposed in the original version using LISREL software (8.5). Parameters and fit indices of the model were estimated through the maximum likelihood model. The fit indices of COVID-19-BS were estimated using a number of indicators including chi-square statistic (χ2), comparative fit index (CFI), standardized root mean square residual (SRMR), non-normed fit index (NNFI), root mean square error of approximation (RMSEA), and adjusted goodness of fit index (AGFI). Model fit indices are assumed to be good if AGFI ≥ .90, NNFI ≥ .90, CFI ≥ .90, SRMR ≤ .10, and RMSEA ≤ .08 (19).
4. Results
4.1. Description of the Samples
The age range of participants was 18 - 56 years, with a mean and standard deviation of 27.52 ± 4.87. Of these, 146 (58.16%) were single, 99 (39.4%) were married, and six (2.4%) were divorced. Also, 79 (31.47%) students held a PhD, 107 (42.62%) a BSc, and 65 (25.9%) an MSc degree. The mean and standard deviation of the COVID-19-BS were 28.44 and 5.17, respectively.
4.2. Confirmatory Factor Analysis
To evaluate the construct validity of the COVID-19-BS and determine the fit of the factor and subscales structure obtained from Yıldırım and Solmaz (4), CFA was performed. Based on the results of Table 1, the one-factor model of the COVID-19-BS had a good fit. Therefore, the results of the present study showed that the one-factor model had a good fit (Figure 1).
Goodness of Fit Indices for One-Factor Model of COVID-19-BS
| Fit Indices | χ2 | df | P-Value | χ2/df | RMSEA | IFI | CFI | SRMR | NNFI | NFI | GFI | AGFI |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| One-factor | 150.29 | 35 | 0.000 | 4.29 | 0.08 | 0.91 | 0.91 | 0.08 | 0.89 | 0.90 | 0.89 | 0.83 |
Construct validity of the Persian version of the COVID-19-BS
4.3. Convergent and Divergent Validity of the COVID-19-BS
As can be seen in Table 2, the relationship between the COVID-19-BS and the CS is negative, indicating divergent validity of the scale (P < 0.01). On the other hand, the relationship between the COVID-19-BS and C-19ASS is positive, which indicates the convergent validity of this scale.
Convergent and Divergent Validity of the COVID-19-BS
4.4. Reliability
Internal consistency obtained by Cronbach’s alpha method for the total score of C-19ASS was 0.72, which indicated a good internal consistency.
5. Discussion
COVID-19 has led to an increase in mental health problems, including psychological distress, anxiety, depression, post-traumatic stress disorder (PTSD), insomnia, fear, stress, and anger (20-22). Stress and anxiety can weaken the immune system and make them vulnerable to diseases such as COVID-19. The COVID-19-BS scale is a useful tool to understand the COVID-19 burnout.
The aim of this study was to investigate the psychometric properties of COVID-19-BS. In this study, psychometric properties (validity and reliability) of the Persian version of COVID-19-BS were studied on 251 students of Ahvaz Jundishapur University of Medical Sciences. The results showed that one-factor structure is confirmed in Iranian society. These results are consistent with the study of the factor structure of this scale by Yıldırım and Solmaz (4). The Iranian version of the COVID-19-BS has a good internal consistency, which is in line with the results of Yıldırım and Solmaz. This finding is consistent with the original version of the scale, which suggests a global factor structure for the scale (4).
Our research findings support the use of COVID-19-BS as a short, convenient, cost-effective, and one-dimensional scale for assessing COVID-19 burnout. Even if COVID-19-BS is valid for use in the current epidemic, it can easily be used to assess burnout in other future public health crises. This can be done simply by modifying the text of the relevant items, such as replacing the term "COVID-19" with a specific term for another epidemic.
To evaluate the convergent validity of the COVID-19-BS, we examined its relevance to the C-19ASS, which showed a positive and significant correlation (23, 24). To examine the divergent validity of the COVID-19-BS, we examined its relationship with the CS, which showed a significant negative correlation, indicating an appropriate divergent validity (25, 26).
Compassion helps people understand that much of what goes on in our minds is not designed by us, and therefore not our fault. Clarifying this point when people are upset, anxious, depressed, tired, or feeling out of control has a key role to play in eliminating feelings of worthlessness, uselessness, and inadequacy. Compassion helps people realize that most of life’s problems and how to respond to them are not their own choice or planning, and that they should not blame themselves. Compassion helps people accept suffering under the influence of compassion and face it voluntarily, but not to drown in it. One of the results of helping clients is that it leads to the growth and development of compassionate motivation.
There are some limitations in interpreting and generalizing the results of our study. First, all the evaluated instruments in this study were self-report questionnaires. Therefore, correlations could have been inflated by common method variance. Second, this study had a cross-sectional and correlational design that does not allow causal interpretations and inferences. Third, the participants in this study may not have represented the general population; so, it is important to examine the general population. The psychometric properties of COVID-19-BS should be assessed in other communities and related samples. Fourth, since the study was conducted online, it was not possible to control how the questionnaires were filled out, and this problem may limit us in generalizing the results.
5.1. Conclusions
The main purpose of our study was to investigate the psychometric properties of COVID-19-BS in an Iranian population. COVID-19-BS can help to investigate the relationship between COVID-19 and the manifestations of psychopathology in constructing explanatory models. The present psychometric study complements the cross-cultural literature of this tool and is a suitable tool for research and clinical work. COVID-19-BS has a good validity and reliability in Iranian population.
Acknowledgements
References
-
1.
Yildirim M, Gecer E, Akgul O. The impacts of vulnerability, perceived risk, and fear on preventive behaviours against COVID-19. Psychol Health Med. 2021;26(1):35-43. [PubMed ID: 32490689]. https://doi.org/10.1080/13548506.2020.1776891.
-
2.
Arslan G, Yıldırım M, Tanhan A, Buluş M, Allen K. Coronavirus Stress, Optimism-Pessimism, Psychological Inflexibility, and Psychological Health: Psychometric Properties of the Coronavirus Stress Measure. Int J Ment Health Addict. 2020. https://doi.org/10.1007/s11469-020-00337-6.
-
3.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(10227):912-20. https://doi.org/10.1016/s0140-6736(20)30460-8.
-
4.
Yıldırım M, Solmaz F. COVID-19 burnout, COVID-19 stress and resilience: Initial psychometric properties of COVID-19 Burnout Scale. Death Stud. 2020:1-9. https://doi.org/10.1080/07481187.2020.1818885.
-
5.
Talaee N, Varahram M, Jamaati H, Salimi A, Attarchi M, Kazempour Dizaji M, et al. Stress and burnout in health care workers during COVID-19 pandemic: validation of a questionnaire. J Public Health. 2020:1-6. [PubMed ID: 32837840]. [PubMed Central ID: PMC7275852]. https://doi.org/10.1007/s10389-020-01313-z.
-
6.
Marcinko D, Jakovljevic M, Jaksic N, Bjedov S, Mindoljevic Drakulic A. The Importance of Psychodynamic Approach during COVID-19 Pandemic. Psychiatr Danub. 2020;32(1):15-21. [PubMed ID: 32303024]. https://doi.org/10.24869/psyd.2020.15.
-
7.
Peterson U, Demerouti E, Bergstrom G, Samuelsson M, Asberg M, Nygren A. Burnout and physical and mental health among Swedish healthcare workers. J Adv Nurs. 2008;62(1):84-95. [PubMed ID: 18352967]. https://doi.org/10.1111/j.1365-2648.2007.04580.x.
-
8.
Almeida GDC, Souza HRD, Almeida PCD, Almeida BDC, Almeida GH. The prevalence of burnout syndrome in medical students. Archives of Clinical Psychiatry (São Paulo). 2016;43(1):6-10. https://doi.org/10.1590/0101-60830000000072.
-
9.
Morgantini LA, Naha U, Wang H, Francavilla S, Acar O, Flores JM, et al. Factors Contributing to Healthcare Professional Burnout During the COVID-19 Pandemic: A Rapid Turnaround Global Survey. medRxiv. 2020. https://doi.org/10.1101/2020.05.17.20101915.
-
10.
Sung C, Chen C, Fan C, Su F, Chang J, Hung C, et al. Burnout in Medical Staffs During a Coronavirus Disease (COVID-19) Pandemic. SSRN Electron J. 2020. https://doi.org/10.2139/ssrn.3594567.
-
11.
Mousavi Asl E, Dabaghi P, Taghva A. Screening borderline personality disorder: The psychometric properties of the Persian version of the McLean screening instrument for borderline personality disorder. J Res Med Sci. 2020;25:97. [PubMed ID: 33273942]. [PubMed Central ID: PMC7698379]. https://doi.org/10.4103/jrms.JRMS_949_19.
-
12.
Mousavi Asl E, Mahaki B, Gharraee B, Asgharnejad Farid AA, Shahverdi-Shahraki A. Beliefs about binge eating: The psychometric properties of the Persian version of the eating beliefs questionnaire. J Res Med Sci. 2020;25:73. [PubMed ID: 33088310]. [PubMed Central ID: PMC7554542]. https://doi.org/10.4103/jrms.JRMS_623_19.
-
13.
Kline RB. Principles and practice of structural equation modeling. Guilford Publications; 2015.
-
14.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: Literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. https://doi.org/10.1016/0895-4356(93)90142-n.
-
15.
Nikcevic AV, Spada MM. The COVID-19 anxiety syndrome scale: Development and psychometric properties. Psychiatry Res. 2020;292:113322. [PubMed ID: 32736267]. [PubMed Central ID: PMC7375349]. https://doi.org/10.1016/j.psychres.2020.113322.
-
16.
Malach-Pines A. The Burnout Measure, Short Version. Int J Stress Manag. 2005;12(1):78. https://doi.org/10.1037/1072-5245.12.1.78.
-
17.
Pommier E, Neff KD, Toth-Kiraly I. The Development and Validation of the Compassion Scale. Assessment. 2020;27(1):21-39. [PubMed ID: 31516024]. https://doi.org/10.1177/1073191119874108.
-
18.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. [PubMed ID: 17161752]. https://doi.org/10.1016/j.jclinepi.2006.03.012.
-
19.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1-55. https://doi.org/10.1080/10705519909540118.
-
20.
Torales J, O'Higgins M, Castaldelli-Maia JM, Ventriglio A. The outbreak of COVID-19 coronavirus and its impact on global mental health. Int J Soc Psychiatry. 2020;66(4):317-20. [PubMed ID: 32233719]. https://doi.org/10.1177/0020764020915212.
-
21.
Bao Y, Sun Y, Meng S, Shi J, Lu L. 2019-nCoV epidemic: address mental health care to empower society. The Lancet. 2020;395(10224):e37-8. https://doi.org/10.1016/s0140-6736(20)30309-3.
-
22.
Yıldırım M, Akgül Ö, Geçer E. The Effect of COVID-19 Anxiety on General Health: the Role of COVID-19 Coping. International Journal of Mental Health and Addiction. 2021. https://doi.org/10.1007/s11469-020-00429-3.
-
23.
Luceno-Moreno L, Talavera-Velasco B, Garcia-Albuerne Y, Martin-Garcia J. Symptoms of Posttraumatic Stress, Anxiety, Depression, Levels of Resilience and Burnout in Spanish Health Personnel during the COVID-19 Pandemic. Int J Environ Res Public Health. 2020;17(15):5514. [PubMed ID: 32751624]. [PubMed Central ID: PMC7432016]. https://doi.org/10.3390/ijerph17155514.
-
24.
Hu D, Kong Y, Li W, Han Q, Zhang X, Zhu LX, et al. Frontline nurses' burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: A large-scale cross-sectional study. EClinicalMedicine. 2020;24:100424. [PubMed ID: 32766539]. [PubMed Central ID: PMC7320259]. https://doi.org/10.1016/j.eclinm.2020.100424.
-
25.
Ruiz-Fernandez MD, Ramos-Pichardo JD, Ibanez-Masero O, Cabrera-Troya J, Carmona-Rega MI, Ortega-Galan AM. Compassion fatigue, burnout, compassion satisfaction and perceived stress in healthcare professionals during the COVID-19 health crisis in Spain. J Clin Nurs. 2020;29(21-22):4321-30. [PubMed ID: 32860287]. https://doi.org/10.1111/jocn.15469.
-
26.
Hofmeyer A, Taylor R, Kennedy K. Fostering compassion and reducing burnout: How can health system leaders respond in the Covid-19 pandemic and beyond? Nurse Educ Today. 2020;94:104502. [PubMed ID: 32980180]. [PubMed Central ID: PMC7295512]. https://doi.org/10.1016/j.nedt.2020.104502.