Abstract
Background:
There is a limited number of psychometric tools for measuring the psychological impacts of COVID-19 on healthcare workers (HCWs). The Coronavirus Anxiety Scale (CAS) is a brief questionnaire that identifies dysfunctional anxiety induced by the COVID-19 pandemic.Method:
The authors translated the CAS into Persian and assessed its validity and reliability among Iranian HCWs. First, they calculated the content validity index (CVI) and the content validity ratio (CVR) based on six psychiatrists’ assessments. Then, 10 medical interns modified the questionnaire for face validity. In addition, 30 psychiatric residents contributed to the test-retest method to evaluate the intergroup correlation coefficient (ICC). Finally, they examined confirmatory factor analysis (CFA) for construct validity, based on the responses of participants to the scale, and they used Cronbach's alpha coefficient to assess the internal consistency.Results:
185 healthcare workers filled out the Persian version of the CAS. In the assessment of the content validity, all five questions of the CAS had CVI > 0.79 and CVR > 0.99, and all were statistically approved. The construct validity showed that the scale is one-dimensional. The internal consistency (Cronbach’s α= 0.878) and test-retest stability (ICC= 0.931) were accepted.Conclusions:
After the localization of the questionnaire, no items were added or subtracted. The CAS presented adequate reliability and validity among Iranian HCWs. Therefore, future epidemiologic studies can consider it a valid scale for HCWs.Keywords
COVID-19 Reliability and Validity Healthcare Workers Nurses Coronavirus Anxiety Scale
1. Background
The coronavirus disease 2019 (COVID-19) has become a global public health emergency. The World Health Organization (WHO) reported almost 531 million confirmed cases globally, including seven million cases in Iran as of June 2022 (1). This high incidence rate has caused severe anxiety and feeling of helplessness in communities including healthcare workers (HCWs) (2) who have been in constant exposure to the virus over the past two years. In addition, HCWs are concerned about spreading the virus to their family members and being stigmatized because of their interactions with COVID-19 patients (3). Besides, this psychological distress, COVID-19 has led to increased working hours, increased inpatient demands, and increased patient mortality (2). These developments have collectively made HCWs vulnerable to impaired function (4) and burnout (5). Burnout negatively affects the mental health of HCWs and the quality of their provided services (6). These issues highlight the importance of the early detection of anxiety symptoms among HCWs. However, timely anxiety detection cannot be adequately addressed without utilizing reliable and valid anxiety assessment tools (4).
Our literature review suggests that the existing tools for evaluating anxiety symptoms among Iranian HCWs during the COVID-19 pandemic have some limitations. For example, a recent Iranian study has developed a compound questionnaire about COVID-19-related stress and job burnout among HCWs (5). It used two available questionnaires, the Depression, Anxiety, and Stress Scale-21 (DASS-21) (7) and the Copenhagen Burnout Inventory (CBI) (8, 9). This study has validated these scales among Iranian nurses (5). In contrast, a review study argued that traditional screening tools might lead to underdiagnosis or overdiagnosis of mental health disorders in a newly emerged situation, such as the current pandemic (10). Hence, new instruments may contribute better to epidemiological studies during the pandemic.
Several questionnaires measure COVID-19-related anxiety. Some examples are the COVID-19 Anxiety Syndrome Scale (C-19ASS) (11), the COVID-19 Anxiety Scale (12), the Persian COVID Stress Scale (13), the Coronavirus Disease Anxiety Scale (CDAS) (14), and the Coronavirus Anxiety Scale (CAS) (15). Among these screening tools, we decided to validate the CAS among HCWs in Iran for several reasons. The CAS is a brief questionnaire that includes five items, which assesses and identifies dysfunctional anxiety induced by the current COVID-19 pandemic. This assessment is based on distinct manifestations of anxiety within cognitive, behavioral, emotional, and physiological dimensions (15). The CAS has been validated among different general papulations with different languages including Bengali (16), Portuguese (17, 18), Korean (19), Turkish (20), Polish (21), Spanish (22, 23), Urdu (24), and Persian (25, 26). The last two cases were studies that validated the CAS in two major cities of Iran, including Kermanshah (25) and Tehran (26). Both studies have validated the Persian version of the CAS among the general population. They have pointed out that it is necessary to conduct a similar study among HCWs, who are facing more anxiety. Hence, we found this scale to be useful, functional, and popular. Our objective is to assess the validity and reliability of the Coronavirus Anxiety Scale among Iranian nurses, as a group of healthcare workers.
2. Methods
This cross-sectional study was conducted from January 22, 2021, to March 19, 2021, which is the period between the second and third peaks of COVID-19 in Iran (1). The University Ethics Committee approved the study. The ethical code was IR.MUMS.REC.1399.639. All participants completed informed consent. The authors received translation permission from the author of the original Coronavirus Anxiety Scale article, Dr. Sherman Lee (15). Subsequently, they began the translation and validation of the CAS. Next, they sent the following two online questionnaires to participants: the demographic questionnaire and the CAS. Inclusion criteria for participation in the study were working in the medical and nursing profession at the hospitals affiliated with Mashhad University of Medical Sciences, being within the age range of 18 to 60, and completing the two online questionnaires. Exclusion criteria were having one or more major psychiatric disorders (e.g. major depressive disorder, schizophrenia, and bipolar disorder), leaving more than two questions unanswered, and unwillingness to fill out the consent form. Eligible participants were provided an invitation form through their academic email.
The CAS is a concise mental health-screening questionnaire. It can identify dysfunctional anxiety due to the coronavirus crisis based on cognitive effects (repetitive thoughts and worries), behavioral effects (dysfunction and compulsive behaviors, or avoidance), emotional effects (fear, anxiety, and anger), and physiological effects of anxiety (sleep disorders and physical distress). Answers were measured using the five-point Likert scale (from 0 = never to 4 = almost every day, for the past two weeks). The cut-off score for this scale was ≥ 9, with 90% sensitivity and 85% specificity (15). A recent study lowered the cut-off score from 9 to ≥ 5 for the general population, and ≥ 9 when screening at-risk or anxious groups (27). For validation of the CAS among Iranian HCWs, the authors translated the CAS into Persian using the forward-backward translation method. Initially, an English expert translated it into Persian. Then, two Persian language professors working in the United States back translated it. Next, the authors compared them to the original English version. Ultimately, the Persian translation was modified in the required parts. For assessment of the content validity, six psychiatrists, who had recently served at the COVID-19 wards of public hospitals, evaluated the translated questionnaire. An online questionnaire was sent to all of them. It consisted of questions about relatedness (completely related, related, relatively related, unrelated), transparency (completely transparent, transparent, relatively transparent, not transparent), simplicity (completely simple, simple, relatively simple, non-simple), and necessity (it is necessary, useful but not necessary, not necessary) of each item. In addition, the psychiatrist expressed their opinions to qualify the questionnaire by answering a qualitative question at the end. Accordingly, the evaluation of psychiatrists’ opinions was qualitative and quantitative. Ultimately, they made modifications to the translated content. The content validity was calculated based on the content validity index (CVI) and the content validity ratio (CVR). For evaluating the face validity, 10 medical interns working at the Mashhad University of Medical Sciences reviewed and modified the questionnaire form. Their corrections regarding the language and writing of the items were submitted. For assessing the construct validity, the confirmatory factor analysis (CFA) was used based on the nurses’ responses to the online questionnaire. Finally, Cronbach's alpha coefficient was used to assess the internal consistency, and the test-retest method was used to evaluate the reliability of the questionnaire. To this aim, 30 psychiatric residents filled out the online form of the questionnaire twice within two weeks.
2.1. Statistical Analysis
Statistical analysis was conducted using AMOS 23.0 and IBM SPSS 16.0. A P-value of less than 0.05 was considered significant. The required sample size for CFA is 10 samples for each item (28, 29).
3. Results
Based on the inclusion criteria, 250 nurses participated. In the assessment of their answers to the questionnaire, 65 participants were excluded (20 people had completed the questionnaire twice, and 45 people had left many questions unanswered). Therefore, 185 participants were included (Table 1). In correlating the total CAS score with demographic variables, the mean total CAS score was 2.3 (SD = 3.3) in the target sample, 1.86 (SD = 3.03) in men, and 2.4 (SD = 3.4) in women, ranging from 0 to 18. There was no significant relationship between gender and the total CAS score (P = 0.32). However, the CAS score in participants aged 30 to 40 years was significantly higher than the score for other participants (P = 0.022). There was no significant difference between the CAS scores between married and single participants (P = 0.872).
Descriptive Statistics Analysis
| Variables | Frequency (%) | Mean |
|---|---|---|
| Age | ||
| 20 to 30 | 32 (17.3) | |
| 30 to 40 | 96 (51.9) | |
| 40 to 50 | 53 (28.6) | |
| 50 to 60 | 4 (2.2) | |
| Total | 185 (100) | 36.05 |
| Gender | ||
| Female | 143 (77.3) | |
| Male | 42 (22.7) | |
| Total | 185 (100) | |
| Marriage | ||
| Yes | 153 (82.7) | |
| No | 32 (17.3) | |
| Total | 185 (100) |
3.1. Content Validity
The answers of six psychiatrists to the online questionnaire based on the Likert scale were statistically analyzed, using the CVI and CVR. The item “When I thought about the coronavirus or was exposed to information about it, I felt paralyzed,” in terms of relevancy, transparency, and simplicity, received the lowest score, which was 0.83; however, according to the cut-off point of 0.79, this item was also confirmed.
3.2. Construct Validity
The CFA of answers indicated that the CAS with a one-factor structure fitted the data well (Figure 1 and Table 2), and the standardized factor loading values were greater than 0.4, which was within an acceptable range (30). The results of the goodness of fit index of the model are presented in Table 3.
Factor Loading Estimation of Confirmatory Factor Analysis for the Coronavirus Anxiety Scale
| Item | Unstandardized Loading Factor (S.E.) | Statistic (P-value) | Standardized Loading Factor | Acceptable Range (Threshold) | Result |
|---|---|---|---|---|---|
| Dizzy | 0.865 (.110) | 7.861 (< 0.001) | 0.602 | Above 0.4 | Acceptable |
| Sleep | 1.051 (.095) | 11.113 (< 0.001) | 0.743 | Above 0.4 | Acceptable |
| Froze | 0.922 (.066) | 13.982 (< 0.001) | 0.884 | Above 0.4 | Acceptable |
| Eat | 0.920 (.070) | 13.198 (< 0.001) | 0.842 | Above 0.4 | Acceptable |
| Stomach | Ref | 0.825 | Above 0.4 | Acceptable |
Goodness Fit Indices and Confirmatory Factor Analysis for Coronavirus Anxiety Scale
| Fitting Index | Value | Acceptable Range (Threshold) | Result |
|---|---|---|---|
| Chi-square/df | 2.367 | Between 1 to 3 | Acceptable |
| CFI | 0.992 | > 0.90 | Acceptable |
| TLI | 0.974 | > 0.90 | Acceptable |
| RMSEA | 0.086 | < 0.10 | Acceptable |
Conceptual model for assessing the construct validity of the CAS. CAS: Coronavirus anxiety scale, Dizzy: Dizziness; Sleep: Sleep disturbance; Froze: Tonic immobility; Eat: Appetite loss; Stomach: Nausea or abdominal distress. All of the standardized coefficients are significant at the 0.4 level.
3.3. Reliability
The internal consistency of the questionnaire was confirmed by Cronbach's alpha coefficient of 0.878. Removing any of the questions did not increase the internal consistency of the questionnaire. Moreover, the reliability of the test-retest was evaluated on 30 participants with an interval of two weeks using the intra-class correlation coefficient (ICC). Considering the two-way mixed model, the ICC was 0.931 (95% confidence interval: 0.852 - 0.967).
4. Discussion
The Coronavirus Anxiety Scale, developed in March 2020, is among the first few published screening tools for assessing dysfunctional anxiety induced by the current COVID-19 pandemic (15). The questionnaire was first evaluated among 775 individuals, with an average age of 32.72 (SD = 9.35) years. In that study, Cronbach’s alpha was 0.93. The study reported the questionnaire’s diagnostic qualities (90% sensitivity and 85% specificity) and indicated that it is comparable to other psychiatric screening tests (15). There are 20 translated versions of the CAS on an online site for resources (27), and it has been validated in 10 languages as of now (16-24). A recent study verified the findings of the CAS and lowered the cut-off score from 9 to ≥5 for the general population, and ≥9 when screening at-risk or anxious groups (27). A brief review study indicated that the CAS has been validated in non-clinical samples consisting of middle-aged adults; however, future studies focusing on vulnerable groups are necessary. The study indicated that the CAS is an easy-to-administer and useful tool for clinicians that is consistent with the DSM-5’s cross-cutting symptom measures (10).
We know that evaluating mental health problems among Iranian Healthcare Workers (HCWs) has been somewhat neglected, partly due to the lack of novel and globally standardized scales. Two studies have validated the CAS in Persian among the Iranian general population (25, 26). In both studies, participants had different occupational and socioeconomic statuses. For confirming the reliability, Cronbach's alphas were 91.5 (25) and 0.80 (26), which were in line with our findings. Although the CAS was shown to be reliable and valid in these studies, it was not validated among HCWs. Hence, we contribute to the literature by applying the CAS, as a brief but valid instrument, to evaluate coronavirus anxiety among Iranian nurses as a group of HCWs. Subsequently, 185 nurses participated in the study. They were working in different hospitals and different departments of hospitals affiliated with Mashhad University of Medical Sciences. Accordingly, the survey was conducted among an admissible represented population of HCWs. assessing the results of this study, all five questions of the questionnaire had a content validity Ratio > 0.99 and a CVI > 0.79, confirming its content validity. The construct validity was approved by confirmatory factor analysis. The internal consistency of the questionnaire was confirmed by Cronbach's alpha coefficient of 0.878. Moreover, the reliability of test-retest at two-week intervals showed a high correlation of 0.931 between scores, approving the reproducible results and reliability of the questionnaire.
A remarkable finding of this study was the total CAS score among the nurses. The men's score was 1.86 (SD= 3.03) and the score of women was 2.4 (SD = 3.4). There was no significant relationship between gender and total CAS score (P = 0.32). However, the CAS score in the group of participants aged 30 to 40 years was significantly higher than the score for other participants (P = 0.022). Although Iranian HCWs experienced several challenges during the COVID-19 pandemic, the total CAS score was low. There are two potential explanations for this finding. First, the CAS mean score was low possibly because the study was conducted at the end of the third peak of COVID-19. Second, chronic exposure to anxiety-provoking events and stressors may make people unaware of their anxiety symptoms; therefore, the self-report questionnaire may be biased.
Our study has several limitations. First, we used the available sampling method, which limits the generalizability of the results to the entire healthcare worker community. In addition, we had to distribute the questionnaires online due to social isolation during the pandemic, limiting the researchers' supervision during data collection. As a result, in the final data review, we found that some participants did not answer all the questions, while some filled out the questionnaires twice. We suggest that future researchers use programming and software tools to limit these errors.
4.1. Conclusions
Healthcare workers are one of the most vulnerable groups during the COVID-19 pandemic, for whom, the early detection of coronavirus-related anxiety can facilitate further research and practice on mental health issues. We found that CAS is a valid and reliable tool to evaluate anxiety among Iranian healthcare workers.
Acknowledgements
References
-
1.
WHO. COVID-19 weekly epidemiological update. 2022. Available from: https://apps.who.int/iris/bitstream/handle/10665/359148/nCoV-weekly-sitrep6Jul22-eng..pdf?sequence=1.
-
2.
Heath C, Sommerfield A, von Ungern-Sternberg BS. Resilience strategies to manage psychological distress among healthcare workers during the COVID-19 pandemic: a narrative review. Anaesthesia. 2020;75(10):1364-71. [PubMed ID: 32534465]. [PubMed Central ID: PMC7323405]. https://doi.org/10.1111/anae.15180.
-
3.
World Health Organization. COVID-19: Occupational health and safety for health workers: interim guidance, 2 February 2021. World Health Organization; 2021.
-
4.
Banerjee D. The COVID-19 outbreak: Crucial role the psychiatrists can play. Asian J Psychiatr. 2020;50:102014. [PubMed ID: 32240958]. [PubMed Central ID: PMC7270773]. https://doi.org/10.1016/j.ajp.2020.102014.
-
5.
Talaee N, Varahram M, Jamaati H, Salimi A, Attarchi M, Kazempour Dizaji M, et al. Stress and burnout in health care workers during COVID-19 pandemic: validation of a questionnaire. Z Gesundh Wiss. 2022;30(3):531-6. [PubMed ID: 32837840]. [PubMed Central ID: PMC7275852]. https://doi.org/10.1007/s10389-020-01313-z.
-
6.
Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain Behav Immun. 2020;88:901-7. [PubMed ID: 32437915]. [PubMed Central ID: PMC7206431]. https://doi.org/10.1016/j.bbi.2020.05.026.
-
7.
Sahebi A, Asghari MJ, Salari RS. Validation of Depression Anxiety and Stress Scale (DASS-21) for an Iranian Population. J Dev Psychol. 2005;1(4):36-54.
-
8.
Mahmoudi S, Atashzadeh-Shoorideh F, Rassouli M, Moslemi A, Pishgooie AH, Azimi H. Translation and Psychometric Properties of the Copenhagen Burnout Inventory in Iranian Nurses. Iran J Nurs Midwifery Res. 2017;22(2):117-22. [PubMed ID: 28584549]. [PubMed Central ID: PMC5442992]. https://doi.org/10.4103/1735-9066.205958.
-
9.
Javanshir E, Dianat I, Asghari-Jafarabadi M. Psychometric properties of the Iranian version of the Copenhagen Burnout Inventory. Health Promot Perspect. 2019;9(2):137-42. [PubMed ID: 31249801]. [PubMed Central ID: PMC6588812]. https://doi.org/10.15171/hpp.2019.19.
-
10.
Ransing R, Ramalho R, Orsolini L, Adiukwu F, Gonzalez-Diaz JM, Larnaout A, et al. Can COVID-19 related mental health issues be measured? Brain Behav Immun. 2020;88:32-4. [PubMed ID: 32470593]. [PubMed Central ID: PMC7248629]. https://doi.org/10.1016/j.bbi.2020.05.049.
-
11.
Nikcevic AV, Spada MM. The COVID-19 anxiety syndrome scale: Development and psychometric properties. Psychiatry Res. 2020;292:113322. [PubMed ID: 32736267]. [PubMed Central ID: PMC7375349]. https://doi.org/10.1016/j.psychres.2020.113322.
-
12.
Silva WAD, de Sampaio Brito TR, Pereira CR. COVID-19 anxiety scale (CAS): Development and psychometric properties. Curr Psychol. 2022;41(8):5693-702. [PubMed ID: 33204058]. [PubMed Central ID: PMC7661558]. https://doi.org/10.1007/s12144-020-01195-0.
-
13.
Khosravani V, Asmundson GJG, Taylor S, Sharifi Bastan F, Samimi Ardestani SM. The Persian COVID stress scales (Persian-CSS) and COVID-19-related stress reactions in patients with obsessive-compulsive and anxiety disorders. J Obsessive Compuls Relat Disord. 2021;28:100615. [PubMed ID: 33354499]. [PubMed Central ID: PMC7746142]. https://doi.org/10.1016/j.jocrd.2020.100615.
-
14.
Alipour A, Ghadami A, Farsham A, Dorri N. A New Self-Reported Assessment Measure for COVID-19 Anxiety Scale (CDAS) in Iran: A Web-Based Study. Iran J Public Health. 2020;49(7):1316-23. [PubMed ID: 33083298]. [PubMed Central ID: PMC7548505]. https://doi.org/10.18502/ijph.v49i7.3585.
-
15.
Lee SA. Coronavirus Anxiety Scale: A brief mental health screener for COVID-19 related anxiety. Death Stud. 2020;44(7):393-401. [PubMed ID: 32299304]. https://doi.org/10.1080/07481187.2020.1748481.
-
16.
Ahmed O, Faisal RA, Sharker T, Lee SA, Jobe MC. Adaptation of the Bangla Version of the COVID-19 Anxiety Scale. Int J Ment Health Addict. 2022;20(1):284-95. [PubMed ID: 32837436]. [PubMed Central ID: PMC7320841]. https://doi.org/10.1007/s11469-020-00357-2.
-
17.
Magano J, Vidal DG, Sousa H, Dinis MAP, Leite A. Validation and Psychometric Properties of the Portuguese Version of the Coronavirus Anxiety Scale (CAS) and Fear of COVID-19 Scale (FCV-19S) and Associations with Travel, Tourism and Hospitality. Int J Environ Res Public Health. 2021;18(2). [PubMed ID: 33430397]. [PubMed Central ID: PMC7827056]. https://doi.org/10.3390/ijerph18020427.
-
18.
Padovan-Neto FE, Lee SA, Guimaraes RP, Godoy LD, Costa HB, Zerbini FLS, et al. Brazilian Adaptation of the Coronavirus Anxiety Scale: A Psychometric Investigation of a Measure of Coronaphobia. Omega (Westport). 2023;86(3):769-87. [PubMed ID: 33530891]. [PubMed Central ID: PMC9810823]. https://doi.org/10.1177/0030222821991325.
-
19.
Choi E, Lee J, Lee SA. Validation of the Korean version of the obsession with COVID-19 scale and the Coronavirus anxiety scale. Death Stud. 2022;46(3):608-14. [PubMed ID: 34030606]. https://doi.org/10.1080/07481187.2020.1833383.
-
20.
Evren C, Evren B, Dalbudak E, Topcu M, Kutlu N. Measuring anxiety related to COVID-19: A Turkish validation study of the Coronavirus Anxiety Scale. Death Stud. 2022;46(5):1052-8. [PubMed ID: 32490730]. https://doi.org/10.1080/07481187.2020.1774969.
-
21.
Skalski S, Uram P, Dobrakowski P, Kwiatkowska A. The link between ego-resiliency, social support, SARS-CoV-2 anxiety and trauma effects. Polish adaptation of the Coronavirus Anxiety Scale. Pers Individ Dif. 2021;171:110540. [PubMed ID: 33223590]. [PubMed Central ID: PMC7670928]. https://doi.org/10.1016/j.paid.2020.110540.
-
22.
Caycho-Rodriguez T, Vilca LW, Carbajal-Leon C, White M, Vivanco-Vidal A, Saroli-Aranibar D, et al. Coronavirus Anxiety Scale: New psychometric evidence for the Spanish version based on CFA and IRT models in a Peruvian sample. Death Stud. 2022;46(5):1090-9. [PubMed ID: 33427098]. https://doi.org/10.1080/07481187.2020.1865480.
-
23.
Broche-Perez Y, Fernandez-Castillo E, Fernandez-Fleites Z, Jimenez-Puig E, Vizcaino-Escobar A, Ferrer-Lozano D, et al. Adaptation of the Cuban version of the Coronavirus Anxiety Scale. Death Stud. 2022;46(3):603-7. [PubMed ID: 33276708]. https://doi.org/10.1080/07481187.2020.1855610.
-
24.
Sabih A, Sadiq H. The Development of Coronavirus Anxiety Scale in Urdu (CASU). J Pak Psychiatr Soc. 2021;18(1).
-
25.
Mohammadpour M, Ghorbani V, Moradi S, Khaki Z, Foroughi AA, Rezaei MR. Psychometric Properties of the Iranian Version of the Coronavirus Anxiety Scale. Iran J Psychiatry Clin Psychol. 2020;26(3 Special Issue on COVID-19):374-87. https://doi.org/10.32598/ijpcp.26.3482.1.
-
26.
Abasi I, Sohrabzadeh Fard A, Farzin A, Lee S, Masjedi Arani A, Poursharifi H. Psychometric Properties of Coronavirus Anxiety Scale in Iranian Population. Iran J Psychiatry Behav Sci. 2021;15(4). https://doi.org/10.5812/ijpbs.112707.
-
27.
Lee SA. Replication analysis of the Coronavirus Anxiety Scale. Dusunen Adam: The Journal of Psychiatry and Neurological Sciences. 2020;2(33):203-5. https://doi.org/10.14744/dajpns.2020.00079.
-
28.
Nunnally JC. Psychometric Theory. New York: McGraw-Hill; 1967.
-
29.
Guadagnoli E, Velicer WF. Relation of sample size to the stability of component patterns. Psychol Bull. 1988;103(2):265-75. [PubMed ID: 3363047]. https://doi.org/10.1037/0033-2909.103.2.265.
-
30.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1-55. https://doi.org/10.1080/10705519909540118.