Psychometric Properties of the Persian Version of Cognitive Fusion Questionnaire-Chronic Illness in Multiple Sclerosis

authors:

avatar Esmail Soltani ORCID 1 , * , avatar Sadegh Izadi 2 , avatar Pardis Sharifi 3 , avatar Maryam Poursadeghfard 2

Research Center for Psychiatry and Behavioral Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
Clinical Neurology Research Center, Shiraz University of Medical Sciences, Shiraz, Iran
School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
Iranian Journal of Psychiatry and Behavioral Sciences: Vol.16, issue 1; e113524
published online: March 15, 2022
article type: Research Article
received: February 2, 2021
revised: September 26, 2021
accepted: January 15, 2022
DOI: https://doi.org/10.5812/ijpbs.113524

how to cite: Soltani E, Izadi S , Sharifi P, Poursadeghfard M. Psychometric Properties of the Persian Version of Cognitive Fusion Questionnaire-Chronic Illness in Multiple Sclerosis. Iran J Psychiatry Behav Sci. 2022;16(1):e113524. https://doi.org/10.5812/ijpbs.113524.

Abstract

Background:

Cognitive fusion is a substantial variable of acceptance and commitment therapy (ACT). Recently, various instruments have been developed to assess cognitive fusion, including a version relevant to medical illness referred to as the Cognitive Fusion Questionnaire-Chronic Illness (CFQ-CI).

Objectives:

This study aimed to assess the validity and reliability of the Persian version of CFQ-CI in multiple sclerosis (MS) patients.

Methods:

In a cross-sectional study, the Persian version of CFQ-CI and several other measures that assessed self-compassion, depression, and social anxiety symptoms were administered on 195 MS patients in Shiraz Emam Reza Clinic. Exploratory factor analysis (EFA), internal consistency, and convergent validity were used for data analysis.

Results:

EFA revealed a 1-factor model. The Cronbach α was 0.92. As to the convergent validity, CFQ-CI had positive associations with measures of depression and social anxiety and negative associations with self-compassion.

Conclusions:

Overall, this research supports the psychometric properties of the Persian version of CFQ-CI.

1. Background

Multiple sclerosis (MS) is defined as an idiopathic, inflammatory disease of the central nervous system characterized by demyelination and axonal loss. The common symptoms of these patients include numbness, weakness, vision problems, balance problems, vertigo, urinary urgency, fatigue, and depression (1). MS is an autoimmune, multifactorial, and heterogeneous disease influenced by genetic and environmental factors. Due to high treatment costs, poor job expectations, and MS patients’ job dropout, this disease imposes significant costs on society (2). MS is 3.13 times more common in women than in men (3). A previous systematic review and meta-analysis estimated the prevalence of MS in Iran to be 29.3 per 100 000 people (4). It has been shown that patients with MS may have different psychological disorders, including depression and anxiety (5-9). Depression and anxiety in MS patients are associated with reduced treatment adherence (10) and quality of life (11). The effectiveness of psychological therapies, such as cognitive-behavioral therapy (CBT), in reducing psychological problems has been shown by empirical research in MS patients (12, 13). However, negative illness beliefs and distress may be realistic in specific medical conditions such as MS at certain times (14). Accordingly, there has been an increase in the use of other psychotherapies, such as acceptance and commitment therapy (ACT), for chronic disorders, and some studies have shown the effectiveness of such therapies for MS (14-17). In contrast to CBT that aims to directly change negative beliefs, in ACT, the focus is on accepting thoughts and feelings and creating behaviors based on values (18).

ACT is a third-wave behavioral therapy that creates psychological flexibility (19). Psychological flexibility is a behavioral pattern defined based on 6 processes, decreasing or increasing the treatment model (20). Cognitive fusion is one of these processes, playing a role in different psychological disorders, including depression and anxiety (21, 22). In ACT, cognitive fusion is the dominance of cognitive events over one’s personal experience, inability to observe cognitive events from a different perspective, tendency toward showing emotional reactions to thoughts, overregulation of behavior under the dominance of cognitive events, attempt to control thoughts, over-analysis of situations, and making judgments about the content of one’s thoughts (23). Given the importance of cognitive fusion in psychopathology, different researchers have examined this construct in MS patients. They have shown the role of cognitive fusion in psychological distress, such as anxiety and depression, as well as in the psychological well-being and quality of life of these patients (24-27). The Cognitive Fusion Questionnaire (CFQ) has recently been designed to assess this concept. The results showed that CFQ had a 1-factor structure and revealed its discriminant validity, sensitivity to treatment, stability over time, and reliability (23). CFQ was translated and validated in Iran (28). CFQ was designed to measure cognitive fusion in mental disorders and non-clinical samples, but some researchers (29) have recently designed a Chronic Illness version of the CFQ referred to as CFQ-CI in inflammatory bowel disease (IBD).

2. Objectives

CFQ-CI was designed for chronic illness, and a review of the literature showed that currently, there is no psychometrically validated instrument to assess cognitive fusion in the context of MS. It seems that creating a questionnaire to assess this concept in MS patients can help us to accurately assess the psychological characteristics of this disease. Therefore, the present study aimed to examine the psychometric properties of CFQ-CI in MS patients.

3. Methods

3.1. Participants and Procedure

The sample included 200 patients with a definite diagnosis of MS according to McDonald’s criteria in the Emam Reza Clinic affiliated with Shiraz University of Medical Sciences in 2020. Based on Munro’s Statistical Methods for Health Care Research (30), a ratio of at least 10 participants for each variable is desirable to generalize the sample to a larger population. We selected 200 subjects according to the number of variables and the possibility of generalization. The participants were selected using the convenience sampling method. After explaining the purpose of the research and obtaining informed consent, demographic information was received by the researcher and neurologist, and then the questionnaires were completed by the participants. The inclusion criteria were being diagnosed with MS by a neurologist at least 6 months ago, not being in the relapse or end-stage of the disease or profound cognitive impairment, being able to read and write, and being 16 - 65 years old. The exclusion criteria were the use of psychiatric drugs and the presence of a comorbid autoimmune disorder. Among the initial participants, 198 patients completed the questionnaires, of whom 46 were male (23%), and 150 were female (76%). Two participants did not report the gender (1%). The age range of the participants was 15 - 61 years (mean age in years of 32.67, SD = 7.08). In terms of marital status, 83 participants were single (42%), 110 were married (66%), and 5 did not report their marital status (2%). In addition, 3 participants did not complete one of the questionnaires, so they were excluded from the analysis. The present research was approved by the Ethics Committee of Shiraz University of Medical Sciences. The objectives of the research were explained to the participants, and after obtaining informed consent, the measures of the study were administered.

3.2. Measurement

3.2.1. Cognitive Fusion Questionnaire-Chronic Illness

The original 7-item CFQ-CI assesses cognitive fusion in patients with chronic illness. CFQ-CI was designed based on CFQ (23). The items are based on a Likert-type scale ranging from “totally incorrect” to “totally correct.” Higher scores indicate higher cognitive fusion. CFQ-CI has good psychometric properties (29). CFQ is suitable for adolescents as well (31). The Iranian original version of the CFQ has good reliability (eg, Cronbach α = 0.86; test-retest r = 0.86) and validity (eg, r = 0.66 and 0.48 when correlated with the Acceptance and Action Questionnaire–second version [AAQ-II] and the Social Interaction Anxiety Scale [SIAS], respectively) (28). Present questions were modified based on the original Persian version to match the Chronic Illness version (for example, “I tend to get very entangled in my thoughts” to “I tend to get very entangled in my thoughts about my illness and/or symptoms).

3.2.2. The Self-compassion Scale

The 26-item version of the Self-compassion Scale (SCS) assesses the following aspects of self-compassion: human commonalities vs isolation, self-kindness vs self-judgment, and mindfulness vs over-identification. SCS items are rated on a Likert-type Scale ranging from “almost never” to “almost always.” Higher scores show higher levels of self-compassion (32). SCS is suitable for adolescents as well (33). SCS has good reliability (eg, Cronbach α = 0.78) and validity (eg, r = -0.36 when correlated with the Spielberger State-Trait Anxiety Inventory [STAI] and 6-factor structure) in Iran (34).

3.2.3. Beck Depression Inventory-Second Edition

The Beck Depression Inventory-Second edition (BDI-II) has 21 items assessing mental and physical symptoms of depression; items range from the absence of depression symptoms to the presence of depression, and the total score ranges from 0 to 63 (35). BDI-II is suitable for adolescents as well (36). BDI-II has good reliability (eg, test-retest r = 0.93) and validity (eg, r = -0.87 when correlated with the Brief Symptom Inventory [BSI]) in Iran (37).

3.2.4. Social Phobia and Anxiety Inventory

The Social Phobia and Anxiety Inventory (SPAI) has 45 items assessing the symptoms of social phobia and agoraphobia. The items are rated on a 7-point Likert-type scale, ranging from “never” to “always.” Turner et al. reported a test-retest reliability of 0.86 for the scale (38). SPAI is suitable for adolescents as well (39). SPAI has good reliability (eg, Cronbach α = 0.99; test-retest r = 0.95) and validity (eg, r = 0.86 when correlated with the social anxiety) in Iran (40). In the present study, 32 items of the SPAI related to social phobia were used.

4. Results

All CFQ-CI items had normal limits skew and kurtosis (skew values < 3 and absolute kurtosis values < 8). Moreover, corrected item-total correlations (CITCs) were satisfactory. Exploratory factor analysis (EFA) was conducted using the principal components analysis with Varimax rotation. The values of the KMO coefficient (0.92) and Bartlett’s test of sphericity (930.278, P < .001) provided sufficient evidence to conduct EFA. The results revealed CFQ-CI as a general factor. The eigenvalue greater than 1.0 was used to determine the number of factors; the results showed that the questionnaire explained 68.61% of the variance of the respective variable (eigenvalue = 4.80). Examination of the scree plot also confirmed the presence of 1 factor. Communalities and factor loadings are presented in Table 1. Communalities were acceptable.

Table 1.

Item Means and Exploratory Factor Analysis Loadings for the Cognitive Fusion Questionnaire-Chronic Illness

ItemsSkewKurtosisCITCFactor loadingCommunality
My thoughts about my illness cause me distress or emotional pain -0.45-0.980.650.890.89
Get so caught up in thoughts about my illness that I am unable to do the things that I most want to do 0.14-1.340.850.870.87
Over-analyze situations associated with my illness to the point where it is unhelpful to me 0.14-1.360.720.840.84
I struggle with my thoughts about my illness and/or symptoms0.16-1.350.810.830.83
I get upset with myself for having certain thoughts about my illness-0.10-1.380.730.800.80
I tend to get very entangled in my thoughts relating to my illness and/or symptoms0.45-1.130.770.790.79
It is such a struggle to let go of upsetting thoughts about my illness, even when I know that letting go would be helpful0.20-1.380.770.730.73
Eigenvalue4.80
Percentage of variance explanation68.61

A Cronbach α of 0.92 was found for CFQ-CI, indicating a good level of internal consistency (Table 2). Table 3 shows the correlations between CFQ-CI and other measures. There was a negative, significant association between CFQ-CI and SCS and its subscales. In addition, CFQ-CI was positively correlated with BDI-II and SPAI.

Table 2.

Internal Consistency and Other Psychometric Indices of Items of Cognitive Fusion Questionnaire-Chronic Illness

ItemsValues aCorrelated Whole CorrectionCronbach α by Removing QuestionsScale’s Mean Score with Deleted ItemsSquared Multiple Correlation
14.51 ± 2.030.650.9221.560.46
23.62 ± 2.120.850.9022.440.73
33.60 ± 2.160.720.9122.460.55
43.66 ± 2.170.810.9022.400.67
53.99 ± 2.180.730.9122.070.54
63.09 ± 2.030.770.9122.970.64
73.60 ± 2.200.770.9122.460.61

Abbreviation: CITC, corrected item-total correlations.

a Values are expressed as mean ± SD.

Table 3.

Correlations Between CFQ-IC and Other Constructsa

VariablesCFQ
Compassion-0.49**
Kindness-0.23**
Judgment-0.41**
Human commonalities-0.25**
Isolation-0.41**
Mindfulness-0.22**
Over-identification-0.40**
Depression0.54**
Social phobia0.50**

a **P < 0.01, *P < 0.05.

5. Discussion

The aim of the current study was to examine the validity and reliability of the Persian version of CFQ-CI in MS patients. The results of EFA revealed a 1-factor structure. This finding is consistent with the original version showing the 1-factor structure in patients with IBD (29). Given the nature of the medical illness, we used EFA, the results of which were largely in line with our predictions. These studies confirmed the definition of proposed cognitive fusion (23) in MS patients. In other words, the 1-factor structure of CFQ-CI in non-clinical English-speaking populations, populations with mental disorders, and Portuguese patients with IBD is also applicable to the Iranian population. It shows the thoughts related to the patients’ experiences of MS symptoms and MS as a chronic disorder.

The internal consistency of CFQ-CI, assessed by the Cronbach α coefficient, was found to be good. This finding agrees with our predictions and the findings of the original version (29), reporting high internal consistency estimates. However, in contrast to the results of IBD (29), test-retest reliability was not assessed in the present study.

CFQ-CI was positively related to depression and social anxiety symptoms and negatively related to SCS and its subscales. These results are consistent with the original version (29), showing the concurrent validity of CFQ-CI. The results showed a significant relationship of CFQ-IC with symptoms of IBD, psychological flexibility, chronic illness-related shame (CISS), and brooding (29). However, for the first time, we used the self-compassion construct to assess validity.

The results of the present study have clinical and theoretical applications. From the theoretical viewpoint, cognitive fusion is an important construct in ACT; the results of our factor analysis were consistent with those of non-clinical populations, patients with mental disorders, and patients with IBD. This provides early evidence of the extent of cognitive fusion in Iranian patients with MS. From the clinical viewpoint, our results can have implications for MS patients, and the questionnaire can be used to assess and monitor cognitive fusion during ACT.

This is the first study to assess the psychometric properties of CFQ-CI in MS patients; this can be seen as a strength of the present study. However, it also had some limitations. First, the data were collected using self-report questionnaires, which are vulnerable to certain biases. Second, a cross-sectional, descriptive design was used that cannot show causation. Third, we could only assess some types of validity and reliability. Therefore, further studies should be conducted to confirm the overall structure of the questionnaire, determine its association with other constructs, and assess the stability over time. Fourth, we did not use random sampling. Finally, the data were collected during the COVID-19 pandemic; therefore, due to fear of contracting COVID-19, some patients might avoid going to clinics, limiting the generalizability of our findings. Future studies are suggested to examine the association of CFQ-CI with symptoms of MS, other chronic illnesses, and related constructs in ACT, as well as to assess the test-retest reliability of CFQ-CI in MS patients.

5.1. Conclusions

Overall, the results of the present study confirm the validity and reliability of CFQ-CI in MS patients, and it can be concluded that the questionnaire can be used for research or clinical purposes in this group of patients.

References

  • 1.

    Calabresi PA. Diagnosis and management of multiple sclerosis. Am Fam Physician. 2004;70(10):1935-44.

  • 2.

    Filippi M, Bar-Or A, Piehl F, Preziosa P, Solari A, Vukusic S, et al. Multiple sclerosis. Nat Rev Dis Primers. 2018;4(1):43. [PubMed ID: 30410033]. https://doi.org/10.1038/s41572-018-0041-4.

  • 3.

    Dilokthornsakul P, Valuck RJ, Nair KV, Corboy JR, Allen RR, Campbell JD. Multiple sclerosis prevalence in the United States commercially insured population. Neurology. 2016;86(11):1014-21. [PubMed ID: 26888980]. [PubMed Central ID: PMC4799713]. https://doi.org/10.1212/WNL.0000000000002469.

  • 4.

    Azami M, YektaKooshali MH, Shohani M, Khorshidi A, Mahmudi L. Epidemiology of multiple sclerosis in Iran: A systematic review and meta-analysis. PLoS One. 2019;14(4). e0214738. [PubMed ID: 30964886]. [PubMed Central ID: PMC6456231]. https://doi.org/10.1371/journal.pone.0214738.

  • 5.

    Siegert RJ, Abernethy DA. Depression in multiple sclerosis: a review. J Neurol Neurosurg Psychiatry. 2005;76(4):469-75. [PubMed ID: 15774430]. [PubMed Central ID: PMC1739575]. https://doi.org/10.1136/jnnp.2004.054635.

  • 6.

    Chwastiak LA, Ehde DM. Psychiatric issues in multiple sclerosis. Psychiatr Clin North Am. 2007;30(4):803-17. [PubMed ID: 17938046]. [PubMed Central ID: PMC2706287]. https://doi.org/10.1016/j.psc.2007.07.003.

  • 7.

    Marrie RA, Reingold S, Cohen J, Stuve O, Trojano M, Sorensen PS, et al. The incidence and prevalence of psychiatric disorders in multiple sclerosis: a systematic review. Mult Scler. 2015;21(3):305-17. [PubMed ID: 25583845]. [PubMed Central ID: PMC4429164]. https://doi.org/10.1177/1352458514564487.

  • 8.

    Karimi S, Andayeshgar B, Khatony A. Prevalence of anxiety, depression, and stress in patients with multiple sclerosis in Kermanshah-Iran: a cross-sectional study. BMC Psychiatry. 2020;20(1):166. [PubMed ID: 32295564]. [PubMed Central ID: PMC7161227]. https://doi.org/10.1186/s12888-020-02579-z.

  • 9.

    Jose Sa M. Psychological aspects of multiple sclerosis. Clin Neurol Neurosurg. 2008;110(9):868-77. [PubMed ID: 18022759]. https://doi.org/10.1016/j.clineuro.2007.10.001.

  • 10.

    Mohr DC, Goodkin DE, Likosky W, Gatto N, Baumann KA, Rudick RA. Treatment of depression improves adherence to interferon beta-1b therapy for multiple sclerosis. Arch Neurol. 1997;54(5):531-3. [PubMed ID: 9152109]. https://doi.org/10.1001/archneur.1997.00550170015009.

  • 11.

    Amato MP, Ponziani G, Rossi F, Liedl CL, Stefanile C, Rossi L. Quality of life in multiple sclerosis: the impact of depression, fatigue and disability. Mult Scler. 2001;7(5):340-4. [PubMed ID: 11724451]. https://doi.org/10.1177/135245850100700511.

  • 12.

    Sesel AL, Sharpe L, Naismith SL. Efficacy of Psychosocial Interventions for People with Multiple Sclerosis: A Meta-Analysis of Specific Treatment Effects. Psychother Psychosom. 2018;87(2):105-11. [PubMed ID: 29518781]. https://doi.org/10.1159/000486806.

  • 13.

    Phyo AZZ, Demaneuf T, De Livera AM, Jelinek GA, Brown CR, Marck CH, et al. The Efficacy of Psychological Interventions for Managing Fatigue in People With Multiple Sclerosis: A Systematic Review and Meta-Analysis. Front Neurol. 2018;9:149. [PubMed ID: 29670565]. [PubMed Central ID: PMC5893652]. https://doi.org/10.3389/fneur.2018.00149.

  • 14.

    Graham CD, Gouick J, Krahe C, Gillanders D. A systematic review of the use of Acceptance and Commitment Therapy (ACT) in chronic disease and long-term conditions. Clin Psychol Rev. 2016;46:46-58. [PubMed ID: 27176925]. https://doi.org/10.1016/j.cpr.2016.04.009.

  • 15.

    Sheppard SC, Forsyth JP, Hickling EJ, Bianchi J. A Novel Application of Acceptance and Commitment Therapy for Psychosocial Problems Associated with Multiple Sclerosis. Int J MS Care. 2010;12(4):200-6. https://doi.org/10.7224/1537-2073-12.4.200.

  • 16.

    Nordin L, Rorsman I. Cognitive behavioural therapy in multiple sclerosis: a randomized controlled pilot study of acceptance and commitment therapy. J Rehabil Med. 2012;44(1):87-90. [PubMed ID: 22234322]. https://doi.org/10.2340/16501977-0898.

  • 17.

    Pakenham KI, Ryan A, Mawdsley M, Brown F. Evaluation of an ACT resilience training program (READY) for people with MS or diabetes. Association for Contextual Behavioral Science 12th World Conference. Minneapolis. 2014. p. 18-22.

  • 18.

    Graham CD, Simmons Z, Stuart SR, Rose MR. The potential of psychological interventions to improve quality of life and mood in muscle disorders. Muscle Nerve. 2015;52(1):131-6. [PubMed ID: 25297932]. https://doi.org/10.1002/mus.24487.

  • 19.

    Hayes SC, Strosahl KD, Wilson KG. Acceptance and commitment therapy: An experiential approach to behavior change. Guilford Press. 1999.

  • 20.

    Hayes SC, Levin ME, Plumb-Vilardaga J, Villatte JL, Pistorello J. Acceptance and commitment therapy and contextual behavioral science: examining the progress of a distinctive model of behavioral and cognitive therapy. Behav Ther. 2013;44(2):180-98. [PubMed ID: 23611068]. [PubMed Central ID: PMC3635495]. https://doi.org/10.1016/j.beth.2009.08.002.

  • 21.

    Bardeen JR, Fergus TA. The interactive effect of cognitive fusion and experiential avoidance on anxiety, depression, stress and posttraumatic stress symptoms. J Contextual Behavioral Sci. 2016;5(1):1-6. https://doi.org/10.1016/j.jcbs.2016.02.002.

  • 22.

    Cookson C, Luzon O, Newland J, Kingston J. Examining the role of cognitive fusion and experiential avoidance in predicting anxiety and depression. Psychol Psychother. 2020;93(3):456-73. [PubMed ID: 30994261]. https://doi.org/10.1111/papt.12233.

  • 23.

    Gillanders DT, Bolderston H, Bond FW, Dempster M, Flaxman PE, Campbell L, et al. The development and initial validation of the cognitive fusion questionnaire. Behav Ther. 2014;45(1):83-101. [PubMed ID: 24411117]. https://doi.org/10.1016/j.beth.2013.09.001.

  • 24.

    Ferenbach C. Process of psychological adjustment to multiple sclerosis: comparing the roles of appraisals, acceptance, and cognitive fusion. The University of Edinburgh; 2011.

  • 25.

    Valvano A, Floyd RM, Penwell-Waines L, Stepleman L, Lewis K, House A. The relationship between cognitive fusion, stigma, and well-being in people with multiple sclerosis. J Contextual Behavioral Sci. 2016;5(4):266-70. https://doi.org/10.1016/j.jcbs.2016.07.003.

  • 26.

    Guzman A, Gillanders D, Stevenson A, Ross K. Psychosocial adjustment to Mild Cognitive Impairment: The role of illness perceptions, cognitive fusion and cognitive impairment. Dementia (London). 2021;20(2):464-84. [PubMed ID: 31948271]. https://doi.org/10.1177/1471301219893862.

  • 27.

    Pakenham KI, Mawdsley M, Brown FL, Burton NW. Pilot evaluation of a resilience training program for people with multiple sclerosis. Rehabil Psychol. 2018;63(1):29-42. [PubMed ID: 29154558]. https://doi.org/10.1037/rep0000167.

  • 28.

    Soltani E, Momenzadeh S, Hoseini SZ, Bahrainian SA. [Psychometric properties of the cognitive fusion questionnaire]. Pajoohande. 2016;21(5):290-7. Persian.

  • 29.

    Trindade IA, Ferreira C, Pinto-Gouveia J. Assessment of Chronic Illness-Related Cognitive Fusion: Preliminary Development and Validation of a New Scale with an IBD Sample. J Clin Psychol Med Settings. 2018;25(4):356-66. [PubMed ID: 29460106]. https://doi.org/10.1007/s10880-017-9536-5.

  • 30.

    Plichta SB, Kelvin EA, Munro BH. 6th ed, editor. Munro s statistical methods for health care research. Wolters Kluwer Health/Lippincott Williams & Wilkins; 2013.

  • 31.

    Solé E, Racine M, Castarlenas E, de la Vega R, Tomé-Pires C, Jensen M, et al. The Psychometric Properties of the Cognitive Fusion Questionnaire in Adolescents. Europ J Psychol Assessment. 2016;32(3):181-6. https://doi.org/10.1027/1015-5759/a000244.

  • 32.

    Neff KD. The Development and Validation of a Scale to Measure Self-Compassion. Self Identity. 2003;2(3):223-50. https://doi.org/10.1080/15298860309027.

  • 33.

    Cunha M, Xavier A, Castilho P. Understanding self-compassion in adolescents: Validation study of the Self-Compassion Scale. Personal Indiv Diff. 2016;93:56-62. https://doi.org/10.1016/j.paid.2015.09.023.

  • 34.

    Azizi A, Mohammadkhani P, Lotfi S, Bahramkhani M. [The validity and reliability of the Iranian version of the Self-Compassion Scale]. Practice Clinical Psychol. 2013;1(3):149-55. Persian.

  • 35.

    Beck AT, Steer RA, Brown G. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation; 1996.

  • 36.

    Dolle K, Schulte-Korne G, O'Leary AM, von Hofacker N, Izat Y, Allgaier AK. The Beck depression inventory-II in adolescent mental health patients: cut-off scores for detecting depression and rating severity. Psychiatry Res. 2012;200(2-3):843-8. [PubMed ID: 22657953]. https://doi.org/10.1016/j.psychres.2012.05.011.

  • 37.

    Dobson KS, Mohammadkhani P. [Psychometric characteristics of Beck Depression Inventory-II in patients with major depressive disorder]. J Rehabil. 2007;8(2):80-6. Persian.

  • 38.

    Turner SM, Beidel DC, Dancu CV, Stanley MA. An empirically derived inventory to measure social fears and anxiety: The Social Phobia and Anxiety Inventory. Psychol Assessment: J Consult Clin Psychol. 1989;1(1):35-40. https://doi.org/10.1037/1040-3590.1.1.35.

  • 39.

    Clark DB, Turner SM, Beidel DC, Donovan JE, et A. Reliability and validity of the Social Phobia and Anxiety Inventory for adolescents. Psychol Assessment. 1994;6(2):135-40. https://doi.org/10.1037/1040-3590.6.2.135.

  • 40.

    Bolandnazar K. Normalization SPAI test in students [Thesis]. Mashhad: Ferdowsi University; 2011.