A Psychometric Evaluation of Iranian Version of the Responses to Positive Affect (RPA) Questionnaire

authors:

avatar Imaneh Abasi 1 , avatar Gregory Feldman 2 , avatar Shirin Farazmand 3 , avatar Abbas Pourshahbaz ORCID 3 , * , avatar Mohammad Ebrahim Sarichloo 3

Department of Clinical Psychology, Taleghani Educational Hospital, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Department of Psychology, Simmons University, Boston, MA, USA
Department of Clinical Psychology, University of Social Welfare and Rehabilitation Sciences, Tehran, Iran

how to cite: Abasi I, Feldman G, Farazmand S, Pourshahbaz A, Sarichloo M E. A Psychometric Evaluation of Iranian Version of the Responses to Positive Affect (RPA) Questionnaire. Iran J Psychiatry Behav Sci. 2018;12(4):e11923. https://doi.org/10.5812/ijpbs.11923.

Abstract

Background:

Despite the existence of the large body of studies demonstrating cognitive responses to negative mood, cognitive responses to positive mood have received relatively less attention.

Objectives:

The aim of the present study was to investigate the psychometric properties of the Responses to Positive Affect (RPA) questionnaire in Iranian population.

Methods:

Using purposive sampling and a cross-sectional design, 499 participants of a community sample of Tehran, Iran during 2016 - 2017 responded to RPA, Ruminative Response Scale, Beck Depression Inventory, Social Interaction Anxiety Scale, and Generalized Anxiety Disorder 7-item scale. Data was analyzed using SPSS 23 and AMOS 23.

Results:

Exploratory factor analysis yielded 2 factors (positive rumination and dampening) which accounted for 47.84% of the total variance. Confirmatory factor analysis results showed a very good fit to the data as χ2 = 135.51, df = 82, χ2/df = 1.65, P < 0.001, CFI = 0.98, GFI = 0.97, RMSEA = 0.03. Results of convergent validity showed that there are significant negative correlations between positive rumination and reflection, depression and generalized anxiety symptoms and significant positive correlations between dampening and brooding, reflection, depression, social phobia and generalized anxiety symptoms. Results of incremental validity analyses revealed that RPA subscales accounted for significant variance in depressive symptoms above and beyond brooding and reflection. Test retest reliability of positive rumination and dampening were 0.81 and 0.83, respectively.

Conclusions:

Responses to Positive Affect questionnaire demonstrates acceptable validity and reliability in Iranian population. Further research is needed to assess RPA in various clinical samples.

1. Background

Emotion regulation is increasingly being investigated through various lines of research with special attention paid to its role in psychopathology (1, 2). Emotion regulation is defined as processes by which people influence the types of emotions they have, when they experience them, and how they experience and express these emotions (3). Relative to negative emotion, positive emotion has received little attention; however, research in this area is expanding (4, 5). According to broaden-and-build theory of positive emotions, positive emotions broaden thought-action repertoires, undo lingering negative emotions, fuel psychological resiliency, and trigger upward spirals toward improved emotional well-being (6). Moreover, people report more life satisfaction in countries where people pay special attention to positive emotions and their values (7). Also, physiological changes accompanying positive emotion have promising effects on health (8) and performance (9).

The tripartite model has emphasized the low level of positive affectivity as a distinguished factor related primarily to depression (10). Positive affectivity is not solely linked to depression, but evidence shows consistent negative relations to social anxiety (11), generalized anxiety disorder (12), and mania/hypomania (13). Recent research development in the field of positive emotion has paid particular attention to responses to positive emotion or positive emotion regulation strategies (14, 15). A number of positive emotion regulation strategies have been linked to psychopathology, including dampening which is defined as a tendency to reduce the intensity and duration of positive mood state. Also positive rumination is defined as a tendency to respond to positive affect states with recurrent thoughts and mentally reflecting on positive self-qualities and positive experiences and memories (16).

Responses to Positive Affect (RPA) questionnaire was developed by Feldman and colleagues to evaluate the responses to positive mood. RPA questionnaire is a self-report 17- item measure that evaluates rumination on positive moods and dampening. RPA measure is parallel to the Response Style Questionnaire (RSQ) (17) which assesses rumination on negative content. Exploratory factor analysis yielded three factors, two of which reflected forms of rumination on positive experience which are called self-focus rumination and emotion-focus rumination and the third factor reflected a tendency to down-regulate positive mood which is called dampening. Results supported acceptable internal consistency for three factors of the RPA questionnaire. Furthermore, confirmatory factor analysis using structural equation modeling suggested that a three-factor model would provide a better fit for the data than alternative models (16). Studies on Dutch (18) and Swedish (19) versions of the RPA questionnaire have replicated the three factor model using EFA and CFA with adequate internal consistency for subscales; however, there were some discrepancies between these two studies about some items loading on self-focus and emotion focus rumination. In contrast, one study identified a two-factor solution in a Korean-speaking sample (20). Furthermore, some studies have found that differences between model fit indices for two- and three-factor model are absent or small (21, 22). Given the very high correlation between the two factors of positive rumination, these authors recommend the use of a single positive rumination score for the sake of empirical and conceptual parsimony.

In research on the convergent validity of the RPA questionnaire (16, 18, 19), self-focused positive rumination, emotion focused rumination, and dampening are associated with self-esteem, manic, depression and anxiety symptoms in non-clinical samples of adults (23).Given the several lines of evidence indicating the role of positive emotion in the etiology and maintenance of emotional disorders and contributing role of positive emotion regulation in psychopathology and treatment, there is a great need for a measure that assesses RPA in Iranian population. Furthermore, as indicated in previous mentioned studies, there are some discrepancies between studies assessing factor structure of RPA questionnaire (22).

2. Objectives

The aims of the present study are to evaluate the factor structure of the Iranian version of the RPA questionnaire using EFA and CFA and to evaluate convergent validity, incremental validity, and stability of RPA questionnaire using SPSS-23 and AMOS-23 in Iranian population.

3. Materials and Methods

3.1. Participants

The present study is a cross-sectional one. Participants were recruited from the metropolitan Tehran, Iran community through purposive sampling method in public places during 2016 - 2017. Assessors were two psychologist with master degree who were present in public places like markets, cafe, etc. and asked individuals who had at least 1 hour of free time to answer to questions. Participants were selected according to these criteria: (1) age range of 18 to 50, (2) being willing to participate in study, (3) literate enough to understand the concepts of questionnaire battery. It is been recommended to have 20 participants for each item and as our questionnaire has 17 items and considering the attrition, almost 500 participants were calculated for sample size (24). Five hundred and twenty individuals agreed to respond to a packet of questionnaires. After screening the data, 499 participants (male = 44.7%, female = 55.3%) with a mean age of 34.81 (SD = 10.48) were obtained. In terms of marital status, 32.7% were identified as single, 64.5% were identified as married, and 2.8% were identified as divorced. In terms of education level, 10.6% were identified as under diploma (did not graduate from secondary school), 45.1%, 29.5%, 11.8%, and 3% were identified as diploma, bachelor degree, master degree, and doctoral degree respectively.

3.2. Measures

3.2.1. Responses to Positive Affect Questionnaire

RPA is a self-report 17-item questionnaire that is rated on a 4 point Likert scale from 1 (almost never) to 4 (almost always). EFA has demonstrated 3 factors (emotion-focus, dampening, and self-focus). Internal consistency for subscales has been reported to be 0.76, 0.79, and 0.73 respectively (16).

3.2.2. Ruminative Response Scale (RRS)

RRS was developed by Nolen-Hoeksema in 1991. RRS is a 22 item self-report questionnaire that is rated on a 4 point Likert scale from 1 (almost never) to 4 (almost always) and assesses rumination (25). Internal consistency (α = 0.89) and 5 month test retest reliability have been reported acceptable (26). Internal consistency of reflection (5 items) and brooding (5 items) in present research are as 0.75 and 0.76 respectively.

3.2.3. Beck Depression Inventory (BDI-II)

BDI was developed by Beck, Steer, and Garbin in 1988. BDI is a self-report 21-item questionnaire that is rated on a 4 point Likert scale from 0 to 3 and assesses severity of depression symptoms (27). Internal consistency of BDI is reported as 0.86 in psychiatric populations and 0.81 in non-psychiatric populations. Test-retest reliability is also reported as r = 0.86 (27). Internal consistency of BDI in present study is 0.91.

3.2.4. Social Interaction Anxiety Scale (SIAS)

SIAS was developed by Heimberg, Mueller, Holt, Hope and, Liebowitz in 1992. SIAS is a 20-item self-report questionnaire which is rated on a 5 Likert scale from 0 (not at all) to 4 (extremely) and assesses severity of social anxiety disorder (28). Internal consistency of SIAS in social phobia sample, community sample, and undergraduate sample has been reported to be 0.86, 0.95, and 0.85 respectively (28). Internal consistency of SIAS in present study is 0.91.

3.2.5. Generalized Anxiety Disorder 7-Item Scale (GAD-7)

GAD-7 was developed by Spitzer, Kroenke, Williams, Lowe in 2006. GAD-7 is a self-report 7-item scale that is rated on a 4 point Likert scale from 0 (not at all sure) to 3 (nearly every day) and assesses severity of generalized anxiety disorder (29). Internal consistency and test-retest reliability have been reported to be α = 0.92 and r = 0.83 respectively (29). Internal consistency of GAD-7 in present research is α = 0.89.

3.3. Procedure

Before administrating the questionnaire, permission was obtained from the first author of the RPA scale development study (16).Then the questionnaire was translated into Persian, and after that from Persian to English by a bilingual who is expert in English language. Then, the two forms of the original RPA and the translated one were compared by another person who is adept at the English language. Next, the translated questionnaire was edited according to feedback. The final translated RPA questionnaire was reviewed and approved by three university professors familiar with the responses to affect and mood concept. After preparation of the Iranian RPA, at first, the questionnaire was given to 50 individuals living in Tehran in order to assess the concept and initial reliability of the scale. After preparation of final transcription, the study participants were recruited and informed about the goal of study, assured that their responses would be confidential, and told that their participation was voluntary. Then, the participants completed the questionnaire package consisting of all study questionnaires. Inclusion criteria were adults habitants of Tehran, being eager for participating in the study, being in the age range of 18 - 55 and individuals who did not meet these criteria were excluded.

3.4. Data Analysis

Before analyzing the data, normality (Table 2) and nonexistence of outliers’ assumptions were met. Exploratory factor analysis and confirmatory factor analysis were conducted to assess the factor structure of RPA. Bivariate correlation, partial correlation, and regression analysis were conducted to evaluate convergent and incremental validity and test-retest reliability of RPA. Internal consistency of the scale was evaluated using Chronbach alpha. SPSS-23 and AMOS 23 were used for analyzing the data.

4. Results

4.1. Exploratory Factor Analysis

Exploratory principal axis factor analyses with oblique rotation were selected. Item 6 (…think “This is too good to be true.”) loaded on all factors and its loadings was less than 0.3, thus it was eliminated from the scale. It is noteworthy that this item, which may reflect an English-language idiom, has also failed to load consistently on the dampening scale in analyses of both Korean (20) and Dutch (22) versions of the RPA where the item has also been eliminated. Exploratory factor analyses were performed on remaining items. A solution emerged that accounted for 47.84% of the total variance (Table 1). This model contained 2 factors (positive rumination and dampening) with eigenvalues greater than 1. The Kaiser-Meyer-Olkin value was 0.87, which exceeds the recommended value of 0.6 (30). Bartlett’s test of sphericity reached statistical significance and further supported the factorability of the correlation matrix (31). The internal consistency for each scale was acceptable (α = 0.87 and α = 0.77 for positive rumination and dampening respectively). All item total correlations and factor loadings were above 0.30 (Table 2). The pattern of scale and factor inter correlation suggested that positive rumination and dampening are not related to each other.

Table 1.

Pattern Matrix and Corrected Item-Total Correlationsa

ItemsPositive RuminationDampeningra
1. Notice how you feel full of energy.0.68-0.20.67
2. Savour this moment.0.67-0.170.66
3. Think “I am getting everything done.”0.69-0.040.68
4. Think about how you feel up for doing everything.0.77-0.090.75
5. Think “I am living up to my potential.”0.690.0070.68
7. Think about how happy you feel.0.67-0.120.69
8. Think about how strong you feel.0.67-0.040.68
9. Think about things that could go wrong.0.10.50.51
10. Remind yourself that these feelings won’t last.-0.170.690.67
11. Think “People will think I am bragging.” 0.0060.580.59
12. Think about how hard it is to concentrate.-0.080.40.45
13. Think “I am achieving everything.”0.58-0.020.61
14. Think “I don't deserve this.”-0.120.550.65
15. Think “My streak of luck is going to end soon.”-0.190.710.67
16. Think about how proud you are of yourself.0.53-0.010.57
17. Think about the things that have not gone well for you.-0.020.560.58
Table 2.

Descriptive Statistics and Scale and Factor Intercorrelationsa

MSDSkewnessKurtosis12
1. Positive rumination27.315.64-0.42-0.48(0.87)-0.08
2. Dampening12.383.910.820.54-0.1(0.77)

4.2. Confirmatory Factor Analysis

The fit of 2-factor model in which items 1, 2, 3, 4, 5, 7, 8, 13, and 16 were loaded on positive rumination factor and items 9, 10, 11, 12, 14, 15, and 17 were loaded on dampening factor was tested. Maximum likelihood (ML) was used for estimating CFA, because this method is continuous and multivariate normal distribution like this data (32). The model showed a good fit to the data (χ2 = 367.78, df = 103, χ2/df = 3.57, P < 0.001, CFI = 0.89, GFI = 0.91, RMSEA = 0.07). The fitness of model was improved according to modification indices (Figure 1). After modification, fitness indices were as χ2 = 135.51, df = 82, χ2/df = 1.65, P < 0.001, CFI = 0.98, GFI = 0.97, RMSEA = 0.03 which all are in an acceptable domain of fitness (24). To compare the fitness of two-factor model with one-factor and three-factor ones, another two CFAs were done. Results showed an acceptable fitness for three-factor model (χ2 = 345.79, df = 101, χ2/df = 3.42, P < 0.001, CFI = 0.90, GFI = 0.91, RMSEA = 0.07), but the fitness of one-factor model was too poor (χ2 = 1054.54, df = 104, χ2/df = 10140, P < 0.001, CFI = 0.63, GFI = 0.72, RMSEA = 0.13). In the final modified model, analysis of variances of items showed that all items variances were significant except e13 which is the error of RPA12 that has the lowest loading on dampening factor.

Results of confirmatory factor analysis of RPA after modification (all paths are significant)
Results of confirmatory factor analysis of RPA after modification (all paths are significant)

4.3. Convergent Validity

Correlational results and descriptive statistics for RPA and criterion variables appear in Table 3. R2 is provided in Table 3 as an indication of the percentage of common variance between the two measures. Results of bivariate correlation showed that higher scores on positive rumination were associated with lower scores on reflection, depression (BDI) and generalized anxiety (GAD) symptoms. Higher scores on dampening were correlated with higher scores on brooding, reflection, depression, social phobia (SAD) and generalized anxiety symptoms.

To evaluate potential role of symptom contamination, partial correlation between RPA factors and criterion variables were conducted controlling for depression symptoms (Table 3). The magnitude of association between RPA factors and criterion variables were minimally affected except that the relation between positive rumination and generalized anxiety symptoms became non-significant when depression symptoms were controlled.

Table 3.

Correlations of RPA Subscales and Criterion Variables

MSDSkewnessKurtosisr (r2)pr Controlling for BDI
Positive RuminationDampeningPositive RuminationDampening
Brooding11.13.120.29-0.140.01 (0.001)0.35a (0.12)0.12a0.18a
Reflection10.853.210.28-0.40.1a (0.01)0.23a (0.05)0.18a0.13a
BDI13.7210.8810.560.2a (0.04)0.39a (0.15)--
SIAS21.6713.60.710.130.15a (0.02)0.36a (0.13)0.14a0.22a
GAD8.125.190.590.10.004 (0.001)0.31a (0.09)-0.060.12a

4.4. Incremental Validity

The goal of this analysis was to assess whether RPA subscales could explain amount of variability in depression symptoms above and beyond the established construct of depressive rumination. Brooding and reflection were entered in block 1 and subscales of RPA were entered in block 2. In predicting depressive symptoms, RPA subscales predicted an additional 7% of the variance in symptoms above and beyond depressive rumination (brooding) and reflection which accounted for 29% of the variance in depressive symptoms (Table 4).

Table 4.

Summary of Hierarchical Regression Analysis for RPA Subscales, Reflection, and Brooding Predicting Depression Symptoms (BDI)

BSE BBetat∆R2
Step 10.29a
Constant-8.041.67-4.79
Brooding1.80.150.5111.68a
Reflection0.160.150.041.1
Step 20.07a
Constant-2.652.58-1.02
Brooding1.510.150.4310.007a
Reflection0.210.140.0631.48
Positive rumination-0.360.07-0.18-5.16a
Dampening0.570.1060.2055.36a

4.5. Test-Retest Reliability

In order to assess test- retest reliability, RPA was delivered to 57 of the participants in the present study after 14 days. Results of test-retest reliability were as follows: Positive rumination pre-post = 0.81, P < 0.01, and Dampening pre-post = 0.83, P < 0.01.

5. Discussion

Recent studies suggest that responses to negative emotion are not solely indicated in the etiology and maintenance of psychopathology; responses to positive emotion also play a fundamental role in this process. Consistent with these studies, the present research aimed to investigate the psychometric properties of an Iranian version of the RPA questionnaire. Using exploratory factor analyses, a 2 factor structure was obtained for the RPA questionnaire. The first factor reflected emotional/somatic and self-rumination on positive experiences and the second factor reflected dampening on positive affect. Result of CFA showed good fitness of the 2-factor and 3-factor model, and poor fitness for 1-factor model. This result is consistent with prior studies suggesting a three factor structure for the RPA questionnaire in English (16), Swedish (19), and Dutch (18); and with one study finding a two-factor solution in a Korean-speaking sample (20). Taken together, this latter study and the present study offer further support for their recommendation to score the RPA with a two-factor solution (21, 22). Because results of EFA and CFA of our study showed RPA to be a 2-factor model, it is suggested this questionnaire be considered as a 2-factor model in Iranian population. In addition, we found non-significant associations between the positive rumination and dampening subscale, a finding also consistent with prior study (22). Internal consistency of subscales was acceptable for research use (33) and also the temporal stability of the test was agreeable across a two-week period consistent with prior research assessing test-retest reliability over a 3-month (21, 23).

Tests of convergent validity largely supported the expected links between RPA subscales and depression, generalized anxiety, and social anxiety measures and these associations largely remained significant after controlling for depression symptoms (with the exception of the relationship between positive rumination and generalized anxiety symptoms). These findings are parallel to previous studies demonstrating the relationship between positive affect regulation and depression using the RPA (15). The replication of the finding that the association of dampening and anxiety symptoms remains after controlling for depression symptoms (34) highlights how the tendency to dampen positive affective experience may be a common factor that may partially account for the comorbidity of depression with both social- and generalized-anxiety disorders.

Furthermore, RPA subscales accounted for variance in current depressive symptoms above and beyond depressive rumination and reflection which are in line with previous studies reporting similar cross-sectional analyses (16, 18, 21). Previous studies have also demonstrated that subscales of the RPA prospectively predict mood disorder symptoms in non-clinical samples of adults in analyses controlling for depressive rumination (21, 23). Taken together, the present findings support the value of assessing response to positive emotions using the RPA as a predictor of depressive symptoms that is conceptually and empirically distinct from the more widely-studied measure of rumination in response to negative emotions.

The findings of present study, suggest that emphasizing and valuing the responses to positive affect and investigating their role in psychopathology is crucially helpful for more comprehensive case conceptualization in clinical settings, and planning treatment strategies to ameliorate pathological symptoms.

5.1. Limitations

It is important to acknowledge some limitations in the present findings. First, an adult community sample was used in the present study. On the one hand, this is a valuable extension of existing research on the RPA that has been largely with younger samples of college students as well as children and adolescents (22). Nonetheless, it is unclear to what extent present findings could be generalized to broader and clinical populations. Second, in this study, only a set of constructs was evaluated, and more studies are needed to take into account another variables, especially mania/hypomanic symptoms and other disorders. Third, as the present study is a cross-sectional one, it cannot tease apart causality in the relationships of study variables.

5.2. Conclusion

The results of the present study offer preliminary evidence of the reliability and validity of the RPA in a Persian speaking sample. The availability of such a measure can facilitate more culturally-diverse research on positive emotion regulation. The present study also contributes new findings to the on-going discussion in the literature about the factor structure of the RPA and its correlates in samples representing previously underrepresented age groups and cultural backgrounds.

Acknowledgements

References

  • 1.

    Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: A meta-analytic review. Clin Psychol Rev. 2010;30(2):217-37. [PubMed ID: 20015584]. https://doi.org/10.1016/j.cpr.2009.11.004.

  • 2.

    Potthoff S, Garnefski N, Miklosi M, Ubbiali A, Dominguez-Sanchez FJ, Martins EC, et al. Cognitive emotion regulation and psychopathology across cultures: A comparison between six European countries. Pers Indiv Differ. 2016;98:218-24. https://doi.org/10.1016/j.paid.2016.04.022.

  • 3.

    Gross JJ. Emotion regulation: Conceptual and empirical foundations. Handbook of emotion regulation. 2nd ed. 2014. p. 3-20.

  • 4.

    Garland EL, Farb NA, Goldin P, Fredrickson BL. Mindfulness Broadens Awareness and Builds Eudaimonic Meaning: A Process Model of Mindful Positive Emotion Regulation. Psychol Inq. 2015;26(4):293-314. [PubMed ID: 27087765]. [PubMed Central ID: PMC4826727]. https://doi.org/10.1080/1047840X.2015.1064294.

  • 5.

    Kalokerinos EK, Greenaway KH, Denson TF. Reappraisal but not suppression downregulates the experience of positive and negative emotion. Emotion. 2015;15(3):271-5. [PubMed ID: 25286074]. https://doi.org/10.1037/emo0000025.

  • 6.

    Fredrickson BL. The broaden-and-build theory of positive emotions. Phil Trans Biol Sci. 2004;359(1449):1367-77. https://doi.org/10.1098/rstb.2004.1512.

  • 7.

    Bastian B, Kuppens P, De Roover K, Diener E. Is valuing positive emotion associated with life satisfaction? Emotion. 2014;14(4):639-45. [PubMed ID: 24749643]. https://doi.org/10.1037/a0036466.

  • 8.

    Dockray S, Steptoe A. Positive affect and psychobiological processes. Neurosci Biobehav Rev. 2010;35(1):69-75. [PubMed ID: 20097225]. [PubMed Central ID: PMC2895001]. https://doi.org/10.1016/j.neubiorev.2010.01.006.

  • 9.

    Garland EL, Fredrickson B, Kring AM, Johnson DP, Meyer PS, Penn DL. Upward spirals of positive emotions counter downward spirals of negativity: Insights from the broaden-and-build theory and affective neuroscience on the treatment of emotion dysfunctions and deficits in psychopathology. Clin Psychol Rev. 2010;30(7):849-64. [PubMed ID: 20363063]. [PubMed Central ID: PMC2908186]. https://doi.org/10.1016/j.cpr.2010.03.002.

  • 10.

    Watson D. Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V. J Abnorm Psychol. 2005;114(4):522-36. [PubMed ID: 16351375]. https://doi.org/10.1037/0021-843X.114.4.522.

  • 11.

    Taylor CT, Bomyea J, Amir N. Malleability of attentional bias for positive emotional information and anxiety vulnerability. Emotion. 2011;11(1):127-38. [PubMed ID: 21401232]. [PubMed Central ID: PMC3208375]. https://doi.org/10.1037/a0021301.

  • 12.

    Turk CL, Heimberg RG, Luterek JA, Mennin DS, Fresco DM. Emotion dysregulation in generalized anxiety disorder: A comparison with social anxiety disorder. Cognit Ther Res. 2005;29(1):89-106. https://doi.org/10.1007/s10608-005-1651-1.

  • 13.

    Edge MD, Miller CJ, Muhtadie L, Johnson SL, Carver CS, Marquinez N, et al. People with bipolar I disorder report avoiding rewarding activities and dampening positive emotion. J Affect Disord. 2013;146(3):407-13. [PubMed ID: 23021378]. [PubMed Central ID: PMC3557770]. https://doi.org/10.1016/j.jad.2012.07.027.

  • 14.

    Carl JR, Soskin DP, Kerns C, Barlow DH. Positive emotion regulation in emotional disorders: A theoretical review. Clin Psychol Rev. 2013;33(3):343-60. [PubMed ID: 23399829]. https://doi.org/10.1016/j.cpr.2013.01.003.

  • 15.

    Nelis S, Holmes EA, Raes F. Response styles to positive affect and depression: Concurrent and prospective associations in a community sample. Cognit Ther Res. 2015;39(4):480-91. [PubMed ID: 26229213]. [PubMed Central ID: PMC4516901]. https://doi.org/10.1007/s10608-015-9671-y.

  • 16.

    Feldman GC, Joormann J, Johnson SL. Responses to positive affect: A self-report measure of rumination and dampening. Cognit Ther Res. 2008;32(4):507-25. [PubMed ID: 20360998]. [PubMed Central ID: PMC2847784]. https://doi.org/10.1007/s10608-006-9083-0.

  • 17.

    Nolen-Hoeksema S, Morrow J. A prospective study of depression and posttraumatic stress symptoms after a natural disaster: The 1989 Loma Prieta earthquake. J Pers Soc Psychol. 1991;61(1):115-21. [PubMed ID: 1890582].

  • 18.

    Raes F, Daems K, Feldman GC, Johnson SL, Van Gucht D. A psychometric evaluation of the Dutch version of the responses to positive affect questionnaire. Psychol Belg. 2010;49(4):293. https://doi.org/10.5334/pb-49-4-293.

  • 19.

    Olofsson ME, Boersma K, Engh J, Wurm M. A psychometric evaluation of the Swedish version of the responses to positive affect questionnaire. Nord J Psychiatry. 2014;68(8):588-93. [PubMed ID: 24724927]. https://doi.org/10.3109/08039488.2014.898792.

  • 20.

    Bin-Na K, Seok-Man K. Preliminary validation of Korean-responses to positive affect (K-RPA). Kor J Clin Psychol. 2014;33(2):243-60. https://doi.org/10.15842/kjcp.2014.33.2.002.

  • 21.

    Bijttebier P, Raes F, Vasey MW, Feldman GC. Responses to positive affect predict mood symptoms in children under conditions of stress: A prospective study. J Abnorm Child Psychol. 2012;40(3):381-9. [PubMed ID: 21984180]. https://doi.org/10.1007/s10802-011-9579-2.

  • 22.

    Nelis S, Luyckx K, Feldman G, Bastin M, Raes F, Bijttebier P. Assessing response styles to positive affect: One or two dimensions of positive rumination in the responses to positive affect questionnaire? Pers Indiv Differ. 2016;89:40-6. https://doi.org/10.1016/j.paid.2015.09.031.

  • 23.

    Raes F, Smets J, Nelis S, Schoofs H. Dampening of positive affect prospectively predicts depressive symptoms in non-clinical samples. Cogn Emot. 2012;26(1):75-82. [PubMed ID: 21756217]. https://doi.org/10.1080/02699931.2011.555474.

  • 24.

    Meyers LS, Gamst G, Guarino AJ. Applied multivariate research: Design and interpretation. Sage publications; 2006.

  • 25.

    Nolen-Hoeksema S. Responses to depression and their effects on the duration of depressive episodes. J Abnorm Psychol. 1991;100(4):569-82. [PubMed ID: 1757671].

  • 26.

    Nolen-Hoeksema S, Parker LE, Larson J. Ruminative coping with depressed mood following loss. J Pers Soc Psychol. 1994;67(1):92-104. [PubMed ID: 8046585].

  • 27.

    Beck AT, Steer RA, Garbin MG. Psychometric properties of the Beck depression inventory: Twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77-100. https://doi.org/10.1016/0272-7358(88)90050-5.

  • 28.

    Heimberg RG, Mueller GP, Holt CS, Hope DA, Liebowitz MR. Assessment of anxiety in social interaction and being observed by others: The social interaction anxiety scale and the social phobia scale. Behav Ther. 1992;23(1):53-73. https://doi.org/10.1016/s0005-7894(05)80308-9.

  • 29.

    Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch Intern Med. 2006;166(10):1092-7. [PubMed ID: 16717171]. https://doi.org/10.1001/archinte.166.10.1092.

  • 30.

    Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31-6. https://doi.org/10.1007/bf02291575.

  • 31.

    Bartlett MS. A note on the multiplying factors for various χ2 approximations. J Roy Stat Soc B. 1954;16(2):296-8.

  • 32.

    Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936-49. [PubMed ID: 26174714]. https://doi.org/10.3758/s13428-015-0619-7.

  • 33.

    DeVellis RF. Scale development: Theory and applications. Sage publications; 2012.

  • 34.

    Eisner LR, Johnson SL, Carver CS. Positive affect regulation in anxiety disorders. J Anxiety Disord. 2009;23(5):645-9. [PubMed ID: 19278820]. [PubMed Central ID: PMC2847490]. https://doi.org/10.1016/j.janxdis.2009.02.001.