Aggregation Partitioning and Study of Demographic, Medical, and Psychological Predictors Related to Derived Clusters in Cardiac Rehabilitation Patients: A Cross-Sectional Study

authors:

avatar Mozhgan Saeidi 1 , avatar Kodamorad Momeni 2 , avatar Keivan Kakabraee ORCID 1 , *

Department of Psychology, Kermanshah Branch, Islamic Azad University, Kermanshah, Iran
Department of Psychology, Faculty of Social Sciences, Razi University, Kermanshah, Iran

how to cite: Saeidi M, Momeni K , Kakabraee K . Aggregation Partitioning and Study of Demographic, Medical, and Psychological Predictors Related to Derived Clusters in Cardiac Rehabilitation Patients: A Cross-Sectional Study. Middle East J Rehabil Health Stud. 2019;6(2):e86748. https://doi.org/10.5812/mejrh.86748.

Abstract

Background:

Classification of high-risk behaviors such as aggression and identifying social, medical, and psychological factors related to it can help the emergence and development of the strategies to prevent these destructive behaviors.

Objectives:

Thus, the present study was done with two objectives: (i) cluster analysis of the aggression components and partitioning cardiac rehabilitation (CR) patients and (ii) determining the demographic, medical, and psychological correlations of each cluster.

Methods:

The sample of this cross-sectional study was 167 CR patients in western Iran examined from June to December 2017. Demographic and risk factors checklist, Beck anxiety inventory (BAI), Beck depression inventory (BDI), and Buss-Perry aggression questionnaire (BPAQ) were used for data collection. The data were analyzed using hierarchical and k-means cluster analysis, Cramer-V test, analysis of variance (ANOVA), and analysis of binary logistic regression.

Results:

The mean age of the participants (66.5% male) was 59.14 ± 9.03. The model proposed two clusters: (i) patients with mild aggression and (ii) patients with severe aggression. Occupation (P = 0.048), marital status (P = 0.048), anxiety (P = 0.006), and depression (P = 0.001) were the most essential predictors of the unhealthy cluster. Our model could explain 30.7% to 41% of the variance of the unhealthy cluster.

Conclusions:

Cluster analysis divided patients into two groups with mild and severe aggression. Marital status and occupation are the most important demographic correlates, and depression and anxiety are the most important psychological predictors of the cluster with high aggression. The results of the present study can provide a map of the focus of attention on harm reduction interventions by health professionals.

1. Background

High-risk behaviors such as aggression and violence, suicidal thoughts and attempts, as well as drug and alcohol abuse are among the most critical threats to public and social health (1, 2). Violent behaviors are defined as visible, aggressive manifestations primarily tending to harm or injure others (2). Aggression can be defined as instinctive behavior, divided into proportional and disproportional types depending on the circumstances. Proportional aggression is an adaptive behavior that changes like societal values.

Conversely, disproportional aggression is seen as a non-adaptive and ineffective behavior in the face of real or perceived risk (3). Harmful behavior is seen as aggression if done intentionally and on purpose to harm another or self. Aggression may have devastating effects, such as harm, harmful attacks on self and others, unexpected death, and high-risk behaviors (3).

Depending on the type of violence and injury, violent behaviors are seen in approximately 1% to 29% of the adults (2). Reports of large populations and recent surveys in Iran have reported 2% to 65% prevalence of aggression and violent behaviors among children and adolescents (4-6). The prevalence of these behaviors in the Iranian adult population is reported to be about 11% to 33% (7, 8). Furthermore, the results of recent studies indicate that aggressive components are common among people with chronic diseases (9, 10). Violent childhood behaviors, anger, and hostility are the risk factors for cardiovascular diseases (CVDs) (9, 11).

Better understanding and identification of social, medical, and psychological factors associated with high-risk behaviors like aggression can help develop and prevent strategies for preventing these devastating behaviors (12). In doing so, the categorization of specific patients in cohesive groups and the separation of risk profile behaviors like aggression could be effective in identifying predictors and outcomes (13). Cluster analysis is a beneficial statistical method for partitioning a population with common characteristics and a wide range of diseases and disorders. The clustering of mental health components eases the identification of target groups for timely interventions and helps health policymakers come up with services according to their preferences and needs (14).

2. Objectives

The present study was done with two objectives: (i) cluster analysis of the aggression components (anger, hostility, and verbal as well as physical activity) and partitioning CR patients and (ii) determining the demographic, medical, and psychological correlations of each cluster.

3. Methods

3.1. Design and Context

In this cross-sectional study, cardiac patients were invited to participate in the CR program from June to December 2017 at the Imam Ali Hospital in Kermanshah, Iran. Kermanshah is located in western Iran, and the Imam Ali Hospital is a 214-bed special heart-clinic center located in the city.

3.2. Participants

At the time of the present study, 215 people participated in the CR program. The inclusion criteria were fluency in the Farsi language, age range of 20 to 75 years, enrollment in CR, and willingness to participate in the study. After initial screening by the research team, only 167 had the criteria for entering the study or were willing to complete the questionnaire. Nine individuals were excluded due to a lack of fluency in Farsi. In addition, 18 and 21 individuals were excluded due to aging and unwillingness to participate in the study. Eligible patients were identified by the research team and entered the study after providing written consent and obtaining the anonymity and confidentiality of their identity. The ethical standards of this study were made according to the Helsinki Statement. Given the formula (N > 50 + 8 m) and the existence of 12 predicting variables in the study, the minimum sample size of more than 146 people seems appropriate for this study (15). This study was approved by the Ethics Committee of Kermanshah University of Medical Sciences (KUMS.REC.1394.203).

3.3. Data Collection

One day before aerobic exercise and initiating a CR program, the demographic and medical information of the patients such as gender, age, education, job status, marital status, smoking, histories of hypertension, diabetes, hyperlipidemia, and psychiatric history was collected by the psychologist and cardiologist of the CR research team. After recording the information in the research forms, Beck anxiety inventory (BAI), Beck depression inventory (BDI), and the Buss-Perry aggression questionnaire (BPAQ) were given to each patient individually. After receiving the necessary explanations by the clinical psychologist, the patients completed the questionnaires.

3.4. Instruments

3.4.1. The Beck Anxiety Inventory (BAI)

The 21-item inventory included scores from zero to three for each item. The final score that is varied from zero to 63 consists of four levels of anxiety (no anxiety = 0 - 7, mild = 8 - 15, anxiety = 16 - 25, severe = 26 - 63). Cronbach’s Alpha of the inventory and retest reliability are 0.92 and 0.75, respectively. The validity of the inventory has been confirmed (16). In the Iranian population, reliability (α = 0.88), convergent (0.40 - 0.44), and divergent (r = 0.216) validity of this tool have been confirmed (17).

3.4.2. The Beck Depression Inventory (BDI)

The 21-item inventory included scores from zero to three for each item. The final score that is varied from zero to 63 includes five levels of depression (no depression = 0 - 4, mild = 5 - 9, moderate = 10 - 18, severe = 19 - 29, very severe = 30 - 63). Beck et al. (18), showed that the retest reliability is 0.93. Reliability (α = 0.87) and validity of the instrument have been confirmed in the Iranian population (19).

3.4.3. Buss-Perry Aggression Questionnaire (BPAQ)

The questions of this 29-item instrument ranged on a 5-point continuum from "extremely uncharacteristic of me" to "extremely characteristic of me." The questionnaire has four subscales, which included hostility, anger, verbal aggression, and physical aggression. The scores are normalized on a scale of zero to one, with one being the highest level of aggression (20). In the Iranian population, the retest reliability of the questionnaire is acceptable (= 0.78). In addition, the instrument validity was approved by factor analysis (21).

3.5. Data Analysis

Data related to the continuous variables were reported as mean and standard deviations, and discontinuous data were reported in terms of frequency and percentage. In cluster analysis, first, the Euclidean Distance Hierarchy method was used to identify the number of clusters. Centroid clustering method was used to prevent the significant effect of entirely related multiple variables (aggression components) on each other. Models with two to five clusters were separately evaluated indicating that the resolution of the two-cluster model is better than the other proposed models. In the next step, k-means clustering method was used to determine the proposed two clusters of the initial model. Finally, Cramer-V test was used to verify the stability of the cluster solution structure and to specify the agreement between the solutions. The clustering components between clusters were compared using analysis of variance (ANOVA). Additionally, demographic information and medical records of the samples were reported in the baseline by clustering.

In the next step, a binary logistic regression analysis was done to identify the correlates of derivate clusters. Demographic factors were gender, age, education, occupational status, and marital status with all medical variables such as histories of hypertension, diabetes, hyperlipidemia, smoking, psychiatry illness, depression, and anxiety that entered the model simultaneously. Given the presence of two classes, cluster one (healthier samples) was considered as a reference. The results of the analysis were presented as adjusted odds ratio (OR) with 95% confidence intervals (CIs). All statistical analyses were performed using SPSS20 (IBM Corp., Armonk,NY, USA). All the tests were of two domains, and statistical significance was defined as P value < 0.05.

4. Results

4.1. The Clusters Identified

Table 1 indicates the profile derived from the hierarchical and k-means cluster analysis. The results of Cramer-V test (V = 0.541, P < 0.001) showed that cluster solution structure has good stability in both models and there is an agreement between the solutions. The model proposed two clusters for the studied components, and as seen in all components, there is a significant difference between the clusters (P < 0.001). The proposed clusters are (i) patients with mild aggression (n = 87, 52.1%) and (ii) patients with severe aggression (n = 80, 47.9%).

Table 1.

Aggression Level Profile Derived from a K-Mean Cluster Analysis (n = 167)a

Aggression ComponentsTotal (n = 167)Cluster 1 (n = 87; 52.1%)Cluster 2 (n = 80; 47.9%)P Valueb
Patients with Mild AggressionPatients with High Aggression
Hostility18.44 ± 8.0212.90 ± 4.8924.46 ± 6.22< 0.001
Anger22.42 ± 5.3919.93 ± 4.8025.12 ± 4.67< 0.001
Verbal aggression13.68 ± 5.5010.64 ± 5.0616.97 ± 3.83< 0.001
Physical aggression8.60 ± 6.145.87 ± 4.1511.57 ± 6.59< 0.001

4.2. Demographic and Medical Correlates Related to the Clusters

Table 2 shows the characteristics of the participants separately for the clusters in the baseline. Furthermore, this table shows the results of binary logistic regression. The table shows a significant difference between occupation (P = 0.048), marital status (P = 0.048), anxiety (P = 0.006), and depression (P = 0.001). Compared to the reference cluster (cluster 1), the unhealthy cluster has fewer housewives and more married ones.

Table 2.

The Results of Binary Regression Logistic for Identifying Correlatesa,b

PredictorsTotal (n = 167)Cluster 1 (n = 87; 52.1%) ReferenceCluster 2 (n = 80; 47.9%)P Value
Patients with Mild AggressionPatients with High Aggression
Descriptive DataReference ColumnDescriptive DataOR (95% CI)
Gender, female (%)56 (33.5)33 (37.9)123 (28.7)0.21 [0.02 - 2.46]0.213
Age, y59.14 ± 9.0359.21 ± 9.55159.07 ± 8.481.03 [ 0.98 - 1.08]0.273
Education1
Under diploma102 (61.1)54 (62.1)48 (60)1
Diploma33 (19.8)16 (18.4)17 (21.2)0.38 [0.12 - 1.20]0.099
Academic32 (19.1)17 (19.5)15 (18.8)0.35 [0.09 - 1.27]0.111
Job1
Employed21 (12.6)10 (11.5)11 (13.8)1
Self-employed46 (27.5)24 (27.6)22 (27.5)1.03 [0.22 - 4.89]0.966
Housekeeper49 (29.3)31 (35.6)18 (22.5)0.06 [0.01 - 0.97]0.048
Retired51 (30.5)22 (25.3)28 (36.2)1.00 [0.26 - 3.85]0.999
Marital status1
Marriage151 (90.4)75 (86.2)76 (95)1
Widow/separated16 (9.6)12 (13.8)4 (5)0.23 [0.05 - 0.99]0.048
Medical history
HTN65 (38.9)33 (37.9)132 (40)1.35 [0.58 - 3.12]0.481
DM34 (20.4)18 (20.7)116 (20)1.31 [0.44 - 2.94]0.800
HLP47 (28.1)26 (29.9)121 (26.3)0.91 [0.37 - 2.21]0.828
Smoking70 (41.9)36 (41.4)134 (42.5)0.86 [0.36 - 2.06]0.741
Psychiatric illness58 (34.7)19 (21.8)139 (48.8)1.86 [0.80 - 4.33]0.148
Depression16.24 ± 3.9114.72 ± 3.35117.90 ± 3.831.30 [1.11 - 1.53]0.001
Anxiety32.72 ± 9.1029.44 ± 9.34136.30 ± 7.371.08 [1.02 - 1.14]0.006

Moreover, the severity of depression and anxiety in the unhealthy cluster samples was significantly higher than that of the healthy cluster. In other words, anxiety and depression increase 1.1 and 1.3 times the chance of aggression, respectively. In addition, the summary of the model indicates that overall predictor variables explain 30.7% to 41% of the unhealthy cluster variance.

5. Discussion

Aggression and violent behaviors are as the most prevalent problems among adults and are one of the most important risk factors for chronic diseases, like CVDs (7-11). In the present study, we used cluster analysis to determine the level of aggressive behaviors and the categorization of CR patients in cohesive groups. This method could well divide the patients into two groups, according to the severity of aggressive behaviors. Previous studies have also indicated that cluster analysis can well classify general and clinical populations according to mental health (14, 22, 23). Additionally, the importance and ability of this method have already been proven in partitioning patients with CVDs (24).

Our results showed a relationship between the occupation status and the unhealthy cluster. In other words, in the unhealthy cluster, people usually have jobs other than housekeeping. It seems that the house makers are less likely to experience job stress compared with others with other businesses. Moreover, their working environment is shared with family members, and this probably means they have more family support during the day. In this regard, the results of several studies showed that higher social-familial support was associated with a lower level of aggression (25, 26). Furthermore, it is expected that they report fewer aggressive behaviors. In addition, as housekeepers are solely women, the unhealthy cluster samples were mostly men. The greater prevalence of aggression in men can explain this result (27).

Other results showed a relationship between the marital status and the unhealthy cluster. The number of married people in this cluster was more than the healthy cluster. Although those who lose their spouses are likely to lose much of their family-emotional-financial support, this problem is not accompanied by increased risk of aggression. Likewise, those who have long been involved with marital conflicts are likely to experience more anger and aggression (28). In line with this, the results of a study in Iran showed that marital conflicts are widespread in married cardiac patients (29).

Furthermore, the results showed a direct relationship between depression and anxiety with an unhealthy cluster. In other words, for a unit of increase in anxiety and depression scores, the probability of aggression increases by 1.1 and 1.3 times, respectively. In confirmation of our results, previous studies have indicated that aggression in anxious and depressed individuals is significantly higher than others (30-32). There is substantial evidence showing that neuroendocrine and neurochemical regulators of aggression and anxiety have a strong relationship with these behaviors (32). Moreover, common genetic factors interconnect depression and aggression (33).

5.1. Limitations

Only CR patients were examined in this study. As only a few patients refer to CR after the heart event, it is suggested that participants in future studies be selected from all patients with CVDs. Furthermore, an increase in sample size, as well as random sampling in future studies, can help distinguish the samples' profiles more accurately.

5.2. Conclusions

Cluster analysis of aggression in CR patients could provide a coherent categorization of low-risk and high-risk patients. Marital status and occupation are the most important demographic correlates while depression and anxiety are the most important psychological predictors of the unhealthy cluster. The results of the present study can provide a map of the focus of attention on harm reduction interventions by health professionals. Cardiac health professionals should focus on managing occupational and marital stress as well as controlling anxiety and depression in patients with CVDs to control aggression and the harm associated with it.

References

  • 1.

    Maghsoudi A, Jalali M, Neydavoodi M, Rastad H, Hatami I, Dehghan A. Estimating the prevalence of high-risk behaviors using network scale-up method in university students of Larestan in 2014. J Subst Use. 2016;22(2):145-8. https://doi.org/10.3109/14659891.2016.1150528.

  • 2.

    Liu J, Lewis G, Evans L. Understanding aggressive behaviour across the lifespan. J Psychiatr Ment Health Nurs. 2013;20(2):156-68. [PubMed ID: 22471771]. [PubMed Central ID: PMC3411865]. https://doi.org/10.1111/j.1365-2850.2012.01902.x.

  • 3.

    Komasi S, Saeidi M, Soroush A, Zakiei A. The relationship between brain behavioral systems and the characteristics of the five factor model of personality with aggression among Iranian students. J Inj Violence Res. 2016;8(2):67-74. [PubMed ID: 26567893]. [PubMed Central ID: PMC4967364]. https://doi.org/10.5249/jivr.v8i2.696.

  • 4.

    Sadeghi S, Farajzadegan Z, Kelishadi R, Heidari K. Aggression and violence among Iranian adolescents and youth: A 10-year systematic review. Int J Prev Med. 2014;5(Suppl 2):S83-96. [PubMed ID: 26157572]. [PubMed Central ID: PMC4476012]. https://doi.org/10.4103/2008-7802.157663.

  • 5.

    Meysamie A, Ghalehtaki R, Ghazanfari A, Daneshvar-Fard M, Mohammadi MR. Prevalence and associated factors of physical, verbal and relational aggression among iranian preschoolers. Iran J Psychiatry. 2013;8(3):138-44. [PubMed ID: 24454423]. [PubMed Central ID: PMC3887231].

  • 6.

    Sadinejad M, Bahreynian M, Motlagh ME, Qorbani M, Movahhed M, Ardalan G, et al. Frequency of aggressive behaviors in a nationally representative sample of Iranian children and adolescents: The CASPIAN-IV study. Int J Prev Med. 2015;6:6. [PubMed ID: 25789141]. [PubMed Central ID: PMC4362279]. https://doi.org/10.4103/2008-7802.151436.

  • 7.

    Dolatshahi B, Abasi I, Pahlavani H. Prevalence of high risk behaviors among women living in Tehran. Pract Clin Psychol. 2016;4(2). https://doi.org/10.15412/j.jpcp.06040205.

  • 8.

    Rounaghi M, Pakseresht S, Asiry S, Atrkar Roushan Z. Relationship between aggression and addiction tendency among university students. J Holist Nurs Midwifery. 2018;28(3):185-91. https://doi.org/10.29252/hnmj.28.3.185.

  • 9.

    Davidson KW, Mostofsky E. Anger expression and risk of coronary heart disease: Evidence from the Nova Scotia health survey. Am Heart J. 2010;159(2):199-206. [PubMed ID: 20152217]. [PubMed Central ID: PMC2831051]. https://doi.org/10.1016/j.ahj.2009.11.007.

  • 10.

    Tilov B, Semerdzhieva M, Bakova D, Tornyova B, Stoyanov D. Study of the relationship between aggression and chronic diseases (diabetes and hypertension). J Eval Clin Pract. 2016;22(3):421-4. [PubMed ID: 26696247]. https://doi.org/10.1111/jep.12502.

  • 11.

    Suglia SF, Sapra KJ, Koenen KC. Violence and cardiovascular health: A systematic review. Am J Prev Med. 2015;48(2):205-12. [PubMed ID: 25599905]. [PubMed Central ID: PMC4300436]. https://doi.org/10.1016/j.amepre.2014.09.013.

  • 12.

    Gunnell D, Harbord R, Singleton N, Jenkins R, Lewis G. Factors influencing the development and amelioration of suicidal thoughts in the general population. Cohort study. Br J Psychiatry. 2004;185:385-93. [PubMed ID: 15516546]. https://doi.org/10.1192/bjp.185.5.385.

  • 13.

    Zhang Y, Ji Y. Clustering of risk behaviors and their social determinants among primary school learners in Beijing, China: A cross-sectional study. Chin Med J (Engl). 2015;128(12):1567-73. [PubMed ID: 26063355]. [PubMed Central ID: PMC4733749]. https://doi.org/10.4103/0366-6999.158289.

  • 14.

    Khazaie H, Najafi F, Hamzeh B, Chehri A, Rahimi-Movaghar A, Amin-Esmaeili M, et al. Cluster analysis of psychiatric profile, its correlates, and using mental health services among the young people aged 15-34: Findings from the first phase of Iranian youth cohort in Ravansar. Soc Psychiatry Psychiatr Epidemiol. 2018;53(12):1339-48. [PubMed ID: 30145626]. https://doi.org/10.1007/s00127-018-1580-4.

  • 15.

    Pallant J. SPSS survival manual: A step by step guide to data analysis using SPSS for Windows (version 12). 2nd ed. Australia: Allen & Unwin; 2005. p. 142-52.

  • 16.

    Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: Psychometric properties. J Consult Clin Psychol. 1988;56(6):893-7. [PubMed ID: 3204199]. https://doi.org/10.1037/0022-006X.56.6.893.

  • 17.

    Khesht-Masjedi MF, Omar Z, Kafi Masoleh SM. Psychometrics properties of the Persian version of Beck anxiety inventory in north of Iranian adolescents. Int J Educ Psychol Res. 2015;1(2):145. https://doi.org/10.4103/2395-2296.152233.

  • 18.

    Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77-100. https://doi.org/10.1016/0272-7358(88)90050-5.

  • 19.

    Ghassemzadeh H, Mojtabai R, Karamghadiri N, Ebrahimkhani N. Psychometric properties of a Persian-language version of the Beck depression inventory-second edition: BDI-II-PERSIAN. Depress Anxiety. 2005;21(4):185-92. [PubMed ID: 16075452]. https://doi.org/10.1002/da.20070.

  • 20.

    Buss AH, Perry M. The aggression questionnaire. J Person Soc Psychol. 1992;63(3):452-9. https://doi.org/10.1037/0022-3514.63.3.452.

  • 21.

    Samani S. [Study of reliability and validity of the Buss and Perry's aggression questionnaire]. Iran J Psychiatr Clin Psychol. 2008;13(4):359-65. Persian.

  • 22.

    Zakiei A, Kiani N, Morovati F, Komasi S. Classification of various types of disability and determining their predictive causes in Western Iran. Clin Epidemiol Global Health. 2018. https://doi.org/10.1016/j.cegh.2018.11.003.

  • 23.

    Newcomer SR, Steiner JF, Bayliss EA. Identifying subgroups of complex patients with cluster analysis. Am J Manag Care. 2011;17(8):e324-32. [PubMed ID: 21851140].

  • 24.

    Ahmad T, Desai N, Wilson F, Schulte P, Dunning A, Jacoby D, et al. Clinical implications of cluster analysis-based classification of acute decompensated heart failure and correlation with bedside hemodynamic profiles. PLoS One. 2016;11(2). e0145881. [PubMed ID: 26840410]. [PubMed Central ID: PMC4739604]. https://doi.org/10.1371/journal.pone.0145881.

  • 25.

    Hamama L, Ronen-Shenhav A. Self-control, social support, and aggression among adolescents in divorced and two-parent families. Child Youth Serv Rev. 2012;34(5):1042-9. https://doi.org/10.1016/j.childyouth.2012.02.009.

  • 26.

    Mukhtar S, Mahmood Z. Moderating role of perceived social support between perceived parenting styles and relational aggression in adolescents. J Aggress Maltreat Trauma. 2018;27(8):831-45. https://doi.org/10.1080/10926771.2018.1468842.

  • 27.

    Staniloiu A, Markowitsch H. Gender differences in violence and aggression – A neurobiological perspective. Soc Behav Sci. 2012;33:1032-6. https://doi.org/10.1016/j.sbspro.2012.01.279.

  • 28.

    Timmons AC, Arbel R, Margolin G. Daily patterns of stress and conflict in couples: Associations with marital aggression and family-of-origin aggression. J Fam Psychol. 2017;31(1):93-104. [PubMed ID: 27504754]. [PubMed Central ID: PMC5293605]. https://doi.org/10.1037/fam0000227.

  • 29.

    Komasi S, Saeidi M. What is role of sex and age differences in marital conflict and stress of patients under cardiac rehabilitation program? ARYA Atheroscler. 2016;12(3):138-45. [PubMed ID: 27752271]. [PubMed Central ID: PMC5055372].

  • 30.

    Meyrueix L, Durham G, Miller J, Smalley KB, Warren JC. Association between depression and aggression in rural women. J Health Dispar Res Pract. 2015;8(4):136-44. [PubMed ID: 26855847]. [PubMed Central ID: PMC4737959].

  • 31.

    Fung ALC, Gerstein LH, Chan Y, Engebretson J. Relationship of aggression to anxiety, depression, anger, and empathy in Hong Kong. J Child Fam Stud. 2013;24(3):821-31. https://doi.org/10.1007/s10826-013-9892-1.

  • 32.

    Neumann ID, Veenema AH, Beiderbeck DI. Aggression and anxiety: Social context and neurobiological links. Front Behav Neurosci. 2010;4:12. [PubMed ID: 20407578]. [PubMed Central ID: PMC2854527]. https://doi.org/10.3389/fnbeh.2010.00012.

  • 33.

    Haddad SK, Reiss D, Spotts EL, Ganiban J, Lichtenstein P, Neiderhiser JM. Depression and internally directed aggression: Genetic and environmental contributions. J Am Psychoanal Assoc. 2008;56(2):515-50. [PubMed ID: 18515705]. [PubMed Central ID: PMC3766738]. https://doi.org/10.1177/0003065108319727.