Abstract
Background:
Psychological factors, such as depression and anxiety are among the risk factors in coronary heart disease (CHD). Therefore, we need the necessary interventions in this field to quickly diagnose these disorders.Objectives:
The aim of this study was to determine the psychometric properties of Patient Health questionnaires-4 (PHQ-4) as a screening tool for depression and anxiety in CHD patients in Iran.Methods:
In this study, 279 CHD patients completed PHQ-4, Patient Health questionnaires-9 (PHQ-9), generalized anxiety disorder-7 (GAD-7) scale, and Beck depression inventory version-II (BDI-II). Semi-structured clinical interviews (SCID) based on DSM-5 were also used to diagnose depression and anxiety.Results:
Cronbach’s alpha for PHQ-2, GAD-2, and PHQ-4 were reported to be 0.79, 0.75, and 0.78 respectively. The correlations of the PHQ-4 questionnaire with the BDI-II, GAD-7, GAD-2, PHQ-9, and PHQ-2 were found to be 0.72, 0.63, 0.85, 0.79, and 0.88 respectively. The results of fitting one-factor and two-factor models showed that the two-factor model has a more suitable fit. The optimal cut-off point of PHQ-4 ≥ 7 to measure depression and anxiety concurrently (sensitivity = 0.86, specificity = 0.90, and the area under the curve was 0.93 (CI = 0.90 - 0.96).Conclusions:
The PHQ-4 questionnaire is an appropriate tool for diagnosis of and screening for depression and anxiety in the population of CHD patients.Keywords
Patient Health Questionnaire-4 Depression Coronary Disease Psychometrics Sensitivity and Specificity Factor Structure
1. Background
Coronary heart disease (CHD) is one of the most important causes of mortality in the world. In Iran, cardiovascular disease is the first cause of death and imposes huge social and economic burdens on society (1). Depression has been known as a risk factor responsible for CHD and is associated with cardiac mortality, poor patients’ lifestyles, poor adherence to the treatment and poor treatment outcomes in patients with coronary artery disease (2). Comorbidity between depression and heart disease is typically acknowledged. Depression among heart patients is more prevalent than the general.
Population, and depressed people are more likely to develop heart disease (3). In addition to depression, anxiety is another psychological component that can affect heart patients (4). The prevalence of anxiety in heart patients has been reported to be 45.7 % in Iran (5). Anxiety is also considered as a risk factor for heart disease which can influence the onset of the first period of illness and its resultant death (6). For rapid diagnosis and early intervention, we need tools to screen these abnormalities. Several tools have been used to measure depression in cardiac patients, such as BDI-II, PHQ-9 and PHQ-2. The American Heart Association in 2008 proposed that PHQ-2 could be used to measure depression (7). The GAD-2 has also shown acceptable psychometric properties of measuring anxiety (8). Combining these two questionnaires, the PHQ-4 questionnaire was made, a much shorter tool. Because of this, Kroenke et al. combined these two questionnaires and developed a tool to measure anxiety and depression (9). This tool has been studied in some samples such as general population and students (10-12). Given the importance of screening in cardiac patients in terms of the anxiety and depression as well as the use of efficient and short tools, this study aimed at evaluating the psychometric properties of this tool in CHD patients.
2. Objectives
The aim of this study was to determine the psychometric properties of PHQ-4 as a screening tool for depression and anxiety in CHD patients in Iran.
3. Methods
3.1. Participants and Procedures
As for research participants, 279 patients with CHD referred to Imam Ali Hospital in Kermanshah were diagnosed with CHD by two cardiologists, some of the patients underwent angiography according to the cardiologists’ opinion. Afterwards, the heart patients not able to participate in the study due to severe heart problems were those with cognitive problems, such as Alzheimer’s, severe psychological problems, such as psychotic disorders, and physical problems, such as thyroid and they were excluded from the study because of symptoms such as depression. In cases where the patient was incapable of reading and writing, the questionnaire was read by the researchers and the patient responded to the questions. After explaining the purpose of the study and completing an informed consent form, the patients were first given a semi-structured clinical interview and then were asked to complete questionnaires, including the PHQ-4, PHQ-9, BDI-II, and GAD-7. This study was approved by ethics code IR.SBMU.MSP.RES.1396.286 in the Ethics Committee of Shahid Beheshti University of Medical Sciences in Tehran.
3.2. Measures
Structured clinical interview for DSM-5 (SCID-5): structured clinical interview for DSM-V (SCID-5) is a semi-structured clinical interview used for the primary diagnosis of DSM-5 (formerly located in axis 1). This tool has to be implemented by trained professionals (clinical experts, mental health experts, etc.) familiar with the diagnostic criteria and classification of disorders in DSM-5 (13).
3.3. Patient Health Questionnaire-4 (PHQ-4)
This questionnaire includes four questions of which the first two and the second two measure depression and anxiety respectively. The questionnaire comprises the question of how much each problem has hurt the subject in the past two weeks. The first two questions relate to the feeling of being depressed and lack of interest in doing things; while, the second two questions regarding the anxiety measure the feeling of anger and anxiety and how much one was able to control his/her own anxiety. Answers to questions are in four scales with different scores: Not at all (0), several days (1), more than half days (2), and almost every day (3) (9).
3.4. Patient Health Questionnaire-9 (PHQ-9) and Patient Health Questionnaire-2 (PHQ-2)
The PHQ-9 with 9-item is based on DSM-IV (14). In a cut-off point of 10 and above, the sensitivity and specificity of this tool have been reported to be 0.88 and 0.88 (15). Dadfar et al. reported a Cronbach’s α of 0.88 and one-week test-retest reliability of 0.79 for the PHQ-9 in a sample of Iranian psychiatric outpatients (16).
The PHQ-2 consists of the first two items of the PHQ-9 (17). Zhang et al. found a Cronbach’s of 0.72 and the test-retest reliability values of 0.82 for PHQ-2 in college students in China (18).
3.5. Beck Depression Inventory Second Edition (BDI-II)
The questionnaire is a 21-item tool taken from BDI and its score is between 0 and 63 (19). This questionnaire has been used in Iran and has shown good psychometric properties (20).
3.6. Generalized Anxiety Disorder Scale-7 (GAD-7) and GAD-2
This questionnaire includes 7 questions and was developed by Spitzer et al. in 2006. As for scoring in this questionnaire, four scales have been used, including never (0), some days (1), several days (2), and almost every day (3). The score obtained is between 0 and 21, and at the cut-off point of 9, its sensitivity and specialty were 0.89 and 0.82, respectively. The internal consistency of the GAD-7 was 0.92 and test-retest reliability was 0.83 (21). The GAD-2 consists of the first two items of the GAD-7. Scores range from 0 to 6 (22). Seo and Park found a Cronbach’s alph of 0.82 for GAD-2 in in patients with a migraine. The GAD-2 well correlated with the beck anxiety inventory (BAI), and the Migraine Disability Assessment scale (MIDAS) (23).
3.7. Data Analysis
Data was analyzed by SPSS software version 24 and AMOS software version 24. Cronbach’s alpha was used to examine the internal consistency. The Pearson correlation coefficient between PHQ-4, BDI-II, PHQ-9, and GAD-7 were used to assess the criterion validity. To study correlation of the items, total score, and gain correlation range, Spearman’s correlation was used. Confirmatory factor analysis was performed using AMOS software for. A receiver operating characteristic curve (Roc curve) was applied to calculate sensitivity, specificity, area under the curve (accuracy), and optimal cut-off point. Eventually, maximal Youden index (sensitivity + specificity-1) was employed to obtain the optimal cut-off point.
4. Results
We studied 279 patients with CHD. Among them, 152 (54.5%) were male and 127 (45.5%) were female. They were in the age range of 33 and 85 years with the mean age of 59.5 ± 9.98. As for the participants’ occupational history, 132 (47.3%) were unemployed, 103 (36.9%) were self-employed, and 44 (15.8%) were employees.
4.1. Reliability Analysis
Cronbach’s alpha for PHQ-2, GAD-2, and PHQ-4 were reported to be 0.79, 0.75, and 0.78 respectively. Likewise, the results of Cronbach’s alpha coefficient analysis, if any item was deleted, showed that all items if deleted would reduce the value of alpha, indicating their suitability (Table 1).
Characteristics of Items and Subscales of PHQ-4 in the CHD
| Item-Total Statistics | Corrected Item-Total Correlation | Cronbach’s Alpha if Item Deleted | |
|---|---|---|---|
| p1 | Feeling down, depressed, or hopeless | 0.55 | 0.76 |
| p2 | Little interest or pleasure in doing things | 0.67 | 0.69 |
| a1 | Feeling nervous, anxious, or on edge | 0.60 | 0.73 |
| a2 | Not being able to stop or control Worrying | 0.56 | 0.75 |
4.2. Validity
The correlations of the PHQ-4 questionnaire with the BDI-II, GAD-7, GAD-2, PHQ-9 and PHQ-2 were reported to be 0.72, 0.63, 0.85, 0.79, and 0.88 respectively (P < 0.5). The correlations of the PHQ-2 questionnaire with the BDI-II, GAD-7 and GAD-2 were found to be 0.64, 0.58, 0.51, 0.79, and 0.88 respectively (P < 0.05). The correlations of the GAD-2 questionnaire with the BDI-II, GAD-7, and PHQ-9 were obtained as 0.61, 0.90, and 0.51 respectively (P < 0.05).
The AMOS software was used for the factor analysis. In previous studies, a two-factor and one-factor structure has been introduced. The structure consists of two factors: anxiety and depression (11, 12). In the present study, the results of fitting one-factor and two-factor models showed that the two-factor model has a more suitable fit (chi-square = 1.28, df = 1 P value = 0.25, RMSEA = 0.03, χ2/df = 1.28, NFI = 0.99, IFI = 0.99,TLI = 0.99, and CFI = 0.99) (Figure 1).
Confirmatory factor analyses results for a one- and two-factor model
The uni-factorial model was also measured but not fitted properly. (Chi-square = 55.27, DF = 2, P value = 0.00, χ2 = 27.53, RMSEA = 0.3, TLI = 0.26, and CFI = 0.85) (Figure 1).
4.3. Test Features for Screening Purposes
The ROC test was used to obtain the sensitivity, specificity, area under the curve, and cut-off point. The cut-off point of PHQ-4 ≥ 7 to measure depression and anxiety concurrently (sensitivity = 0.86, specificity = 0.90, and the area under the curve was 0.94 (CI = 0.90 - 0.97) (Figure 2 and Tables 2 and 3), the cut-off point of PHQ-4 ≥ 5 to measure depression (sensitivity = 0.76, specificity = 0.80, and the area under the curve was 0.84 (0.79 - 0.89) (Figure 3 and Tables 2 and 3), the cut-off point of PHQ-4 ≥ 7 to measure anxiety (sensitivity = 0.80, specificity = 0.94, and the area under the curve was 0.94 (CI = 0.91 - 0.97) (Figure 4 and Tables 2 and 3), the cut-off point of PHQ-2 ≥ 3 to measure depression (sensitivity = 0.77, specificity = 0.84, and the area under the curve was 0.82 (CI = 0.77 - 0.87) (Figure 3 and Tables 2 and 3), and the cut-off point of GAD-2 ≥ 3 to measure anxiety (sensitivity = 0.96, specificity = 0.82, and the area under the curve was 0.95 (CI = 0.93 - 0.97) (Figure 4 and Tables 2 and 3).
ROC curve for PHQ-4 to detect depression and anxiety concurrently
Area Under the Curve for the PHQ-9 and PHQ-2 (P Value < 0.001)
| Test Result Variable(s) | Area | Std. Error | Asymptotic 95% Confidence Interval | |
|---|---|---|---|---|
| Lower Bound | Upper Bound | |||
| Depression | ||||
| PHQ-4 | 0.84 | 0.02 | 0.79 | 0.89 |
| PHQ-2 | 0.82 | 0.26 | 0.77 | 0.87 |
| Anxiety | ||||
| PHQ-4 | 0.94 | 0.01 | 0.91 | 0.97 |
| GAD-2 | 0.95 | 0.01 | 0.93 | 0.97 |
| Depression and anxiety concurrently | ||||
| PHQ-4 | 0.94 | 0.01 | 0.90 | 0.97 |
Sensitivity, Specificity, Predictive Values, and Likelihood Ratios at Various Cut-off Scores of the PHQ-4, PHQ-2 and GAD-2
| Test Result Variable(s) (Positive if Greater Than or Equal Toa) | Sensitivity | Specificity | Positive Predictive Value | Negative Predictive Value | Positive Likelihood Ratio | Negative Likelihood Ratio |
|---|---|---|---|---|---|---|
| PHQ-4 (depression-anxiety) | ||||||
| ≥ 6 | 0.92 | 0.78 | 0.54 | 0.97 | 4.15 | 0.10 |
| ≥ 7 | 0.86 | 0.90 | 0.71 | 0.95 | 8.81 | 0.16 |
| PHQ-4 (depression) | ||||||
| ≥ 4 | 0.86 | 0.69 | 0.66 | 0.86 | 2.76 | 0.21 |
| ≥ 5 | 0.76 | 0.80 | 0.74 | 0.82 | 3.94 | 0.29 |
| PHQ-4 (anxiety) | ||||||
| ≥ 6 | 0.87 | 0.82 | 0.64 | 0.94 | 4.73 | 0.15 |
| ≥ 7 | 0.80 | 0.94 | 0.83 | 0.92 | 13.25 | 0.21 |
| PHQ-2 (depression) | ||||||
| ≥ 2 | 0.82 | 0.69 | 0.65 | 0.84 | 2.65 | 0.25 |
| ≥ 3 | 0.68 | 0.85 | 0.76 | 0.78 | 4.44 | 0.37 |
| GAD-2 (anxiety) | ||||||
| ≥ 2 | 0.99 | 0.57 | 0.47 | 0.99 | 2.30 | 0.02 |
| ≥ 3 | 0.96 | 0.82 | 0.67 | 0.98 | 5.22 | 0.04 |
ROC curves for PHQ-4 and PHQ-2 to detect depression
ROC curve for PHQ-4 and GAD-2 to detect anxiety
The cut-off points obtained for the PHQ-4 questionnaire as a whole, PHQ-4 for the diagnosis of depression, PHQ-4 for the diagnosis of anxiety, PHQ-2 for the diagnosis of depression, and GAD-2 for the diagnosis of anxiety were as follows (Table 2). Based on the area under the curve, it can be said that the questionnaire with the two questions of depression and anxiety can well differentiate people with depression and anxiety from those suffering from CHD without these symptoms.
5. Discussion
The purpose of this study was to translate and investigate the psychometric properties of PHQ-4 as a brief questionnaire to screen patients with CHD in Iran. The study was also the first attempt to investigate the validity of PHQ-4 as a measure to investigate the depression and anxiety in patients with CHD in Iran.
Based on Cronbach alpha, the reliability values of 0.78, 0.79, and 0.75 were calculated for PHQ-4, PHQ-2, and GAD-2 respectively. However, in a study conducted on a general population, the Cronbach alpha has been reported to be 0.82, 0.78, and 0.75 for PHQ-4, PHQ-2, and GAD-2 respectively (11). In addition, in another study conducted on college students, the reported Cronbach alpha were 0.81, 0.76, and 0.82 for PHQ-4, PHQ-2, and GAD-2 respectively (10). The moderate to high correlation between PHQ-4 and other questionnaires of BDI-II, GAD-7, GAD-2, PHQ-9, and PHQ-2 brings evidence to the validity of the PHQ-4 questionnaire. While, in a study conducted on a general population, the concurrent validity of the PHQ-4 questionnaire which was investigated by checking the correlation between the questionnaire and Hospital Anxiety and Depression scale (HADS), General Health questionnaire (GHQ)-12 (GHQ-12), and General Self Efficacy scale (GSES) were r = 0.26, r = 0.46, and r = -0.44 respectively (11).
In this study, the validity of the questionnaire has been also investigated using confirmatory factor analysis. Following other studies, we used one and two factor structures. However, the results showed a better fit for the two-factor model. Accordingly, the results of the current study were in line with the results of the studies conducted in Germany and Colombia (11, 12).
The optimal cut off point of the PHQ-4 was ≥ 7 to measure depression and anxiety concurrently (sensitivity = 0.86, specificity = 0.90). While in a study on a general population, the same index for measuring the anxiety and depression was 6 (12). To separately measure the depression and anxiety, the optimal cut off point were 5 and 7 respectively. The optimal cut off point of PHQ-2 measuring the depression in this study was ≥ 3 (sensitivity = 0.77, specificity = 0.84(. In a study on a patient with heart disease, a cut-off point of 3 with a sensitivity of 0.39 and specificity of 0.92 was measured, showing low sensitivity (24).
To measure the anxiety, the selected cut off point of GAD-2 was ≥ 3 (sensitivity = 0.96, specificity = 0.82). The selected cut off point in this study was consistent with that of a meta- analysis conducted to determine the cut off point for GAD-7 and GAD-2 (8).
Given that the present study was conducted only on the patients with CHD in Kermanshah’s Imam Ali Hospital and it included a sample of 279 patients with CHD, further studies with larger sample sizes are needed on the patients in other hospitals across Iran.
5.1. Conclusions
The results of the current study provided evidence for the validity and reliability of the PHQ-4, GAD-2, and PHQ-2 questionnaires in the population of patients with heart disease. Hence, the indices of patient health two-item questionnaires, namely PHQ-2 and GAD-2 with the cut-off point of 3 can be used for screening the anxiety and depression in patients with heart disease. Additionally, if concurrent screening of these two variables is intended, the 4-item questionnaire with cut-off point of 7 can be useful. These three tools demonstrated acceptable sensitivity and specificity values of screening and conducting research.
References
-
1.
Saadat S, Yousefifard M, Asady H, Moghadas Jafari A, Fayaz M, Hosseini M. The most important causes of death in Iranian population; a retrospective cohort Study. Emerg (Tehran). 2015;3(1):16-21. [PubMed ID: 26512364]. [PubMed Central ID: PMC4614603].
-
2.
Khawaja IS, Westermeyer JJ, Gajwani P, Feinstein RE. Depression and coronary artery disease: The association, mechanisms, and therapeutic implications. Psychiatry (Edgmont). 2009;6(1):38-51. [PubMed ID: 19724742]. [PubMed Central ID: PMC2719442].
-
3.
Hare DL, Toukhsati SR, Johansson P, Jaarsma T. Depression and cardiovascular disease: A clinical review. Eur Heart J. 2014;35(21):1365-72. [PubMed ID: 24282187]. https://doi.org/10.1093/eurheartj/eht462.
-
4.
Suls J. Toxic affect: Are anger, anxiety, and depression independent risk factors for cardiovascular disease? Emotion Rev. 2017;10(1):6-17. https://doi.org/10.1177/1754073917692863.
-
5.
Moradian ST, Msc FF. Comparison of hospital anxiety and depression among patients with coronary artery disease based on proposed treatment. Iran J Crit Care Nurs. 2011;4(2):97-102.
-
6.
Celano CM, Daunis DJ, Lokko HN, Campbell KA, Huffman JC. Anxiety disorders and cardiovascular disease. Curr Psychiatry Rep. 2016;18(11):101. [PubMed ID: 27671918]. [PubMed Central ID: PMC5149447]. https://doi.org/10.1007/s11920-016-0739-5.
-
7.
Lichtman JH, Bigger JJ, Blumenthal JA, Frasure-Smith N, Kaufmann PG, Lesperance F, et al. Depression and coronary heart disease: recommendations for screening, referral, and treatment: A science advisory from the American Heart Association Prevention Committee of the Council on Cardiovascular Nursing, Council on Clinical Cardiology, Council on Epidemiology and Prevention, and Interdisciplinary Council on Quality of Care and Outcomes Research: endorsed by the American Psychiatric Association. Circulation. 2008;118(17):1768-75. [PubMed ID: 18824640]. https://doi.org/10.1161/CIRCULATIONAHA.108.190769.
-
8.
Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24-31. [PubMed ID: 26719105]. https://doi.org/10.1016/j.genhosppsych.2015.11.005.
-
9.
Kroenke K, Spitzer RL, Williams JB, Lowe B. An ultra-brief screening scale for anxiety and depression: The PHQ-4. Psychosomatics. 2009;50(6):613-21. [PubMed ID: 19996233]. https://doi.org/10.1176/appi.psy.50.6.613.
-
10.
Khubchandani J, Brey R, Kotecki J, Kleinfelder J, Anderson J. The psychometric properties of PHQ-4 depression and anxiety screening scale among college students. Arch Psychiatr Nurs. 2016;30(4):457-62. [PubMed ID: 27455918]. https://doi.org/10.1016/j.apnu.2016.01.014.
-
11.
Kocalevent RD, Finck C, Jimenez-Leal W, Sautier L, Hinz A. Standardization of the Colombian version of the PHQ-4 in the general population. BMC Psychiatry. 2014;14:205. [PubMed ID: 25037706]. [PubMed Central ID: PMC4223637]. https://doi.org/10.1186/1471-244X-14-205.
-
12.
Lowe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: Validation and standardization of the Patient Health questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122(1-2):86-95. [PubMed ID: 19616305]. https://doi.org/10.1016/j.jad.2009.06.019.
-
13.
First MB, Williams JBW, Karg RS, Spitzer RL. Structured clinical interview for DSM-5 disorders: SCID-5-CV clinician version. USA: American Psychiatric Association Publishing; 2016.
-
14.
Arrieta J, Aguerrebere M, Raviola G, Flores H, Elliott P, Espinosa A, et al. Validity and Utility of the Patient Health questionnaire (PHQ)-2 and PHQ-9 for screening and diagnosis of depression in rural Chiapas, Mexico: A Cross-Sectional Study. J Clin Psychol. 2017;73(9):1076-90. [PubMed ID: 28195649]. [PubMed Central ID: PMC5573982]. https://doi.org/10.1002/jclp.22390.
-
15.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-13. [PubMed ID: 11556941]. [PubMed Central ID: PMC1495268]. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.
-
16.
Dadfar M, Kalibatseva Z, Lester D. Reliability and validity of the Farsi version of the Patient Health questionnaire-9 (PHQ-9) with Iranian psychiatric outpatients. Trends Psychiatry Psychother. 2018;40(2):144-51. [PubMed ID: 29995159]. https://doi.org/10.1590/2237-6089-2017-0116.
-
17.
Kroenke K, Spitzer RL, Williams JB. The Patient Health questionnaire-2: Validity of a two-item depression screener. Med Care. 2003;41(11):1284-92. [PubMed ID: 14583691]. https://doi.org/10.1097/01.MLR.0000093487.78664.3C.
-
18.
Zhang YL, Liang W, Chen ZM, Zhang HM, Zhang JH, Weng XQ, et al. Validity and reliability of Patient Health Questionnaire-9 and Patient Health questionnaire-2 to screen for depression among college students in China. Asia Pac Psychiatr. 2013;5(4):268-75. [PubMed ID: 24123859]. https://doi.org/10.1111/appy.12103.
-
19.
Beck AT, Steer RA, Brown G. Beck depression inventory-II. San Antonio. 1996;78(2):490-8. https://doi.org/10.1037/t00742-000.
-
20.
Ghassemzadeh H, Mojtabai R, Karamghadiri N, Ebrahimkhani N. Psychometric properties of a Persian-language version of the beck depression inventory--second edition: BDI-II-Persian. Depress Anxiety. 2005;21(4):185-92. [PubMed ID: 16075452]. https://doi.org/10.1002/da.20070.
-
21.
Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch Intern Med. 2006;166(10):1092-7. [PubMed ID: 16717171]. https://doi.org/10.1001/archinte.166.10.1092.
-
22.
Kroenke K, Spitzer RL, Williams JB, Lowe B. The Patient Health questionnaire somatic, anxiety, and depressive symptom scales: A systematic review. Gen Hosp Psychiatry. 2010;32(4):345-59. [PubMed ID: 20633738]. https://doi.org/10.1016/j.genhosppsych.2010.03.006.
-
23.
Seo JG, Park SP. Validation of the generalized anxiety disorder-7 (GAD-7) and GAD-2 in patients with migraine. J Headache Pain. 2015;16:97. [PubMed ID: 26596588]. [PubMed Central ID: PMC4656257]. https://doi.org/10.1186/s10194-015-0583-8.
-
24.
McManus D, Pipkin SS, Whooley MA. Screening for depression in patients with coronary heart disease (data from the Heart and Soul Study). Am J Cardiol. 2005;96(8):1076-81. [PubMed ID: 16214441]. [PubMed Central ID: PMC2776683]. https://doi.org/10.1016/j.amjcard.2005.06.037.