Iranian Version of the Quality of Life in Adult Cancer Survivors (QLACS) Questionnaire: Examining Face and Content Validity, Exploratory Factor Analysis and Reliability

authors:

avatar Fariba Fathollahi-Dehkordi 1 , avatar Ziba Farajzadegan 2 , * , avatar Simin Hematti 3 , avatar Narges Motamedi 2

Social Determinants of Health Research Center, Shahrekord University of Medical Sciences, Shahrekord, Iran
Community Medicine Department, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
Radiotherapy Department, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran

how to cite: Fathollahi-Dehkordi F, Farajzadegan Z, Hematti S, Motamedi N. Iranian Version of the Quality of Life in Adult Cancer Survivors (QLACS) Questionnaire: Examining Face and Content Validity, Exploratory Factor Analysis and Reliability. Shiraz E-Med J. 2021;22(2):e100390. https://doi.org/10.5812/semj.100390.

Abstract

Background:

Quality of life among cancer patients after diagnosis and treatment steps is an important factor in preventing further cancer complications. Thus, appropriate tools to evaluate the quality of life among this group are required. Quality of life in Adult Cancer Survivors (QLACS) questionnaire is a suitable tool which evaluates different aspects of life among cancer survivors.

Objectives:

This study evaluated the Persian version of the QLACS questionnaire among Iranian short-survivors of breast cancer by assessing its validity and reliability.

Methods:

The QLACS was translated to Persian for this study. The questionnaire's face and content validity were assessed by a panel of experts by the impact score, content validity ratio, and index methods. In the next step, the questionnaire was filled out by 150 women with breast cancer who were diagnosed 1.5 - 5 years before this study. Explanatory factor analysis was performed to assess factors. Reliability was evaluated using Cronbach’s alpha.

Results:

Overall, 37 items were selected for explanatory factor analysis that had an impact score of more than 1.5, content validity ratio (CVR) more than 0.99, and a suitable content validity index (CVI). In factor analysis, 10 factors were extracted via varimax rotation, accounting for 75.8% of the total variance. Cronbach’s alpha of all the factors was more than 0.7, that was similar to the original questionnaire.

Conclusions:

We conclude that the Persian version of the QLACS questionnaire has optimal properties for the assessment of quality of life among Iranian short-survivors of breast cancer.

1. Background

Breast cancer is the most important type of cancer among women worldwide, including Iran, comprising 23% of all cancers in this group around the globe and 21.4% in Iran (1, 2). Today, the rate of breast cancer mortality has reduced because of advancements in its screening and treatment methods. Thus, the percentage of patients living with this cancer is increasing (3). An American study showed that 89.2% of women with breast cancer were alive after five years of cancer diagnosis (4). In another study in Iran, 58% of women with cancer were alive after five years of diagnosis (5). According to the national cancer definition, survivor of cancer is defined as a patient with cancer from diagnosis to death (4). The growing number of breast cancer survivors indicates a need for a comprehensive evaluation of different physical and mental aspects to prevent or reduce cancer-related disability.

Quality of life is a good way to comprehensively evaluate patients’ needs, understand success or failure in the treatment process, and prevent further complications of the cancer (4, 6, 7). Multiple tools have been used to determine the quality of life in the active phase of the illness, such as FACT-B and EORTC (6). EORTC QLQ-C30 questionnaire has been standardized for Iranian women (8). However, this tool cannot evaluate the patient’s quality of life after the treatment process. Thus, a tool for evaluating long-term effects of treatment and illness on physical, psychological , cognitive and sexual conditions is required (9). This tool should cover problems encountered at the end of treatment, such as pain, worry about appearance, and illness relapse (9). Quality of life in the Adult Cancer Survivor (QLACS) questionnaire covers different aspects of patient’s. This questionnaire includes 12 sections, seven of which are related to the general condition of quality of life and five sections to special conditions of cancer patients (3). This questionnaire was first designed to evaluate the quality of life in long survivors of cancer (6). But later studies showed this questionnaire is suitable for short-survivors of cancer as well (3, 4).

2. Objectives

Considering the inability of the available tools to evaluate the quality of life among Iranian cancer survivors at the end of treatment and follow up stages and the ability of QLACS questionnaire, this study was performed to evaluate the properties of the Persian version of QLACS questionnaire among Iranian short-survivors of breast cancer by assessing its validity and reliability.

3. Methods

This was a cross-sectional study. The inclusion criteria included patients diagnosed with stage I, II, or III breast cancer 1.5 - 5 years before starting the study, having finished the active stages of treatment, being in follow up stage, ability to read and understand Persian, and interest to participate. This study was performed at Sayed al-Shohada Hospital clinics, a referral center for cancer patients in Isfahan city in 2017. The eligibility criteria for the center included providing accessibility to a large number of breast cancer survivors in follow up stages. At first, the interviewer explained the purpose of the study, the voluntary nature of participation, and confidentiality of information. Then, the questionnaire was filled out by patients who were willing to participate.

3.1. Questionnaire

The QLACS questionnaire includes 47 items categorized into 12 domains rated based on a seven-point Likert scale. It consists of seven domains related to the general condition, including positive and negative feelings, cognitive and sexual problems, pain, fatigue, and social avoidance. There are five domains associated with the cancer-specific condition. Its topics include appearance concern, financial problems, recurrence concern, family-related distress, and cancer benefit. In this study, items were rated based on a five-point Likert scale (i.e., never , seldom, sometime, usually, and always) (3).

3.2. Procedure

3.2.1. Translation

In this study, we used the forward-backward method. At first, the original version of the questionnaire was translated to Persian by two native Iranians who were proficient in English and were aware of the research objectives. A review session was held to make the necessary changes and provide the first Persian version of the questionnaire. At the backward step, the Persian version of the questionnaire was separately back-retranslated into English by two bilingual English speakers who was aware of the study objectives. A session was held to compare translations with the original version of the questionnaire. The final Persian version was prepared after making the necessary changes (10).

3.2.2. Face Validity

We used the quantitative method to evaluate the face validity of the questionnaire. Quantitative face validity was established by an impact score. In this method, validity is calculated by multiplying the importance of each item with its frequency. The importance of each item is rated based on a Likert scale ranging from very important (5 score) to unimportant (1 score). An impact score of more than 1.5 is considered suitable. To determine quantitative face validity, the questionnaire was evaluated by a panel of experts, including an internal specialist, a psychologist, three palliative care specialists, and a specialist related to tool making (11).

3.2.3. Content Validity

To evaluate content validity, we used content validity ratio (CVR) for investigating items’ necessity and content validity index (CVI) for items’ relevance.

A three-point Likert scale was used to evaluate the necessity of each item as follows: necessary (3 scores), useful but not necessary (2 scores), not necessary (1 score). The formula of content validity ratio is CVR= (Ne - N/2)/(N/2). In this formula, N is the number of specialists, and Ne is the number of specialists who indicated item necessity. A CVR of more than 0.99 was meaningful and acceptable according to the Lawshe table based on the number of panelists (12).

The relevancy of each item was assessed by a four-point Likert scale as follows: very relevant (4 scores), relevant (3 scores), relatively relevant (2 scores), and not relevant (1 score). The formula of the content validity index is CVI = Nr/N. In this formula, N is the number of specialists, and Nr is the number of specialists who selected relevant or very relevant for each item. A CVI of more than 0.79 was considered suitable. The items with CVI between 0.7 - 0.79 were acceptable after item modification (11).

3.2.4. Construct Validity

We used exploratory factor analysis (EFA) for this section. EFA is a statistical method that identifies the dimensionality of structures by exploring relations between factors and items (13). This method sets the number of questionnaire domains that do not overlap with each other (14). The suitable sample size for EFA is 3-6 cases for every item, according to Cattell (15).

3.2.5. Reliability

We used Cronbach’s alpha coefficient to assess the reliability of the questionnaire. Α value of more than 0.7 was considered suitable (14, 16).

3.3. Statistical Analysis

Descriptive statistics were used to calculate face and content validity. EFA was used to determine construct validity. EFA process was started with the Kaiser-Meyer-Olkin (KMO) test that measures sampling adequacy, and Bartlett’s test of sphericity confirmed that data collected for EFA are suitable (13). A significant value for Bartlett’s test of sphericity is less than 0.05 to continue EFA. Appropriate KMO is more than 0.6 (13). For factor extraction, principle component analysis and varimax rotation were used. Eigenvalue and scree plot graphics were used to determine the number of factors to be extracted. Eigenvalue was considered more than 1 that explained variance percentage of each factor was more than 3% (17). The reliability of the questionnaire was calculated according to Cronbach’s alpha.

4. Results

The panel of experts included six specialists who evaluated quantitative face validity via impact score and content validity via CVR and CVI.

The impact score, CVR, and CVI of the questionnaire items are shown in Table 1. One item was deleted in the face validity stage. This item had an impact score of less than 1.5. Nine items were deleted in the content validity stage. Seven items had a CVR of less than 0.99, and two items had CVI less than 0.7.

Table 1.

Impact Score, CVR1 and CVI2 Results Among Breast Cancer Survivors

NQuestionImpact ScoreCVRCVI
1You had the energy to do the things you wanted to do4.811
2You had difficulty doing activities that require concentrating.3.5611
3You were bothered by having a short attention span.2.310.66*-
4You had trouble remembering things3.7411
5You felt fatigued.4.811
6You felt happy4.811
7You felt blue or depressed.511
8You enjoyed life4.811
9You worried about little things2.640.66*-
10You were bothered by being unable to function sexually4.810.66*
11You didn’t have energy to do the things you wanted to do2.860.66*-
12You were dissatisfied with your sex life4.811
13You were bothered by pain that kept you from doing the things you wanted to do4.811
14You felt tired a lot1.580.66*-
15You were reluctant to start new relationships210.83
16You lacked interest in sex4.6611
17Your mood was disrupted by pain or its treatment511
18You avoided social gatherings3.8711
19You were bothered by mood swings1.7510.83
20You avoided your friends2.6410.83
21You had aches or pains511
22You had a positive outlook on life4.810.83
23You were bothered by forgetting what you started to do2.5210.83
24You felt anxious4.6611
25You were reluctant to meet new people1.7510.83
26You avoided sexual activity3.1811
27Pain or its treatment interfered with your social activities4.511
28You were content with your life4.811
29You appreciated life more because of having had cancer3.450.66*-
30You had financial problems because of the cost of cancer surgery or treatment3.4511
31You worried that your family members were at risk of getting cancer3.4511
32You realized that having had cancer helps you cope better with problems now2.410.66*-
33You were self-conscious about the way you look because of your cancer or its treatment2.5210.66*
34You worried about whether your family members might have cancer-causing genes1.660.66*-
35You felt unattractive because of your cancer or its treatment3.7310.83
36You worried about dying from cancer511
37You had problems with insurance because of cancer2.5210.83
38You were bothered by hair loss from cancer treatment4.6611
39You worried about cancer coming back511
40You felt that cancer helped you to recognize what is important in life1.6610.83
41You felt better able to deal with stress because of having had cancer1.9810.88
42You worried about whether your family members should have genetic tests for cancer0.99*--
43You had money problems that arose because you had cancer3.3211
44You felt people treated you differently because of changes to your appearance due to your cancer or its treatment2.8511
45You had financial problems due to a loss of income as a result of cancer3.3211
46Whenever you felt a pain, you worried that it might be cancer again3.7311
47You were preoccupied with concerns about cancer2.6411

Construct validity was established on 37 items via factor analysis. In this section, the questionnaire was filled out by 150 patients who met the inclusion criteria (four samples per item). Participants were between 30 - 68 years old. Kaiser-Meyer-Olkin (KMO) test confirmed the sampling adequacy for EFA, KMO = 0.844. Bartlett’s test of sphericity, χ2 = 3504.456, P < 0.000 showed that correlations between items were suitable to conduct EFA. Ten factors had eigenvalues greater than one, and the scree plot is shown in Figure 1. Factor analysis extracted 10 factors via varimax rotation, accounting for 75.8% of the total variance (Table 2). Item 31 was transferred to the recurrence-distress factor, and recurrence-distress and family distress factors were merged. Positive and negative feelings factors were merged.

Table 2.

QLACS Factor Analysis Results Among Breast Cancer Survivors

Factor 1Factor 2Factor 3FactorFactor 5FactorFactor 7Factor 8Factor 9Factor 10
Negative/positive feeling
1.You felt happy0.2190.2320.6820.0810.0770.0390.2620.0360.229-0.071
2.You felt blue or depressed0.2470.2720.5420.0630.0810.1980.1910.0440.350.014
3. You enjoyed life0.1470.2280.678-0.010.1050.1920.1850.0880.3310.062
4 You were bothered by mood swings0.1140.4340.5010.0340.1790.1810.2360.230.0520.176
5. You had a positive outlook on life0.1930.1810.7730.0460.1880.078-0.0110.0740.1450.214
6. You felt anxious0.4110.4220.4380.1750.0530.1880.2270.02-0.0230.031
7. You were content with your life0.1660.0410.7570.0360.230.0720.1520.241-0.20.119
Distress/recurrence
8. You worried that your family members were at risk of getting cancer0.6130.1040.066-0.114-0.115-0.0010.469-0.141-0.103-0.09
9. You worried about dying from cancer0.8030.1760.1730.0780.2220.0390.040.1540.0490.054
10. You worried about cancer coming back0.8040.0540.1250.212-0.0260.0530.0750.1080.1380.081
11. Whenever you felt a pain, you worried that it might be cancer again0.8550.040.1910.0480.0210.1450.0230.1950.140.017
12. You were preoccupied with concerns about cancer0.8130.0830.1920.0850.0420.1030.0850.2720.1640.019
Social avoidance
13. You were reluctant to start new relationships0.0370.6590.1220.0870.020.0120.0160.180.3060.023
14. You avoided social gatherings0.0980.8660.1660.0440.1560.0720.1220.075-0.0290.076
15. You avoided your friends0.090.8760.170.0690.1440.1460.0120.135-0.0160.039
16. You were reluctant to meet new people0.1120.8270.1620.0780.1570.140.1390.124-0.035-0.029
Financial problem
17. You had financial problems because of the cost of cancer surgery or treatment0.1240.1070.0340.87-0.0770.1120.1360.012-0.0310.04
18. You had problems with insurance because of cancer0.0430.05-0.010.7380.126-0.0830.028-0.0390.161-0.002
19. You had money problems that arose because you had cancer0.1080.0680.0830.916-0.0890.0920.1010.096-0.0770.099
20. You had financial problems due to a loss of income as a result of cancer0.0330.0420.0640.864-0.0350.0280.0970.08-0.0770.006
Sexual problem
21. You were dissatisfied with your sex life.0.0470.1510.115-0.0310.890.0030.059-0.0520.0780.105
22. You lacked interest in sex0.0590.1340.139-0.0440.850.1260.046-0.0880.140
23. You avoided sexual activity0.0410.190.280.0140.7570.0940.1560.0890.156-0.027
Cognitive problems
24. You had difficulty doing activities that require concentrating.0.0940.2210.1720.059-0.0430.8150.1170.03-0.0680.067
25. You had trouble remembering things.0.0320.0410.10.0480.0810.870.077-0.020.220.133
26. You were bothered by forgetting what you started to do.0.1670.1230.0990.0210.1870.8460.139-0.0160.124-0.059
Pain
27. You were bothered by pain that kept you from doing the things you wanted to do.0.020.0530.0750.2160.1860.1560.7380.150.2210.031
28. Your mood was disrupted by pain or its treatment.0.0780.2750.3560.1570.1270.1140.5020.1860.1780.142
29. You had aches or pains0.1360.0110.2660.0790.0510.160.670.0770.1660.127
30. Pain or its treatment interfered with your social activities.0.2090.2950.1960.2180.0370.0610.6440.293-0.0380.075
Appearance
31. You felt unattractive because of your cancer or its treatment.0.1790.3290.1220.0190.021-0.010.0560.7940.0240.01
32. You were bothered by hair loss from cancer treatment.0.2390.0330.115-0.012-0.338-0.0310.2830.612-0.163-0.022
33. You felt people treated you differently because of changes to your appearance due to your cancer or its treatment.0.2240.1950.1630.1280.0410.0090.160.757-0.0370.03
Fatigue/energy
34. You had the energy to do the things you wanted to do.0.1820.0740.178-0.0850.2460.0880.115-0.0590.7860.154
35. You felt fatigued.0.1880.0110.2060.0370.1760.1970.236-0.0950.7140.062
Benefits
36. You felt that cancer helped you to recognize what is important in life.-0.0370.0450.1260.010.0920.0130.104-0.0340.0430.901
37. You felt better able to deal with stress because of having had cancer.0.1160.0540.1010.107-0.020.1060.0580.060.1150.856
Scree plot for the QLACS instrument
Scree plot for the QLACS instrument

The reliability of the questionnaire was evaluated by Cronbach’s alpha. In this section, the questionnaire was filled out by 20 patients who met the inclusion criteria. Cronbach’s alpha was calculated by the statistical analysis for each factor (Table 3). Cronbach’s alpha coefficients were more than 0.7 for all the factors.

Table 3.

QLACS Factors Reliability Among Survivors of Breast Cancer

QLACS Questionnaire Cronbach’s α
Distress-recurrence0.92
Social avoidance0.92
Positive and negative feeling0.88
Financial problem0.93
Sexual interest0.90
Cognitive problem 0.88
Pain0.74
Appearance0.86
Energy0.93
Benefit0.87

5. Discussion

Quality of life evaluation can help to determine the necessary interventions for improving cancer survivor’s quality of life. Among the available tools, we used the QLACS questionnaire because it covered different aspects of life among cancer survivors (3). In this study, after the translation process, we evaluated the face, content and construct validity and reliability of the questionnaire. Overall, 46 items had impact scores of more than 1.5; thus, they were used to evaluate CVR and CVI validity. Nine items were deleted in the content validity stage because of CVR less than 0.99 (seven items) and CVI less than 0.7 (two items). EFA extracted 10 factors from the 37 items. All of the questionnaire domains had a Cronbach’s alpha coefficient of more than 0.7.

According to our results, 10 items were deleted in the face and content validity stages. One reason can be the specialist panel that expressed their opinions subjectively about items. However, specialists’ panel were involved in different aspects of cancer patients to reduce this effect. Cultural and environmental differences between countries can be another reason for changing the number of items. Previous studies had not examined QLACS face and content validity.

Based on the results of KMO and Bartlett’s test of sphericity, we could confirm that our data are suitable to conduct EFA. EFA extracted 10 factors from 37 items. The Persian version had two factors less than the original questionnaire. This difference was due to integrating the recurrence-distress and family distress factors and positive and negative feelings factors. The Persian version of the QLACS questionnaire explained 75.8% of the total variance. This incoherence may be due to the number of items used for factor analysis. In this study, after face and content validity stages, 37 items were selected for EFA. Another reason can be a similar understanding of some sentences in our language. Also, the difference in target populations can justify this difference. In this study, breast cancer patients were studied, but the original questionnaire was used for different kinds of cancers (6).

We identified a negative, positive dimension: This factor includes many of the same items as original QLACS questionnaire positive and negative feeling domains except one item ("you were bothered by having a short attention span."). This item was deleted in the content validity stage because could not obtain CVR more than 0.99 according to panelist opinions for necessary aspect. CVR is dependent on the number of panel specialist. In this study, we had a panel, including 6 specialists. In previous studies, CVR was not calculated for QLACS.

We identified a Distress/recurrence dimension: This factor includes items of the distress- recurrence domain and one item from the family-distress domain from the original QLACS questionnaire. Two items from the family distress domain were deleted in this study. The item "you were worried about whether your family members should have genetic tests for cancer" was deleted thein face validity stage because this item could not obtain sufficient importance score according to the panelists’ opinions. "You were worried about whether your family members might have cancer-causing genes" was deleted in the content validity stage.

We identified a social avoidance dimension: This factor included the same items as the social avoidance factor in the original QLACS questionnaire. We also identified a financial dimension: This factor included all the items that were similar to those in the original questionnaire.

We identified a sexual problem dimension: This factor included three items of the sexual problem domain in the original questionnaire. One item (“you were bothered by being unable to function sexually”) was deleted in the content validity stage according to the panelists’ opinions, which could be due to cultural issues.

We identified a cognitive problem dimension: This factor expressed three items of the same factor in the original instrument. One Item ("you were bothered by having a short attention span") was deleted due to CVR less than 0.99.

We identified a pain dimension: This factor was similar to that in the original instrument.

We identified an appearance concerns dimension: This factor included all of the items as the original questionnaire except for “you were self-conscious about the way you look because of your cancer or its treatment”. This item was deleted because it was not relevant enough according to the panelists’ opinions.

We identified a fatigue/energy dimension: This factor expressed two items from the original instrument. Items “you did not have the energy to do the things you wanted to do” and “you felt tired a lot” were deleted because of CVR less than 0.66.

We identified a benefit dimension: This factor included two items from the original questionnaire. In this study, two items were deleted from the benefit factor from the original questionnaire. Items “You appreciate life more because of having had cancer” and “You realize that having had cancer helps you cope better with problems now” were deleted because of CVR less than 0.6 (6).

Previous studies did not apply EFA for the QLACS questionnaire, which limited our comparisons (3, 9). However, EFA should be used in the early stages of developing or correcting an instrument (13).

In this study, Cronbach’s alpha was used to evaluate internal consistency. The range of Cronbach’s alpha was between 0.74 - 0.93 for different factors of the questionnaire. The range of Cronbach’s alpha for the original questionnaire factors was between 0.72 - 0.91 that was similar to our results. In the Spanish version of the questionnaire, the range of Cronbach’s alpha was between 0.73 and 0.87 (6).

Our results supported that the Persian version of the QLACS questionnaire has suitable properties for evaluating the quality of life among short survivors of breast cancer.

5.1. Limitations

There were some limitations to this study. According to the specialist panel’s suggestions, face and content validity were determined so it can change by changing the specialist panel. For further studies, we suggest a panel group with a greater number of specialists to reduce this effect. In this study, we used EFA for construct validity. For further studies we recommend confirmatory factor analysis for confirming our findings.

5.2. Conclusion

According to the results, the Persian version of the QLACS questionnaire has optimal properties for assessing the quality of life among Iranian short-survivors of breast cancer.

Acknowledgements

References

  • 1.

    Farajzadegan Z, Fathollahi-Dehkordi F, Hematti S, Sirous R, Tavakoli N, Rouzbahani R. The transtheoretical model, health belief model, and breast cancer screening among Iranian women with a family history of breast cancer. Journal of Research in Medical Sciences. 2016;21(1):122.

  • 2.

    Ozmen V. Breast cancer in the world and Turkey. J Breast Health. 2008;4(2):6-12.

  • 3.

    Escobar A, del Mar Trujillo-Martín M, Rueda A, Pérez-Ruiz E, Avis NE, Bilbao A. Cross-cultural adaptation, reliability and validity of the Spanish version of the Quality of Life in Adult Cancer Survivors (QLACS) questionnaire: application in a sample of short-term survivors. Health and quality of life outcomes. 2015;13(1):1.

  • 4.

    Sohl SJ, Levine B, Avis NE. Evaluation of the Quality of Life in Adult Cancer Survivors (QLACS) scale for early post-treatment breast cancer survivors. Quality of Life Research. 2015;24(1):205-12.

  • 5.

    Rezaianzadeh A, Peacock J, Reidpath D, Talei A, Hosseini SV, Mehrabani D. Survival analysis of 1148 women diagnosed with breast cancer in Southern Iran. BMC cancer. 2009;9(1):1.

  • 6.

    Avis NE, Smith KW, McGraw S, Smith RG, Petronis VM, Carver CS. Assessing quality of life in adult cancer survivors (QLACS). Quality of Life Research. 2005;14(4):1007-23.

  • 7.

    Kamp K, Flanigan M, Thana K, Terpstra J, Wyatt G, Sikorskii A. Expanding Application of the Long-Term Quality of Life Instrument to the Population of Women Undergoing Treatment of Advanced Breast Cancer. Cancer Nursing. 2019.

  • 8.

    Montazeri A, Harirchi I, Vahdani M, Khaleghi F, Jarvandi S, Ebrahimi M, et al. The EORTC breast cancer-specific quality of life questionnaire (EORTC QLQ-BR23): translation and validation study of the Iranian version. Quality of Life Research. 2000;9(2):177-84.

  • 9.

    Avis NE, Ip E, Foley KL. Evaluation of the Quality of Life in Adult Cancer Survivors (QLACS) scale for long-term cancer survivors in a sample of breast cancer survivors. Health and quality of life outcomes. 2006;4(1):1.

  • 10.

    Ataei J, Shamshirgaran SM, Iranparvar M, Safaeian A, Malek A. Reliability and validity of the Persian version of the Kessler psychological distress scale among patients with type 2 diabetes. Journal of Analytical Research in Clinical Medicine. 2015;3(2).

  • 11.

    Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar A. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of caring sciences. 2015;4(2):165.

  • 12.

    Lawshe CH. A quantitative approach to content validity1. Personnel psychology. 1975;28(4):563-75.

  • 13.

    Yu T, Richardson JC. An exploratory factor analysis and reliability analysis of the student online learning readiness (SOLR) instrument. Online Learning. 2015;19(5):120-41.

  • 14.

    Amiri P, Ardekani EM, Jalali-Farahani S, Hosseinpanah F, Varni JW, Ghofranipour F, et al. Reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales in adolescents. Quality of Life Research. 2010;19(10):1501-8.

  • 15.

    Helen C, Rowlinson S. sample size in factor analysis: why size matters. 2006, [cited 2017/14/01]. Available from: http://www.researchgate.net/publication/23862291.

  • 16.

    Araban M, Tavafian SS, Zarandi SM, Hidarnia AR, Gohari MR, Prochaska JM, et al. Introducing a new measure for assessing self-efficacy in response to air pollution hazards for pregnant women. Journal of Environmental Health Science and Engineering. 2013;11(1):1.

  • 17.

    Demo G, Neiva ER, Nunes I, Rozzett K. Human resources management policies and practices scale (HRMPPS): Exploratory and confirmatory factor analysis. BAR-Brazilian Administration Review. 2012;9(4):395-420.