Abstract
Background:
Quality of care in breast cancer is a widely researched topic, with many objectively measurable indicators of quality in healthcare. However, while there is a large consensus on the importance of patient’s perspective in breast cancer care process, there are only a few tools to measure such subjective indicators, and none of them has been validated for its use in Italy yet.Objectives:
The aim of this methodological study was to validate a cultural and organizational adaptation of the quality of care through the patient’s eyes breast cancer (QUOTE-BC) questionnaire for its use in Italian breast units.Methods:
The QUOTE-BC questionnaire was translated, adapted for the Italian context and pre-tested on a small sample of breast cancer patients during their hospital stay. The questionnaire was then administered to a large sample of patients from December 2016 to May 2017 in order to further validate it. A visual analogue scale (VAS) was also handed out to assess patients' level of satisfaction.Results:
A total of 212 patients filled the questionnaire. Confirmatory factor analysis corroborated the five-factor structure of the original questionnaire explaining 80.2% of the total variance. The Cronbach alpha ranged from 0.69 to 0.84 showed a good level of internal consistency. The VAS difference between the groups of patients giving positive and negative answers showed that, in almost all the items, there was a statistically significant difference in patients’ level of satisfaction between the two groups.Conclusions:
In this study, we validated the first Italian adaptation of the QUOTE-BC (IT-QUOTE-BC) questionnaire, which represents a valuable tool for supporting clinical and organizational decisions in Italian breast units. Moreover, the routine use of the IT-QUOTE-BC questionnaire in the same breast unit is a tool to verify the improvement in organizational quality change as perceived by the patients.Keywords
1. Background
Breast cancer, being the most frequent form of cancer among women, represents a serious problem in modern society. As defined by the European Society of Mastology (EUSOMA) and then by the European guidelines, documents, and scientific papers (1-11) breast cancer care requires a multidisciplinary and well- structured approach. Experts in different fields need to join their competencies and work in specialized breast cancer clinics (breast units) where patients receive high-quality personalized care. While most of the past scientific papers focused on the importance of process quality indicators of breast cancer care (e.g. the minimal/optimal composition of the expert team, compliance to care protocols, re-hospitalization, surgical site infections, etc.) (12, 13), only few studies have provided a quantitative approach on patient’s perspective (14-19). It is very useful to collect the patient’s opinion when the performance of breast unit professionals are evaluated. It has been shown that patient’s feedback improves physicians’ team performance and care quality. Furthermore, at the organizational level patient’s satisfaction may provide useful information about the ability of hospital to provide good service as a part of the patient’s experience (20-25).
According to the authors’ knowledge, two questionnaires have been developed with the aim to evaluate patient’s perspective on the breast cancer care: the quality of care through the patients’ eyes breast cancer (QUOTE-BC) questionnaire (17); and the consumer quality index (CQ-index) breast care instrument (14).
For the purpose of the current study, we chose the QUOTE-BC questionnaire so that we only assess the aspects of hospital breast cancer care, instead of the CQ-index items which are usually focused on assessing other health care sectors (e.g. relation with the general practitioner).
The QUOTE-BC is a questionnaire which was developed by the Netherland Institute of Public Health. It is specifically designed to provide data on how breast cancer patients experience healthcare services, to explore issues related to patients’ needs and expectations and to produce useful data for quality assessment in breast cancer care. Several examples of translation and cultural adaptation of instruments using the QUOTE methodology have been already reported for different health conditions in different languages (26-31).
Based on the best of the authors’ knowledge, none of the existing instruments to evaluate the patients’ experience have yet been translated, adapted, and validated for the Italian population.
Therefore, the aim of this methodological study was to validate a cultural and organizational adaptation of the QUOTE-BC for its use in Italian breast units.
The questionnaire comprised 33 items covering the most important aspects of breast cancer care, from diagnostic tests to adjuvant treatment, assessing both the quality of care and the performance provided by healthcare professionals. Patients were asked to rate perceived performance of the healthcare professionals/services. Four-point Likert-type scales (never; sometimes; usually; always) were used for most questions, while dichotomous answering categories (yes/no) were applied for the rest of the items. The subscales referred to: (1) patient education regarding postoperative treatment (6 Likert-type items); (2) services by the breast nurse (5 Likert-type items); (3) services by the surgeon (6 Likert-type items); (4) patient education regarding activities at home (3 dichotomous items); (5) patient education regarding aspects related to preoperative treatment (4 dichotomous items). The questionnaire also comprised a set of 9 miscellaneous items that were not grouped into a specific scale. The resulting set of items was easy to complete and enabled anonymous responses. The instrument combines experience and needs of breast cancer patients with outcome measures, offering specific information about the quality of specific aspects of breast cancer care, which can become targets for quality improvement actions.
2. Methods
2.1. Study Overview
Due to the methodological nature of this study, the research was divided into two separate steps (Figure 1).
•From May to June 2014, a preliminary phase was carried out involving translation, adaptation, and pre-test of the questionnaire in Italy on a small sample of patients in breast unit, resulting in the assessment of the Italian version of the QUOTE-BC (IT-QUOTE-BC) adapted to the Italian population;
•From December 2016 to May 2017, data collection activity was performed by administering the previously developed IT-QUOTE-BC to a large group of patients to further validate the questionnaire by assessing its factorial structure, internal consistency, and construct validity.
Overview of the Research Process
2.1.1. Step A: Translation, Adaptation, and Pre-Testing of the IT-QUOTE-BC
The translation process was carried out by following established good process; first, the original English tool was initially distributed among a team of experts (1 breast surgeon, 2 epidemiologists, 1 public health doctor, and 1 general surgery resident). Translation from English into Italian was carried out by each member, resulting in an initial collection of different translations which were later merged into a single one by the whole team. In order to check the translation reliability, the resulting version was translated back into English and evaluated by the team. Finally, the team filled out the questionnaire to detect any possible ambiguities and misinterpretations (32). To further pre-test the adapted version for comprehensibility, the questionnaire was administered to a convenience sample of 20 breast cancer patients who were also interviewed to check possible misinterpretations.
In line with previously reported adaptations of similar QUOTE questionnaires (26-28, 31), a visual analogue scale (VAS) was added at the end of the questionnaire to detect the patients’ satisfaction on the quality of breast unit. The patients had to mark a 10 cm horizontal line that varies from 0 (totally dissatisfied) to 10 (very satisfied) (33). The IT-QUOTE-BC is available upon request from the corresponding author.
2.1.2. Step B: IT-QUOTE-BC Validation
To validate the IT-QUOTE-BC we conducted a field study by recruiting patients in breast units located in north-eastern regions of Italy (Autonomous Province of Trento, Friuli Venezia Giulia, and Veneto). In order to collect the most comprehensive sample possible, all patients accessing the breast units from December 2016 to May 2017 were initially screened for eligibility. Patients were eligible if: (a) scheduled for surgery for any type of breast cancer, (b) aged 18 years or older, (c) mentally competent as judged by doctors, and (d) hospitalized in the breast unit for at least 2 days. All study participants were female. Patients with pre-neoplastic lesions and who underwent on a day-surgery setting were excluded from the study due to short stay at the hospital. Surgeons of breast units performed recruitment and invited the patients to participate in the hospital admission study. After briefing about the study, patients were asked to sign informed consent to be included as study participants. During the first medical examination after surgery, participants received a paper sheet of the IT-QUOTE-BC questionnaire to fill it at home to improve acceptability and comfort while answering. Demographic information (date of birth, residence, educational level, and occupational condition) was also collected. The questionnaire was then returned in a closed envelope during the following outpatient visit and scheduled within 10 - 15 days.
2.2. Statistical Analysis
A descriptive analysis of the sample data collected in the second step was performed. Frequencies and percentages were calculated for categorical variables, while the measures of central tendency and dispersion were calculated for continuous ones. A confirmatory factor analysis (CFA) was then conducted by confirming the structural validity and the correct assignment of each item to the respective dimension, like the original version of the QUOTE questionnaire. Cronbach alpha was calculated to test the internal consistency for each factor of the IT-QUOTE-BC: 0.70 or higher values were considered optimal (34). As the questionnaire was supposed to measure the patient’s perspective during the care process, we decided to test its construct validity by comparing IT-QUOTE-BC results with a summary measure of patients’ satisfaction using a VAS “from 1 to 10, how much do you feel satisfied with the received treatment?”
All Likert-type variables were dichotomized (never, sometimes = negative answer group; usually, always = positive answer group) and compared using the Wilcoxon-Mann-Whitney test to find any statistical difference in VAS values between patients who gave positive answers and patients who gave negative answers. The significance level for all tests was set to α = 0.05.
All the analyses were performed with SAS 9.3 software for Windows (SAS Institute Inc., Cary, North Carolina, USA).
3. Results
The following changes were required in order to provide a cultural adaptation of the original QUOTE-BC instrument to further adapt it to the Italian organizational standards:
1. There was a minor revision in the item of original questionnaire in order to allow immunohistochemistry characterization to be performed on local standards of care. (“The results of a biopsy were communicated to me within three (working) days” was modified in “The results of a biopsy were communicated to me within seven (working) days”);
2. Since complete diagnostic results, including double-blinded read mammography performed by two expert breast radiologists, require more than 24 hours to meet local standards, the following item of the original questionnaire was eliminated: “Within 24h after diagnostic tests (mammography, breast ultrasound and a possible fine-needle biopsy)”;
3. To further explore standard quality of Italian breast units requirements, the original item on surgery timing “I was operated within 2 weeks from being diagnosed as having breast cancer” was modified into “How long did you wait for surgery after diagnosis?”, with three possible answers: within four weeks, between 4 and 6 weeks, and more than 6 weeks. The surgeons filled out this question before giving the questionnaire to the participants.
A total number of 215 breast cancer patients agreed to take part in the study and 98.6% (212) of them returned the questionnaire.
Table 1 demonstrates the socio-demographic characteristics of the participants, including information about the time between the first visit and surgery. The average age of the women who participated in the study was 59.8 years old (from 22 to 86), with a mid-low educational level (40%), and most of them were not working at the time of interview. The surgery was carried out within 6 weeks from the diagnosis for most of the participants (75%). The VAS descriptive analysis showed that 97% of the respondents had expressed a positive opinion about the quality of the care experience (median = 10).
Socio-Demographic Characteristics of the Study Sample (N = 2012)
| Variables | Values |
|---|---|
| Age | |
| Mean ± SD | 59.8 ± 13.0 |
| Median | 61.5 |
| Min - max | 22 - 86 |
| Educational attainment, No. (%) | |
| Low | 49 (23.0) |
| Middle | 36 (17.0) |
| High | 16 (7.6) |
| NR | 111 (52.4) |
| Working status, No. (%) | |
| Working | 79 (37.3) |
| Not working | 114 (53.8) |
| NR | 19 (8.9) |
| Time between breast visit and surgery, No. (%) | |
| < 4 weeks | 80 (37.7) |
| Between 4 and 6 weeks | 79 (37.3) |
| > 6 weeks | 32 (15.1) |
| NR | 21 (9.9) |
| VAS (n = 206) | |
| Mean ± SD | 9.2 ± 1.07 |
| Median | 10 |
| Min - max | 5 - 10 |
Applying CFA, we confirmed the five-factor structure of the original questionnaire which explains the 80.2% of the total variance, and the root mean square error of approximation (RMSEA) was good (= 0.01)
Results from internal consistency analysis of the sub-scales are presented in Table 2. Except for sub-scale 2, “services by the breast nurse” (alpha = 0.62), all the other sub-scales presented a good level of internal consistency, with an alpha value between 0.69 and 0.84. Although some items had a low correlation with the belonging factor (e.g. item 3.6 correlation is 0.25), the results indicated that the questionnaire presents an acceptable overall internal consistency.
Cronbach Alpha Coefficients for Each Factor of the IT-QUOTE-BC Questionnaire and Correlation Between Items and Belonging Factors
| Factors and the Related Items | Correlation with the Factors | Alpha |
|---|---|---|
| Patient’s education regarding postoperative treatment | 0.84 | |
| 1.1. Health professionals informed me well about the possible side effects of the treatment | 0.56 | |
| 1.2. Health professionals informed me well about a possible drain | 0.59 | |
| 1.3. Health professionals informed me well about a possible prosthesis | 0.41 | |
| 1.4. Health professionals informed me well about possible side effects of the treatment | 0.74 | |
| 1.5. Health professionals concerned with adjuvant treatment informed me clearly about the start of adjuvant treatment(s) | 0.75 | |
| 1.6. Health professionals concerned with adjuvant treatment informed me clearly about the consequences of adjuvant treatment (e.g., tiredness, boldness, swollen arm) | 0.67 | |
| Services by the breast nurse | 0.62 | |
| 2.1. The breast nurse listened to me attentively | 0.34 | |
| 2.2. The breast nurse treated me as an equal | 0.28 | |
| 2.3. The breast nurse took me seriously | 0.46 | |
| 2.4. The breast nurse spent enough time on my consultation | 0.50 | |
| 2.5. The breast nurse explained things to me in understandable language | 0.29 | |
| Services by the surgeon | 0.78 | |
| 3.1. The surgeon listened to me attentively | 0.49 | |
| 3.2. The surgeon treated me with respect | 0.64 | |
| 3.3. The surgeon took me seriously | 0.67 | |
| 3.4. The surgeon spent enough time on my consultation | 0.63 | |
| 3.5. The surgeon explained things to me in understandable language | 0.48 | |
| 3.6. The surgeon was informed about my life before the consultation started | 0.25 | |
| Patient education regarding activities at home | 0.69 | |
| 4.1. Health professionals informed me well about wound care in the home situation | 0.47 | |
| 4.2. Health professionals informed me clearly about what I should and should not do after surgery | 0.52 | |
| 4.3. Health professionals informed me well about exercises for the period after surgery | 0.51 | |
| Patient education regarding aspects related to preoperative treatment | 0.79 | |
| 5.1. Health professionals informed me well about survival rates that were known about my type of breast cancer | 0.43 | |
| 5.2. Health professionals informed me well about different treatment options | 0.67 | |
| 5.3. Health professionals informed me clearly about risks of different treatment options | 0.72 | |
| 5.4. Health professionals informed me/ provided me with good information about what the chosen treatment consisted of | 0.58 |
The results of the Wilcoxon-Mann-Whitney test which compares the VAS measure of patients’ satisfaction between the two groups of patients (positive and negative answers) are presented in Table 3. Most of the items showed that the VAS significantly differed between two groups of patients, with only four exceptions (items 2.5, 3.5, 3.6 and 6.2). Overall, these results showed that IT-QUOTE-BC items are significantly related to patients’ satisfaction.
VAS Difference P Value Between Positive and Negative Answer Groups, for Each IT-QUOTE-BC Items
| IT-QUOTE-BC Items | Wilcoxon Mann-Whitney (P Value) |
|---|---|
| Patient education regarding postoperative treatment | |
| 1.1. Health professionals informed me well about possible side effects of the treatment | < 0.001 |
| 1.2. Health professionals informed me well about a possible drain | < 0.001 |
| 1.3. Health professionals informed me well about a possible prosthesis | < 0.001 |
| 1.4. Health professionals informed me well about possible side effects of the treatment | < 0.001 |
| 1.5. Health professionals concerned with adjuvant treatment informed me clearly about the start of adjuvant treatment (s) | < 0.001 |
| 1.6. Health professionals concerned with adjuvant treatment informed me clearly about the consequences of adjuvant treatment (e.g., tiredness, boldness, swollen arm) | < 0.001 |
| Services by the breast nurse | |
| 2.1. The breast nurse listened to me attentively | < 0.001 |
| 2.2. The breast nurse treated me as an equal | < 0.001 |
| 2.3. The breast nurse took me seriously | 0.019 |
| 2.4. The breast nurse spent enough time on my consultation | < 0.001 |
| 2.5. The breast nurse explained things to me in understandable language | 0.173a |
| Services by the surgeon | |
| 3.1. The surgeon listened to me attentively | 0.010 |
| 3.2. The surgeon treated me with respect | 0.065a |
| 3.3. The surgeon took me seriously | 0.014 |
| 3.4. The surgeon spent enough time on my consultation | 0.004 |
| 3.5. The surgeon explained things to me in understandable language | 0.059a |
| 3.6. The surgeon was informed about my file before the consultation started | 0.153a |
| Patient education regarding activities at home | |
| 4.1. Health professionals informed me well about wound care in the home situation | 0.0019 |
| 4.2. Health professionals informed me clearly about what I should and should not do after surgery | 0.0004 |
| 4.3. Health professionals informed me well about exercises for the period after surgery | 0.0002 |
| Patient education regarding aspects related to preoperative treatment | |
| 5.1. Health professionals informed me well about survival rates that were known about my type of breast cancer | 0.007 |
| 5.2. Health professionals informed me well about different treatment options | 0.009 |
| 5.3. Health professionals informed me clearly about risks of different treatment options | < 0.001 |
| 5.4. Health professionals informed me/ provided me with good information about what the chosen treatment consisted of | 0.005 |
| Other items | |
| 6.1. Health professionals took care that the various caregivers coordinated patient education | < 0.001 |
| 6.2. Health professionals had results available when I had an appointment with (one of) them for that reason | 0.063a |
| 6.4. Health professionals ensured that all diagnostic tests took place on the same day | < 0.001 |
| 6.5. The results of a biopsy were communicated to me within ten (working) days | 0.003 |
| 6.6. Health professionals concerned with adjuvant treatment paid me personal attention | < 0.001 |
| 6.7. Health professionals concerned with adjuvant treatment were helpful | < 0.001 |
| 6.8. Health professionals concerned with adjuvant treatment kept appointments punctually | < 0.001 |
4. Discussion
In this study we developed an Italian cultural and organizational adaptation of the QUOTE-BC questionnaire and tested its validity for its use in Italian breast units. Since other published adaptations of questionnaires using QUOTE methodology was targeted at different health conditions (26-31), therefore, to compare the result of this research with other related studies we found only one study which carried out by de Kok et al. (17). Validity and comprehensibility of IT-QUOTE-BC were ensured by carefully translating and pre-testing the questionnaire. Overall, we found 3 items that should be changed compared to the original QUOTE-BC instrument.
Regarding the questionnaire structure, factorial analysis confirmed the original 5 sub-scales structure, as described by de Kok et al. (17). Internal consistency of the sub-scales was also assessed using Cronbach alphas and can be considered sufficient for all sub-scales with the exception of sub-scale 2 “Services by the breast nurse”. This result, is not in line with the original study (all alphas equal or above 0.70), and shows the need to further adapt the Italian version to better reflect the cultural aspect of nurse care.
The correlation of the IT-QUOTE-BC items with the VAS was statistically significant for most of the items, suggesting that the questionnaire is indeed related to patients’ satisfaction demonstrating its overall construct validity.
The compliance of participants in the study was 98.6% which is much higher than the previous in the original study by de Kok et al. (47%) (17). We believe this result was due to the different methods of questionnaires distribution and collection: instead of sending out the questionnaire by mail, we delivered and collected it in person during the first medical examination after surgery. Moreover, the number of missing answers in the questionnaires was also very low, which indicates that the surgeons participating in the data collection presented the questionnaire clearly.
In the most of the items of questionnaire structure, the level of patients’ satisfaction showed a statistically significant difference between the two groups of patients (the positive answer group and the negative answer group); the only exception was found in some items regarding the surgeon. In three items regarding the services offered by the surgeon (3.2, 3.5 and 3.6) the VAS measurement in each group of answers is the same.
Both groups agreed on claiming that the surgeons treat the patients with respect, use clear language to explain the situation, and demonstrate their knowledge of the patient’s clinical history at the time of the medical examination.
Especially, the items 3.2 and 3.3 were very similar, as the P value was significant; therefore, in the future, to avoid a possible misunderstanding by the patients, we might consider to unify the two items, as already indicated in the nursing section (2.2 and 2.3), in order to avoid a possible misunderstanding by the patients. The same can be said for the patient-nurse relationship.
However, considering the wide gap between the two groups of answers, it cannot be excluded that the results obtained are due to mere chance. Therefore, the sample needs to be extended to better understand the level of patients’ satisfaction regarding the services offered by the ward and the healthcare personnel.
4.1. Conclusions
While there are many studies that focused on quality indicators of breast cancer care only a few studies had attempted to determine patient’s perspectives on quality of care. A greater understanding of the patients’ perspective is important to provide and improve services and healthcare organizations. As a result of this study, we provided an adapted Italian translation of QUOTE Breast Cancer questionnaire for the first time, in order to assess the quality of care for female breast cancer patients. By introducing the patient point of view, the IT-QUOTE-BC questionnaire can offer valuable support for those who monitor the clinical and the organizational decisions in the Italian breast units routine. The use of the IT-QUOTE-BC questionnaire in the same breast unit will allow to verify whether the organizational changes lead to an improvement in the quality perceived by the patients, besides the usual performance measurement to support managerial and clinical decisions (35). Nonetheless, further refining and testing of the IT-QUOTE-BC still need to be performed to be able fully to validate a reliable instrument. For this purpose, a larger multicentric study is needed.
4.2. Limitations
This study had two main limitations worth considering.
First, we used an opportunity sampling as a collection strategy which limited the generalization of the results. It was obtained as a result of collaboration among the surgeons of the breast units interested in assessing the quality of breast care in their surgical wards.
Secondly, the concentration of the patients’ sample in north-east Italy cannot be considered representative of the whole Italian breast cancer patients. Future studies using the IT-QUOTE-BC should collect data from different Italian regions and compare the results with more objective clinical quality of care metrics (e.g. re-hospitalization, patient infection, discharge time, etc).
Acknowledgements
References
-
1.
EUSOMA. The requirements of a specialist breast unit. Eur J Cancer. 2000;36(18):2288-93. https://doi.org/10.1016/s0959-8049(00)00180-5.
-
2.
European Parliament Resolution. Breast cancer in the Enlarged European Union. OJ C 313 E (20.12.2006); 2006.
-
3.
European Commission. European declaration on the fight against breast cancer in the European Union (0071/2009). Brussels: European Commission; 2010.
-
4.
Perry N, Broeders M, de Wolf C, Tornberg S, Holland R, von Karsa L. European guidelines for quality assurance in breast cancer screening and diagnosis. Fourth edition--summary document. Ann Oncol. 2008;19(4):614-22. [PubMed ID: 18024988]. https://doi.org/10.1093/annonc/mdm481.
-
5.
European Parliament. Motion for a resolution. Policy challenges and strategies against women's cancers and related comorbidities (2018/2782 (RSP). European Parliament; 2019.
-
6.
Joint Research Centre. European commission initiative on breast cancere ECIBC. Plenary; 2016, [cited 20.05.2019]. Available from: https://ec.europa.eu/jrc/en/publication/european-commission-initiative-breast-cancer-ecibc-plenary-2016.
-
7.
Knox S. The European patient advocacy perspective on specialist breast units and accreditation. Breast. 2015;24(3):287-9. [PubMed ID: 25701514]. https://doi.org/10.1016/j.breast.2015.01.013.
-
8.
Kesson EM, Allardice GM, George WD, Burns HJ, Morrison DS. Effects of multidisciplinary team working on breast cancer survival: Retrospective, comparative, interventional cohort study of 13 722 women. BMJ. 2012;344. e2718. [PubMed ID: 22539013]. [PubMed Central ID: PMC3339875]. https://doi.org/10.1136/bmj.e2718.
-
9.
Wilson AR, Marotti L, Bianchi S, Biganzoli L, Claassen S, Decker T, et al. The requirements of a specialist Breast Centre. Eur J Cancer. 2013;49(17):3579-87. [PubMed ID: 23968730]. https://doi.org/10.1016/j.ejca.2013.07.017.
-
10.
Paluch-Shimon S, Pagani O, Partridge AH, Abulkhair O, Cardoso MJ, Dent RA, et al. ESO-ESMO 3rd international consensus guidelines for breast cancer in young women (BCY3). Breast. 2017;35:203-17. [PubMed ID: 28822332]. https://doi.org/10.1016/j.breast.2017.07.017.
-
11.
Cardoso F, Cataliotti L, Costa A, Knox S, Marotti L, Rutgers E, et al. European Breast Cancer Conference manifesto on breast centres/units. Eur J Cancer. 2017;72:244-50. [PubMed ID: 28064097]. https://doi.org/10.1016/j.ejca.2016.10.023.
-
12.
Stordeur S, Vrijens F, Devriese S, Beirens K, Van Eycken E, Vlayen J. Developing and measuring a set of process and outcome indicators for breast cancer. Breast. 2012;21(3):253-60. [PubMed ID: 22056787]. https://doi.org/10.1016/j.breast.2011.10.003.
-
13.
Biganzoli L, Marotti L, Hart CD, Cataliotti L, Cutuli B, Kuhn T, et al. Quality indicators in breast cancer care: An update from the EUSOMA working group. Eur J Cancer. 2017;86:59-81. [PubMed ID: 28963914]. https://doi.org/10.1016/j.ejca.2017.08.017.
-
14.
Damman OC, Hendriks M, Sixma HJ. Towards more patient centred healthcare: A new Consumer Quality Index instrument to assess patients' experiences with breast care. Eur J Cancer. 2009;45(9):1569-77. [PubMed ID: 19167212]. https://doi.org/10.1016/j.ejca.2008.12.011.
-
15.
van Weert JC, Jansen J, de Bruijn GJ, Noordman J, van Dulmen S, Bensing JM. QUOTEchemo: A patient-centred instrument to measure quality of communication preceding chemotherapy treatment through the patient's eyes. Eur J Cancer. 2009;45(17):2967-76. [PubMed ID: 19615889]. https://doi.org/10.1016/j.ejca.2009.06.001.
-
16.
de Kok M, van der Weijden T, Kessels AG, Dirksen CD, Sixma HJ, van de Velde CJ, et al. Patients' opinions on quality of care before and after implementation of a short stay programme following breast cancer surgery. Breast. 2010;19(5):404-9. [PubMed ID: 20466546]. https://doi.org/10.1016/j.breast.2010.04.002.
-
17.
de Kok M, Sixma HJ, van der Weijden T, Kessels AG, Dirksen CD, Spijkers KF, et al. A patient-centred instrument for assessment of quality of breast cancer care: Results of a pilot questionnaire. Qual Saf Health Care. 2010;19(6). e40. [PubMed ID: 21127103]. https://doi.org/10.1136/qshc.2007.025890.
-
18.
Saito AI, Suda M, Sasai K, Jagsi R. Satisfaction of breast cancer patients regarding surgery and radiation therapy: A survey in Japan. Adv Radiat Oncol. 2016;1(4):216-21. [PubMed ID: 28740890]. [PubMed Central ID: PMC5514224]. https://doi.org/10.1016/j.adro.2016.09.001.
-
19.
Yu TH, Chung KP, Tung YC, Tsai HY. Insight into patients' experiences of cancer care in Taiwan: An instrument translation and cross-cultural adaptation study. Int J Environ Res Public Health. 2018;15(8). [PubMed ID: 30126140]. [PubMed Central ID: PMC6121327]. https://doi.org/10.3390/ijerph15081772.
-
20.
Kennedy GD, Tevis SE, Kent KC. Is there a relationship between patient satisfaction and favorable outcomes? Ann Surg. 2014;260(4):592-8. discussion 598-600. [PubMed ID: 25203875]. [PubMed Central ID: PMC4159721]. https://doi.org/10.1097/SLA.0000000000000932.
-
21.
Tevis SE, Kennedy GD, Kent KC. Is there a relationship between patient satisfaction and favorable surgical outcomes? Adv Surg. 2015;49:221-33. [PubMed ID: 26299501]. [PubMed Central ID: PMC4548286]. https://doi.org/10.1016/j.yasu.2015.03.006.
-
22.
Tevis SE, Kennedy GD. Patient satisfaction: Does surgical volume matter? J Surg Res. 2015;196(1):124-9. [PubMed ID: 25796107]. [PubMed Central ID: PMC6205697]. https://doi.org/10.1016/j.jss.2015.02.054.
-
23.
Sacks GD, Lawson EH, Dawes AJ, Russell MM, Maggard-Gibbons M, Zingmond DS, et al. Relationship between hospital performance on a patient satisfaction survey and surgical quality. JAMA Surg. 2015;150(9):858-64. [PubMed ID: 26108091]. https://doi.org/10.1001/jamasurg.2015.1108.
-
24.
Al-Abri R, Al-Balushi A. Patient satisfaction survey as a tool towards quality improvement. Oman Med J. 2014;29(1):3-7. [PubMed ID: 24501659]. [PubMed Central ID: PMC3910415]. https://doi.org/10.5001/omj.2014.02.
-
25.
McGowan M, Reid B. Using the Plan, Do, Study, Act cycle to enhance a patient feedback system for older adults. Br J Nurs. 2018;27(16):936-41. [PubMed ID: 30187794]. https://doi.org/10.12968/bjon.2018.27.16.936.
-
26.
Masachs M, Casellas F, Borruel N, Torrejon A, Castells I, Malagelada JR. Validation of the Spanish version of a questionnaire to measure quality of care through the eyes of patients with inflammatory bowel disease (QUOTE-IBD). Inflamm Bowel Dis. 2010;16(6):982-92. [PubMed ID: 19918968]. https://doi.org/10.1002/ibd.21156.
-
27.
Soares JB, Nogueira MC, Fernandes D, Goncalves BM, Goncalves R. Validation of the Portuguese version of a questionnaire to measure quality of care through the eyes of patients with inflammatory bowel disease (QUOTE-IBD). Eur J Gastroenterol Hepatol. 2015;27(12):1409-17. [PubMed ID: 26441206]. https://doi.org/10.1097/MEG.0000000000000485.
-
28.
Pallis AG, Vlachonikolis IG, Mouzas IA. Validation of a reliable instrument (QUOTE-IBD) for assessing the quality of health care in Greek patients with inflammatory bowel disease. Digestion. 2003;68(2-3):153-60. [PubMed ID: 14671422]. https://doi.org/10.1159/000075524.
-
29.
Hekkink CF, Sixma HJ, Wigersma L, Yzermans CJ, Van Der Meer JT, Bindels PJ, et al. QUOTE-HIV: An instrument for assessing quality of HIV care from the patients' perspective. Qual Saf Health Care. 2003;12(3):188-93. [PubMed ID: 12792008]. [PubMed Central ID: PMC1743708]. https://doi.org/10.1136/qhc.12.3.188.
-
30.
Cinaroglu S, Hearld KR, Igici SO. Explanatory factors of quality of care from cataract patients' perspectives. Semin Ophthalmol. 2017;32(3):321-5. [PubMed ID: 27058671]. https://doi.org/10.3109/08820538.2015.1088553.
-
31.
Tijhuis GJ, Kooiman KG, Zwinderman AH, Hazes JM, Breedveld FC, Vliet Vlieland TP. Validation of a novel satisfaction questionnaire for patients with rheumatoid arthritis receiving outpatient clinical nurse specialist care, inpatient care, or day patient team care. Arthritis Rheum. 2003;49(2):193-9. [PubMed ID: 12687510]. https://doi.org/10.1002/art.10994.
-
32.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94-104. [PubMed ID: 15804318]. https://doi.org/10.1111/j.1524-4733.2005.04054.x.
-
33.
Gould D, Kelly D, Goldstone L, Gammon J. Examining the validity of pressure ulcer risk assessment scales: Developing and using illustrated patient simulations to collect the data. J Clin Nurs. 2001;10(5):697-706. [PubMed ID: 11822520].
-
34.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334. https://doi.org/10.1007/bf02310555.
-
35.
Batterham RW, Hawkins M, Collins PA, Buchbinder R, Osborne RH. Health literacy: Applying current concepts to improve health services and reduce health inequalities. Public Health. 2016;132:3-12. [PubMed ID: 26872738]. https://doi.org/10.1016/j.puhe.2016.01.001.