article information

International Journal of Cancer Management: Vol.13, issue 12; e108332
published online: January 2, 2021
article type: Methods Article
received: August 8, 2020
revised: October 8, 2020
accepted: October 26, 2020
DOI: https://doi.org/10.5812/ijcm.108332
Crossmark

Development of a Health Literacy Program for Parents of Children with Cancer: A Mixed-Methods Study Protocol

authors:

avatar Masoud Bahrami ORCID 1 , avatar Ahmad Ali Eslami ORCID 2 , avatar Alireza Moafi 3 , avatar Somaye Sayahi ORCID 4 , *

Cancer Prevention Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
Department of Health Education and Promotion, Isfahan University of Medical Sciences, Isfahan, Iran
Department of Pediatric Hematology and Oncology, Isfahan University of Medical Sciences, Isfahan, Iran
Student Research Committee, Faculty of Nursing and Midwifery, Isfahan University of Medical Sciences, Isfahan, Iran

how to cite: Bahrami M, Eslami A A , Moafi A , Sayahi S. Development of a Health Literacy Program for Parents of Children with Cancer: A Mixed-Methods Study Protocol. Int J Cancer Manag. 2020;13(12):e108332. https://doi.org/10.5812/ijcm.108332.

Abstract

Objectives:

Parents’ health literacy plays an important role in the proper management of symptoms and providing appropriate care for their children living with cancer. However, studies conducted on health literacy in Iranian culture is very limited. Therefore, this study will identify the health literacy needs of parents of children with cancer and will design a program for promoting their health literacy.

Methods:

This exploratory mixed-methods study, using qualitative-quantitative methods including 4 consecutive phases. In the first phase, the literature review will be carried out to conceptualize and determine the domains of health literacy. In the second phase, a qualitative study will be conducted to identify and determine the needs and strategies for promoting the health literacy of parents using deep semi-structured interviews. Participants will be selected by purposive and snowball sampling methods and data will be analyzed using the directed content analysis method. In the third phase, participants’ needs will be prioritized using a panel of experts and the initial draft of the program will be designed. In the fourth phase, the modified Delphi method will be used to prioritize program strategies and select the final program.

Discussion:

Developing a program using a qualitative method and literature review can provide some evidence for promoting health literacy in parents of children living with cancer. Moreover, it is expected that this program promotes knowledge and empowerment of health team members, especially nurses to provide family-centered care for children with cancer. This, in turn, will increase the quality of provided treatment and care and will decrease the costs.

1. Background

Today, non-communicable diseases are the main cause of mortality throughout the world and cancer is the basic cause of death and the most important barrier for increased life expectancy in the 21st century. In 2018, about 18.1 million new cases of cancer and 9.6 million cases of death due to cancer have been reported in 185 countries (1). In 2018, the cancer incidence was estimated as 16.8 per 100,000 for boys and 16.56 per 100,000 for Iranian girls (2). Total of 2219 new cases of childhood cancer are being estimated in Iran in 2020 (3). Although the cancer incidence is increasing among children, the 5-year survival rate has also significantly increased in 80% of childhood cancers (4).

Medical advancements like increasing in life expectancy and changing in the treatment system toward outpatient treatments and home care highlight the important role of parents in caring for their children with cancer (5, 6). In fact, parents are considered as the main caregivers of children in the hospital and the main part of caring at home, managing drug use and their side effects, giving required care, and communicating with the treatment team. Parents have the main role in receiving and processing medical and health information related to the disease and their health literacy is one of the important factors affecting the proper child care (7-10).

However, the health literacy is still a new concept in clinical practice. Some resources considered health literacy as an individuals' ability in receiving, processing and understanding initial healthcare information and services required for making appropriate health decisions (11-13). Some other resources considered it as an active mediator between personal skills and healthcare background that include functional, interactive, and critical domains. Functional health literacy refers to the basic ability to read, write, and understand the health information provided. This area includes dimensions such as adequate understanding of medical information, having sufficient information to manage health, and the ability to access accurate and quality health information. Interactive health literacy refers to the capacity to combine cognitive, social, and functional skills to extract information and use new information in changing situations. Dimensions in this area include a sense of understanding and support by health care providers, the ability to effectively interact with health care providers, and coordination with the health care system. Critical health literacy refers to the simultaneous application of advanced cognitive skills and social skills to critically analyze the information provided to make health care decisions. This area includes the dimensions of health information evaluation, active health status management, and social health support (14-16). The common point of literature is that health literacy has been considered as the core of knowledge and skills required for function in the healthcare system (11), but there are still inconsistencies in the literature regarding this concept that needs further elaboration.

Ignoring the needs of health literacy can lead to negative consequences in individuals with low health literacy compared to people with sufficient health literacy (17). For example, the low health literacy of caregivers can cause incorrect clinical decisions affecting the child’s treatment course. Moreover, the rate of going to emergency and hospitalization increases among them, and in general, they spend more medical costs (12, 18). Health literacy is especially important for patients with cancer because decision-making for prevention, screening, and treatment in the oncology environment is complex. Since parents can directly influence the health literacy needs of children (14, 19, 20) and clinical outcomes of children are affected by parental health literacy, therefore, promoting health literacy is essential for this group (13).

Despite the importance of health literacy especially for parents of children with cancer, studies to develop programs for promoting the health literacy for these parents are limited in the world. Most of these studies conducted on the health literacy of parents are descriptive. For example, the study which conducted by Miller et al. showed that the health literacy level was 33% among mothers and 32% among fathers of children with cancer (21). Results of the study by Yin et al. showed that a large portion of American parents have low health literacy skills and need health literacy promotion programs to improve the health conditions of their children (22). Results of a systematic review of Adams et al. showed that information needs of caregivers are more relevant to patient care than medical information (5). Results of a systematic review of Keim-Malpass et al. showed that promoting the health literacy of caregivers of children with cancer has not been adequately considered in studies (8). In Iran, Khodabakhshi et al. stated that sufficient health literacy among mothers of children with cerebral palsy is 43%, among mothers of children with autism is 49%, and among mothers of children with mental retardation is 42%, and the level of health literacy has been reported insufficient (9).

There are also some research studies outside Iran aimed at promoting health literacy in these parents. For instance, study of Wittenberg et al. who evaluated a health literacy promotion program for family caregivers of patients with cancer. They found that the presented content was very useful and effective for 63% of caregivers. The results of the qualitative part of this study showed that caregivers need to promote health literacy and suggest health literacy promotion interventions in oncology (23). Results of a study by Yuen et al. aimed at designing a conceptual model for health literacy promotion for caregivers of patients with cancer, showed that the health literacy of caregivers is a multi-dimensional concept and includes a wide range of personal and interpersonal elements and is affected by the healthcare system and social factors (24). Other studies revealed that this group still has many ignored needs in terms of health literacy (18, 20, 23, 25).

It can be concluded that health literacy is an important concept which can promote community health and increase the quality of healthcare services. In addition, health literacy affects almost every aspect of health care and is especially important in cancer because decisions about cancer prevention, screening, and treatment are more complex. No research has been found to develop health literacy programs for parents of children with cancer in Iran. Therefore, the current study will be carried out to design a health literacy promotion program for parents of children with cancer in selected centers of cancer treatment in Iran.

2. Methods

The current study is a sequential exploratory mixed methods study that includes qualitative and quantitative steps and it will be based on the paradigm of pragmatism. This study will be conducted in 4 phases to determine the health literacy needs of parents of children with cancer and design a health literacy promotion program for these parents approximately in 2 years. Studies in this area are limited in Iran, and research team members achieve a deeper understanding of the health literacy needs of parents by conducting a qualitative study. Thus, the qualitative step will be given more priority in this study. In the current research, integration of data with the merging data approach will be done. This integration will be done by reporting results of qualitative and quantitative phases together in a discussion section (26).

2.1. Phase 1: Literature Review

A narrative review will be conducted searching library resources (articles, reference books, and thesis) and electronic databases of Medline, EMBASE, ProQuest, ISI Web of Science, Science Direct, and Scopus with keywords “Health Literacy”, “Cancer”, “Caregiver”, “Mother”, and “Parent”; and with derivations of “Mesh” in titles and abstracts of original articles and review articles from 2010 to 2020. Moreover, Persian literature will be reviewed in iranmedex, SID, and magiran databases with the same keywords from 2010 to 2020. The papers with the following criteria will be excluded: duplicated studies, letters to the editor, and the poster and conference papers. This phase will be done with the aim of identifying models, areas, and dimensions of health literacy in caregivers of children with cancer and using it as a basis for the qualitative phase.

2.2. Phase 2: Qualitative Study

In this phase, a qualitative study will be conducted to analyze the situation, determine the health literacy needs of parents of children with cancer, and identify barriers and strategies to meet health literacy needs. The research environment includes selected centers of cancer treatment affiliated to Isfahan University of Medical Sciences or workplace or house of participants. The schedule, duration, and place of the interview will be determined by participants. This phase will be done with the aim of identifying the needs and strategies to promote health literacy in areas (functional, interactive, and critical) from the perspective of participants.

2.2.1. Participants

Participants are mainly parents of children with cancer (with maximum variation in sex, age, type of childhood cancer, and duration of care). Moreover, health service providers including nurses and oncologist may be interviewed to further understand this concept and related needs. Participants will be selected by purposive and snowball sampling methods. The number of participants is not determined previously and interviews continue until data saturation.

2.2.2. Inclusion Criteria

Parents of Iranian children with cancer who are under the age of 15 (27, 28) are direct caregivers. Children at least one month after cancer diagnosis (24), and hospitalized at least once for diagnostic and therapeutic procedures will be included in the study. In case of the need to interview with the health service providers, the inclusion criteria will be having at least 6 months of work experience at the oncology wards and desire to participate in the study.

2.2.3. Qualitative Data Collection Method

Data will gather through deep semi-structured individual interviews and field notes. An interview guide questions will be extracted from the relevant literature. Possible questions might be “What problems did you have in receiving information on child disease? (Functional domain)” and “What support have you received from the health care providers? (Interactive domain)”. Ethical considerations will be observed. Research objectives will be described for participants and informed written consent will be taken for participating in the study.

2.2.4. Analyzing Qualitative Data

Data analysis will be performed using Elo and Kyngas directed content analysis method. In this method, the researcher begins the study with a theory or findings of previous research studies, and codes are defined before analyzing data. Then, codes are developed during analysis. It is suggested that the main categories are extracted from the literature. One of the limitations of deductive coding is that newly collected documents or data may contain important ideas or views that have not been identified in previous studies. Thus, these new ideas are added to available categories. Therefore, the directed content analysis generally is a combined deductive and inductive approach for coding (29-31). This approach has been selected because there is no research or framework for analyzing the health literacy needs of parents of children with cancer in our setting (32). In the current study, categories were determined based on health literacy domains in previous research studies and interviews will be coded based on functional, interactive, and critical domains of health literacy. The continuous comparative analysis will be carried out during the study that will allow the formation of new categories (14-16).

2.2.5. The Trustworthiness of Qualitative Data

Guba and Lincoln criteria including credibility, dependability, confirmability, and transferability will be used to assure the trustworthiness of data. Prolonged engagement of the researcher, persistent observation, negative case analysis, peer debriefing, member check, comprehensive description of sampling strategies, methods of data collecting, and analyzing data will increase creditability. A member check will be used to increase researcher creditability. Moreover, events and decisions related to different phases of the study including interviews and data analysis are precisely recorded to allow inquiry audits by other researchers. The confirmability of results will be achieved by describing the detailed process of data analysis, negative case analysis, and peer debriefing. Moreover, providing a comprehensive description of the study allows readers to follow the study plan and judge the transferability of data to other fields (31).

2.3. Phase 3: Prioritizing Health Literacy Needs and Developing the Program

A panel of Experts will be done to prioritize the health literacy needs of parents resulting from the literature review and qualitative study. In this phase, extracted needs will place on a 5-point Likert scale (from 5 as very important to 1 as very unimportant) to prioritize. Panel members will formally invite and a summary of research objectives and they receive a need prioritizing questionnaire. Then, priorities will be given a score and discussed in the panel meeting. Members of the experts’ panel are persons who have experience in the care and treatment of children with cancer and have experience interacting with their parents. Next, the needs of participants will be prioritized based on mean scores obtained and the initial draft of the health literacy promotion program will be developed using Ewles and Simnett’s (2010) designing pattern. This model is a suitable method for designing health promotion programs. The main steps of this model are as follows: 1- Identify needs and priorities, 2- Set aims and objectives, 3. Decide the best way of achieving the aims, 4- Identify resources, 5- Plan evaluation methods, 6- Set an action plan (33). This phase will be carried out with the aim of prioritizing the health literacy needs of caregivers of children with cancer and designing an initial version of the program based on prioritizing health literacy needs.

2.4. Phase 4: Prioritizing Strategies of the Program and Final Confirmation of The Program

The Delphi modified method will be used to the prioritize strategies of the program. In this stage, a list of extracted strategies from findings of qualitative content analysis of interviews and literature review will be prepared in the form of a questionnaire. Each strategy is investigated in terms of ease for implementation, cost-effectiveness, simplicity, efficiency, and acceptability in a 5-point Likert scale (very high = 5 to very low = 1). The number of panel members will be between 7 and 15 and experts in various specialties who are familiar with caregivers for children with cancer will be invited and they will receive a summary of the research objectives and the questionnaire and according to the schedule, they will send the completed questionnaires. The researcher analyzes the questionnaires and enters the data into SPSS software (version 19) and calculates mean and standard deviation for each strategy. Then, strategies will be prioritized based on the mean scores. The results of the experts’ agreement will be sent to them. Next, a session will be held at the Nursing and Midwifery Faculty of Isfahan with experts’ panel members to discuss the priority of strategies face to face and complete the questionnaires again. Finally, the mean score of each strategy and agreement level will be determined based on the variance of answers and quartile range. If more than 80% of members agree on a subject and the quartile range is 0, the agreement level will estimate very high. If more than 60% of members agree on a subject and the quartile range is 1, the agreement level will estimate medium. If less than 60% of members agree on a subject and the quartile range is more than 2, the agreement level will estimate weak. When the agreement level is very high, there is consensus and the strategy is accepted (33-36). This phase will be done with the aim of prioritizing the program strategies using the Delphi modified method and the final confirmation of the health literacy promotion program for caregivers of children with cancer.

3. Discussion

Since health literacy dimensions have not yet been investigated in parents of children with cancer and no action is taken to promote their health literacy, conducting a sequential exploratory study and developing a program is a useful step in this regard. We believe that this program will be a basis for supporting and promoting health literacy among parents of children with cancer. Various studies have emphasized the necessity of investigating the information needs of caregivers and promoting their health literacy (13, 23, 25). Promoting health literacy of caregivers will increase their capability to make informed decisions, decrease health risks, increase prevention of diseases, safety, quality of life, and quality of care. High quality of care is very important for patients with cancer, because it warrants better outcomes for the patient and reduces costs, and makes possible the better allocation of resources in the healthcare system (37, 38).

Moreover, the Ministry of Health and Medical Education and other related institutions can use the results of this research in policy-making and planning for promoting the health literacy of parents of children with cancer. Focusing on the promotion of health literacy can help policymakers in different health care sectors access to appropriate healthcare services including adherence to treatment, reduce emergencies, reduce the length of hospitalization, reduce mortality, and increase the use of health care services. In addition, negative economic effects resulted from low health literacy on patients and the healthcare system cannot be ignored (39). Effect of the mental status of parents on providing information during the interview is among the potential limitations of this study that we will try to control this limitation by selecting participants one month after diagnosis when the critical period of accepting cancer has been passed.

Acknowledgements

References

  • 1.

    Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394-424. [PubMed ID: 30207593]. https://doi.org/10.3322/caac.21492.

  • 2.

    Hassanipour S, Fathalipour M, Delam H, Ghorbani M, Abdzadeh E, Arab-Zozani M, et al. The incidence of childhood cancer in Iran: A systematic review and meta-analysis. Iran J Pediatr Hematol Oncol. 2019. https://doi.org/10.18502/ijpho.v9i3.1170.

  • 3.

    WHO. Noncommunicable diseases (NCD) country profiles. 2020. Available from: https://www.who.int/cancer/country-profiles/IRN_2020.pdf?ua=1.

  • 4.

    Masa'Deh R, Collier J, Hall C. Parental stress when caring for a child with cancer in Jordan: a cross-sectional survey. Health Qual Life Outcomes. 2012;10:88. [PubMed ID: 22838940]. [PubMed Central ID: PMC3416682]. https://doi.org/10.1186/1477-7525-10-88.

  • 5.

    Adams E, Boulton M, Watson E. The information needs of partners and family members of cancer patients: a systematic literature review. Patient Educ Couns. 2009;77(2):179-86. [PubMed ID: 19406609]. https://doi.org/10.1016/j.pec.2009.03.027.

  • 6.

    Can G, Akin S, Aydiner A, Ozdilli K, Oskay U, Durna Z. A psychometric validation study of the Quality of Life and FAMCARE scales in Turkish cancer family caregivers. Qual Life Res. 2011;20(8):1319-29. [PubMed ID: 21347572]. https://doi.org/10.1007/s11136-011-9867-x.

  • 7.

    Hasan Tehrani T, Haghighi M, Bazmamoun H. Effects of stress on mothers of hospitalized children in a hospital in iran. Iran J Child Neurol. 2012;6(4):39-45. [PubMed ID: 24665279]. [PubMed Central ID: PMC3943023].

  • 8.

    Keim-Malpass J, Letzkus LC, Kennedy C. Parent/caregiver health literacy among children with special health care needs: a systematic review of the literature. BMC Pediatr. 2015;15:92. [PubMed ID: 26242306]. [PubMed Central ID: PMC4525748]. https://doi.org/10.1186/s12887-015-0412-x.

  • 9.

    Khodabakhshi-Koolaee A, Rostami Goharni H, Kafashpour Marandi A. The comparison between health literacy and quality of life in three groups of mothers with cerebral palsy, Autism and intellectual impairments. J Health Lit. 2018;2(4):245-54. https://doi.org/10.29252/jhl.2.4.4.

  • 10.

    Stephens FO, Aigner KR. Basics of oncology. 2nd ed. Springer; 2016.

  • 11.

    Khuu BP, Lee HY, Zhou AQ, Shin J, Lee RM. Healthcare providers' perspectives on parental health literacy and child health outcomes among Southeast Asian American immigrants and refugees. Child Youth Serv Rev. 2016;67:220-9. https://doi.org/10.1016/j.childyouth.2016.06.006.

  • 12.

    Coleman C. Teaching health care professionals about health literacy: a review of the literature. Nurs Outlook. 2011;59(2):70-8. [PubMed ID: 21402202]. https://doi.org/10.1016/j.outlook.2010.12.004.

  • 13.

    Dingemans AJM, Reck CA, Vilanova-Sanchez A, Gonzalez DO, Gasior AC, Weaver LJ, et al. Does clinic visit education within a multidisciplinary center improve health literacy scores in caregivers of children with complex colorectal conditions? J Pediatr Surg. 2017;52(12):1997-2000. [PubMed ID: 29223544]. https://doi.org/10.1016/j.jpedsurg.2017.08.044.

  • 14.

    Koay K, Schofield P, Jefford M. Importance of health literacy in oncology. Asia Pac J Clin Oncol. 2012;8(1):14-23. [PubMed ID: 22369440]. https://doi.org/10.1111/j.1743-7563.2012.01522.x.

  • 15.

    Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658. [PubMed ID: 23855504]. [PubMed Central ID: PMC3718659]. https://doi.org/10.1186/1471-2458-13-658.

  • 16.

    Sorensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80. [PubMed ID: 22276600]. [PubMed Central ID: PMC3292515]. https://doi.org/10.1186/1471-2458-12-80.

  • 17.

    Izadirad H, Zareban I. The relationship of health literacy with health status, preventive behaviors and health services utilization in Baluchistan, Iran. Journal of Education and Community Health. 2015;2(3):43-50. https://doi.org/10.20286/jech-02036.

  • 18.

    Wittenberg E, Goldsmith J, Parnell TA. Development of a communication and health literacy curriculum: Optimizing the informal cancer caregiver role. Psychooncology. 2020;29(4):766-74. [PubMed ID: 31997477]. https://doi.org/10.1002/pon.5341.

  • 19.

    Yi TW, Deng YT, Chen HP, Zhang J, Liu J, Huang BY, et al. The discordance of information needs between cancer patients and their families in China. Patient Educ Couns. 2016;99(5):863-9. [PubMed ID: 26763870]. https://doi.org/10.1016/j.pec.2015.12.022.

  • 20.

    Lynn C, Quast L, Rogers H, Effinger K, Gilleland-Marchak J. Systematic review of health literacy in childhood cancer patients, survivors, and their caregivers. J Pediatr Psychol. 2020;45(4):373-85. [PubMed ID: 32186708]. https://doi.org/10.1093/jpepsy/jsaa009.

  • 21.

    Miller KS, Vannatta K, Vasey M, Yeager N, Compas BE, Gerhardt CA. Health literacy variables related to parents' understanding of their child's cancer prognosis. Pediatr Blood Cancer. 2012;59(5):914-8. [PubMed ID: 22434779]. https://doi.org/10.1002/pbc.24146.

  • 22.

    Yin HS, Johnson M, Mendelsohn AL, Abrams MA, Sanders LM, Dreyer BP. The health literacy of parents in the United States: a nationally representative study. Pediatrics. 2009;124 Suppl 3:S289-98. [PubMed ID: 19861483]. https://doi.org/10.1542/peds.2009-1162E.

  • 23.

    Wittenberg E, Goldsmith J, Ferrell B, Ragan SL. Promoting improved family caregiver health literacy: evaluation of caregiver communication resources. Psychooncology. 2017;26(7):935-42. [PubMed ID: 26990206]. [PubMed Central ID: PMC5026538]. https://doi.org/10.1002/pon.4117.

  • 24.

    Yuen EY, Dodson S, Batterham RW, Knight T, Chirgwin J, Livingston PM. Development of a conceptual model of cancer caregiver health literacy. Eur J Cancer Care (Engl). 2016;25(2):294-306. [PubMed ID: 25630765]. https://doi.org/10.1111/ecc.12284.

  • 25.

    Northouse LL, Katapodi MC, Song L, Zhang L, Mood DW. Interventions with family caregivers of cancer patients: meta-analysis of randomized trials. CA Cancer J Clin. 2010;60(5):317-39. [PubMed ID: 20709946]. [PubMed Central ID: PMC2946584]. https://doi.org/10.3322/caac.20081.

  • 26.

    Creswell JW, Klassen AC, Clark VL, Smith KC. Best practices for mixed methods research in the health sciences. OBSSR. 2011:5-6. https://doi.org/10.1037/e566732013-001.

  • 27.

    Hockenberry MJ, Wilson D. Wong's nursing care of infants and children. 10th ed. Mosby; 2015.

  • 28.

    Kyle T, Carman S. Essentials of pediatric nursing. 3rd ed. Philadelphia: Wolters Kluwer; 2017.

  • 29.

    Darisko JW, Maschi T. Content analysis. New york: Oxford university press; 2016.

  • 30.

    Elo S, Kyngas H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-15. [PubMed ID: 18352969]. https://doi.org/10.1111/j.1365-2648.2007.04569.x.

  • 31.

    Polit DF, Beck CT. Nursing research, generating and assessing evidence for nursing practice. 9th ed. Philadelphia: Wolters Kluwer; 2017.

  • 32.

    Meier BJ, El-Gabri D, Friedman K, Mvungi M, Mmbaga BT, Nickenig Vissoci JR, et al. Perceptions of alcohol use among injury patients and their family members in Tanzanian society. Alcohol. 2020;83:9-15. [PubMed ID: 31195127]. [PubMed Central ID: PMC7197291]. https://doi.org/10.1016/j.alcohol.2019.06.001.

  • 33.

    Scriven A, Ewles L, Simnett I, Parish R. Promoting health: a practical guide. 6th ed. Elsevier; 2010.

  • 34.

    Ginter PM, Duncan WJ, Swayne IE. The strategic management of health care organizations. 8th ed. john wiley & sons; 2013.

  • 35.

    Junger S, Brearley S, Payne S, Mantel-Teeuwisse AK, Lynch T, Scholten W, et al. Consensus building on access to controlled medicines: a four-stage Delphi consensus procedure. J Pain Symptom Manage. 2013;46(6):897-910. [PubMed ID: 23706904]. https://doi.org/10.1016/j.jpainsymman.2013.01.014.

  • 36.

    Ridgely MS, Ahluwalia SC, Tom A, Vaiana ME, Motala A, Silverman M, et al. What are the determinants of health system performance? Findings from the literature and a technical expert panel. Jt Comm J Qual Patient Saf. 2020;46(2):87-98. [PubMed ID: 31837990]. https://doi.org/10.1016/j.jcjq.2019.11.003.

  • 37.

    Andrade I, Silva C, Martins AC. Application of the Health Literacy INDEX on the development of a manual for prevention of falls for older adults. Patient Educ Couns. 2017;100(1):154-9. [PubMed ID: 27516436]. https://doi.org/10.1016/j.pec.2016.07.036.

  • 38.

    Lee YM, Yu HY, You MA, Son YJ. Impact of health literacy on medication adherence in older people with chronic diseases. Collegian. 2017;24(1):11-8. [PubMed ID: 29218957]. https://doi.org/10.1016/j.colegn.2015.08.003.

  • 39.

    Park JY, June KJ. Influencing factors on functional health literacy among the rural elderly. J Korean Acad Community Health Nurs. 2011;22(1):75. https://doi.org/10.12799/jkachn.2011.22.1.75.