This study conducted methodological research in 2016 with the aim of developing and evaluating an ADL assessment questionnaire for the Iranian population. The development and evaluation of the scale were based on a sequential exploratory mixed-method study, with scoring based on the Likert Scale. The three stages included the definition of the concept to be measured, the development of assessment tools, and the calculation of validity and reliability (
Figure 1) (
14).
3.1. Questionnaire Development
The first phase involved studying literature on ADL questionnaires and models, with the occupational therapy practice framework (OTPF) being chosen as the framework. Scientific databases such as PubMed, Elsevier, Scopus, Web of Knowledge, and the Cochrane Library were searched. All ADL assessment tools were gathered, and the MET table for various activities, as well as occupational therapy models and frameworks, were examined.
The MET table defined activities with varying required oxygen consumption, encompassing both BADL and IADL activities in ADL assessment tools and activities in the OTPF. The sets of activities and parameters were inputted into the initial questionnaire. These parameters included fatigue, dyspnea, pain, value, independence, safety, difficulty, and performance time, sourced from occupational therapy and qualitative work. Following expert panel meetings and gathering opinions, the questionnaire was revised, leading to the preparation of the initial questionnaire. A team of five experts, including three with doctorates in occupational therapy, one with a doctorate in neuroscience, and one with a doctorate in physiotherapy, were involved. Individuals classified as level four of the New York Heart Association (NYHA) were excluded due to their significant limitations in physical activity. Consequently, as advised by the cardiologist, only patients categorized as levels 1 - 3 were considered for the study.
In the next phase, this form was piloted with 30 people with HF. To improve item generation, a qualitative study was carried out involving semi-structured interviews with 12 individuals at different levels of HF, using purposive sampling. The interviews were audio-recorded and transcribed directly by an occupational therapist. The focus was on HF patients' views and recommendations on questionnaire items and parameters. The first author conducted an inductive analysis and thematic evaluation of the qualitative data from the interviews. Items identified in the qualitative study were compared to the initial form. Analogical-inductive methods were used to prepare the items. Following the preparation of the form (pool of questions), the expert panel convened to gather opinions on the items in the form (15 items). Based on expert feedback, some items were combined and others were renamed. The final questionnaire (13 items) was then prepared, incorporating expert opinions, and the psychometric evaluation phase commenced.
Based on the expert panel's opinions, the questionnaire has been revised. Activities such as eating, using communication devices, performing artistic works, financial management, and caring for others have been removed. The decision to exclude light activities like eating was based on low energy consumption according to the MET table, and it is only applicable in advanced stages of the disease (
15,
16). Similarly, using communication devices and performing artistic works are not universally applicable due to varying levels of education and interest. The item of financial management was removed as severe cognitive involvement occurs only in level 4 NYHA of HF, which is not applicable to levels 1 to 3 (
17). Caring for others was also removed due to its lack of generality for all patients and its similarity to child care duties. Additionally, based on the OTPF, mobility and movement items were divided into functional mobility and community mobility (
18).
3.7. Reliability
Reliability was evaluated by two raters and 30 HF patients on two occasions, two weeks apart, and internal consistency was determined using Cronbach's alpha coefficient. Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC). The ICC results were categorized as poor (0.5), moderate (0.5 - 0.75), good (0.75 - 0.9), and excellent (> 0.9) (
25). Pearson correlations and ICC are influenced by the score range. Calculating the proportion of agreement of test-retest differences with a referent value of ±1 could offer more insight into the questionnaire's stability (
26).
The initial questionnaire was completed by 30 individuals with HF, with 53% (16 people) being male and 46% female. Participants' ages ranged from 22 to 65 years old, with a mean (SD) age of 50.57 (11.3). Among the participants, 8 people (25%) were at level I, 14 people (43%) were at level II, and 8 people (25%) were at level III of the NYHA functional class. Additionally, 8 (25%) individuals were admitted to the hospital, while 22 (75%) were not. The average duration of HF among the participants was 5.6 (4.4) years.
To perform face validity, the HF patients provided their opinions and suggestions regarding the items and parameters of the questionnaire. Interviews with HF patients at different levels of NYHA were conducted, and 26 items from the initial questionnaire and results of the interviews were extracted. To review the content of the questionnaire, three sessions were held with eight experts, including five individuals with doctorates in occupational therapy, one with a doctorate in neuroscience, one with a doctorate in physiology, and one with a doctorate in physiotherapy. After applying the suggested changes, 15 items remained. These items include: Excretion of urine and feces, dressing, bathing, functional mobility, social mobility, sexual activities, using public transportation, driving, taking care of one's health, performing individual religious duties, carrying out duties related to child care, traveling, duties at home, caring for animals and plants, and self-grooming.
To check face validity, 15 therapists commented on the items of the questionnaire. Three were nurses (experts in the HF department), five were physiotherapists (master's degree), and seven were occupational therapists (master's degree). The effect of items ranged between 2.43 and 5. In this way, no items were deleted, and 15 items were prepared for content validity.
To check the content validity of the questionnaire, a meeting was held with eight experts and research team members. The panel included three cardiologists specializing in HF (5 to 13 years of professional experience), eight masters in occupational therapy (2 to 8 years of professional experience), six masters in physical therapy (2 to 12 years of professional experience), and three bachelor-level nurses (10 to 15 years of professional experience). The questionnaire, with the remaining 15 items and the given changes, was prepared to check the quantitative content validity (CVI and CVR).
Twenty experts (eight occupational therapists, six physiotherapists, three cardiologists, and three cardiac nurses) completed the questionnaire at this stage to determine the CVI and CVR (
Tables 1 and
2). According to the critical value suggested by the Lawshe table, items with a content validity index of less than 0.42 should be removed from the questionnaire. The total content validity of the questionnaire (CVI-s) was calculated as 0.91. Two items were deleted: The self-grooming item with an I-CVI of 0.65, and the animal and plant care item with an I-CVI of 0.7 and a CVR of -0.2.
| Numbers | Items | Essential | Useful But Not Essential | Unessential | CVR | Interpretation |
|---|
| 1 | Excretion of urine and feces (sitting and standing up, maintaining the situation in the toilet, transfer to the toilet) | 15 | 4 | 1 | 0.5 | Remained |
| 2 | Self-grooming (correction of body hair, nail care) | 12 | 7 | 1 | 0.2 | Eliminated |
| 3 | Self-dressing (flexion and extension for wearing clothes and closing shoelace) | 19 | 1 | - | 0.9 | Remained |
| 4 | Take a bath (change the position in the bathroom and during washing, entering, and exiting the bathroom) | 20 | - | 1 | 1 | Remained |
| 5 | Functional mobility Easy: Sitting and standing, bending and straightening moderate: Fast walking, transfer to car difficulty: Climbing ramps, going up and down stair | 20 | - | - | 1 | Remained |
| 6 | Social mobility (shopping, going to do banking, walking with carrying things) | 20 | - | - | 1 | Remained |
| 7 | Sexual activities (participating in an activity that results in sexual satisfaction or pregnancy) | 19 | 1 | - | 0.9 | Remained |
| 8 | Use of public transportation (standing on a bus for a long time, using a plane, using the subway to travel) | 17 | 3 | - | 0.7 | Remained |
| 9 | Caring for animals and plants (flowering, taking care of animals and flowers) | 8 | 9 | 3 | -0.2 | Eliminated |
| 10 | Driving (independent transfer in society with their own car) | 17 | 2 | 1 | 0.7 | Remained |
| 11 | Taking care of your health (using a proper diet, exercising, managing your medication ) | 17 | 3 | - | 0.7 | Remained |
| 12 | Carrying out individual religious duties (how to pray (sitting or standing), bending, straightening, doing meditation) | 16 | 4 | - | 0.6 | Remained |
| 13 | Tasks related to taking care of the child (spending time for issues related to the child, spending time with the child) | 11 | 9 | - | 0.1 | Remained |
| 14 | Traveling (the ability to sit for a long time in a vehicle) | 12 | 7 | 1 | 0.2 | Remained |
| 15 | Housekeeping tasks (sweeping, making the bed, washing dishes, ironing, cooking, interior repairs, dusting and house cleaning) | 18 | 2 | - | 0.8 | Remained |
Abbreviations: ADL, activity of daily living; CVR , content validity ratio.
| Numbers | Items | Not Relevant | Somewhat Relevant | Acceptable Relevant | Very Relevant | CVI | Interpretation |
|---|
| 1 | Excretion of urine and feces (sitting and standing up, maintaining the situation in the toilet,transfer to the toilet) | 1 | - | 3 | 16 | 0.95 | Remained |
| 2 | Self-grooming (correction of body hair, nail care) | 3 | 4 | 8 | 5 | 0.65 | Remained |
| 3 | Self-dressing (flexion and extension for wearing clothes and closing shoelace) | - | 1 | 3 | 16 | 0.95 | Remained |
| 4 | Take a bath (change the position in the bathroom and during washing, entering, and exiting the bathroom) | - | - | - | 20 | 1 | Remained |
| 5 | Functional mobility Easy: Sitting and standing, bending and straightening moderate: Fast walking, transfer to car difficulty: Climbing ramps, going up and down stair | - | - | 1 | 19 | 1 | Remained |
| 6 | Social mobility (shopping, going to do banking, walking with carrying things) | - | - | 1 | 19 | 1 | Remained |
| 7 | Sexual activities (Participating in an activity that results in sexual satisfaction or pregnancy) | - | 1 | 3 | 16 | 0.95 | Remained |
| 8 | Use of public transportation (standing on a bus for a long time, using a plane, using the subway to travel) | - | - | 2 | 18 | 1 | Remained |
| 9 | Caring for animals and plants (flowering, taking care of animals and flowers) | 3 | 3 | 9 | 5 | 0.7 | Eliminated |
| 10 | Driving (independent transfer in society with their own car) | - | 2 | 5 | 13 | 0.9 | Remained |
| 11 | Taking care of your health (using a proper diet, exercising, managing your medication ) | 1 | 1 | - | 18 | 0.9 | Remained |
| 12 | Carrying out individual religious duties (how to pray (sitting or standing), bending, straightening, doing meditation) | - | - | 4 | 16 | 1 | Remained |
| 13 | Tasks related to taking care of the child (spending time for issues related to the child, spending time with the child) | 1 | 2 | 9 | 8 | 0.85 | Remained |
| 14 | Traveling (the ability to sit for a long time in a vehicle) | 1 | 1 | 6 | 12 | 0.9 | Remained |
| 15 | Housekeeping tasks (sweeping, making the bed, washing dishes, ironing, cooking, interior repairs, dusting and house cleaning) | - | 2 | 2 | 16 | 0.9 | Remained |
| S-CVI average | | | | | 0.91 | |
Abbreviations: ADL, activity of daily living; CVR, content validity ratio; S-CVI, Scale-Level Content Validity Index.
After collecting the opinions of experts, 13 items (urinating and defecating, dressing, bathing, functional mobility, social mobility, sexual activities, using public transportation, driving, taking care of one's health, performing personal religious duties, performing child care duties, traveling, and tasks at home) remained in the questionnaire. The questionnaire was completed by 180 people with HF at NYHA levels 1 - 3. Among the participants, 65% (117 people) were male and 35% were female. The participants' ages ranged from 18 to 65 years old, with a mean (SD) age of 50.12 (12.49). A total of 83 people (46.1%) were at level I, 58 people (32.2%) were at level II, and 39 people (21.7%) were at level III of the NYHA functional class.
The KMO and Bartlett’s sphericity test results are shown in
Table 3. The KMO sampling adequacy index was 0.86, and Bartlett’s test of sphericity was statistically significant (χ2 = 557.52, P < 0.001). The KMO exceeding the recommended value of 0.6 indicates sampling adequacy (
27).
| Variables | Values |
|---|
| KMO | o.86 |
| Bartlett's test of Sphericity | 557.52 |
| Df | 28 |
| P | < 0.01 |
Abbreviations: KMO, kaiser-meyer-olkin; EFA, exploratory factor analysis.
The scree plot (
Figure 2) suggested that two factors must be retained, but varimax rotation indicated that three factors were necessary.
Table 4 depicts that the EFA proposed a three-factor model. Considering the conceptual commonalities between the variables, we labeled factor one as value, safe independence, and signs and symptoms. The first factor, signs and symptoms, encompassed dyspnea, pain, duration of activity, and difficulty. Safe independence constituted the second factor, involving safety and independence, while the third factor, value, consisted of just one item.
Scree plot of the exploratory factor analysis (EFA) of activities of daily living (ADL) Questionnaire
Figure 2. Scree plot of the exploratory factor analysis (EFA) of activities of daily living (ADL) Questionnaire
| Variables | Components |
|---|
| 1 | 2 | 3 |
|---|
| Dyspnea | 0.9 | | |
| Fatigue | 0.87 | | |
| Pain | 0.82 | | |
| Duration of activity | 0.79 | | |
| Difficulty | 0.75 | | |
| Safety | | 0.84 | |
| Independence | | 0.78 | |
| Value | | | 0.98 |
The questionnaire's construct validity was assessed through Pearson correlation. All parameters of the ADL questionnaire had correlations exceeding 0.9 (P < 0.05), except for the value parameter, which ranged from 0.3 to 0.44 (P > 0.05) due to the different nature of this parameter. The convergence validity of the questionnaire with the ADL part of the IHF-QoL in 80 patients with HF, based on Pearson correlation, was 0.74 (P < 0.05).
The reliability was evaluated by two raters and 30 HF patients on two occasions, with a 2-week interval between assessments, to minimize the chance of rater recall bias. Internal consistency was calculated using Cronbach's alpha coefficient, which yielded a value of 0.98, indicating high reliability. Inter-rater reliability was measured using the intraclass correlation coefficient (ICC), with the ICC for all items being > 0.9 (
Table 5). These results indicate that the questionnaire's stability over time is considered adequate.
| Parameters | ICC | CI (0.95) | SEM | Mean | SD |
|---|
| Value | 0.97 | 0.81 - 0.99 | 2.17 | 75.08 | 12.55 |
| Safety | 0.97 | 0.85 - 0.99 | 3.26 | 74.41 | 18.84 |
| Independence | 0.97 | 0.84 - 0.99 | 3.27 | 73.75 | 18.9 |
| Difficulty | 0.93 | 0.41 - 0.99 | 5.06 | 70.08 | 19.15 |
| Pain | 0.96 | 0.73 - 0.99 | 3.81 | 71.58 | 19.08 |
| Fatigue | 0.95 | 0.75 - 0.99 | 4.03 | 67.91 | 18.04 |
| Dyspnea | 0.96 | 0.76 - 0.99 | 3.69 | 68.75 | 18.48 |
| Duration of activity | 0.94 | 0.66 - 0.99 | 4.86 | 70.66 | 19.86 |
| Total | 0.96 | 0.78 - 0.99 | 28.77 | 576.41 | 143.86 |
Abbreviations: ICC, interclass correlation coefficient; SEM, standard error of the mean; SD, standard deviation ; CI, confidence interval.