The Validity and Reliability of Early Feeding Skills Assessment and Cue-Based Feeding Scales for Preterm Infants

authors:

avatar Farideh Kamran ORCID 1 , avatar Setareh Sagheb ORCID 2 , 3 , avatar Seyyed Ahmadreza Khatoonabadi ORCID 1 , avatar Abbas Ebadi ORCID 4 , 5 , avatar Yaser Faryadras ORCID 6 , avatar Mahshid Aghajanzadeh ORCID 1 , *

Department of Speech Therapy, School of Rehabilitation, Tehran University of Medical Sciences, Tehran, Iran
Department of Neonatology, Tehran University of Medical Sciences, Shariati Hospital, Tehran, Iran
Neonatal Research Center, Vali-e-Asr Hospital, Tehran University of Medical Sciences, Tehran, Iran
Behavioral Sciences Research Center, Life Style Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran
Faculty of Nursing, Baqiyatallah University of Medical Sciences, Tehran, Iran
Department of Foreign Languages, Faculty of Literature and Humanities, Kharazmi University, Tehran, Iran

how to cite: Kamran F, Sagheb S, Khatoonabadi S A, Ebadi A, Faryadras Y, et al. The Validity and Reliability of Early Feeding Skills Assessment and Cue-Based Feeding Scales for Preterm Infants. Middle East J Rehabil Health Stud. 2021;8(3):e110973. https://doi.org/10.5812/mejrh.110973.

Abstract

Background:

One of the fundamental factors in infants’ readiness to discharge from the Neonatal Intensive Care Unit (NICU) is attaining full oral feeding. Determining the infants’ development requires instruments to comprehensively assess the infants’ oral skills and the process of feeding.

Objectives:

This study aimed to measure the validity and reliability of Early Feeding Skill assessment (EFS) and the subscales of the cue-based feeding (Oral Feeding Readiness scale (OFRS) and Oral Feeding Quality scale (OFQS)).

Methods:

Participants consisted of 30 preterm infants born at gestational age (GA) ≤ 34 weeks in Dr. Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran. Infants were enrolled by convenience sampling. Intraclass correlation coefficients (ICC) and Weighted Kappa were used to measure reliability, and Spearman and Pearson’s correlation coefficient were used to test convergent and discriminant validity.

Results:

The inter- and intra-rater reliability of all dimensions of EFS were good (ICC ranged from 0.77 to 0.95) except intra-rater reliabiltiy for the ability to maintain physiologic stability and ability to coordinate swallowing was moderate. The inter-rater reliability of the cue-based feeding scales was excellent (Weighted Kappa of > 0.74). The intra-rater reliablity indicated good agreement for OFRS (Weighted Kappa = 0.73) and excellent agreement for OFQS (Weighted Kappa = 0.75). There was an inverse correlation between most subscales of EFS and cue-based feeding scales (P < 0.05), except the ability to maintain physiologic stability and ability to coordinate swallowing dimensions (P > 0.05). There was a significant correlation between the ability to maintain physiologic stability dimension and post menstrual age (PMA) (r = 38, (P < 0.05) and between the oral feeding recovery assessment and GA (r = 0.37, (P < 0.05). OFQS was inversely correlated with GA and PMA (P < 0.05).

Conclusions:

EFS and cue-based feeding scales are valid and reliable scales to assess the oral feeding skills of preterm infants; however, using only one of these scales solely to evaluate infants’ feeding process is not enough.

1. Background

One of the most important concerns for preterm infants’ discharge is the achievement of oral feeding skills (1, 2). The immaturity of neurological, cardio-respiratory, and gastrointestinal functions in preterm infants leads to delay in oral feeding (3-5). Approximately, 40% to 70% of infants with comorbidities and 3% to 10% of other infants require tube feeding after discharge (6). One of the most difficult tasks for preterm infants is making a decision for starting oral feeding (7, 8). The evaluation should be performed based on the maturity of infants’ neurodevelopment, respiratory status, weight, activity level, and coordination of sucking, swallowing, and breathing (4). Facilitation of transition to independent oral feeding is one of the most important aims of the speech-language pathologist in the neonatal field (9).

Assessment instruments are required to objectively evaluate infants’ oral feeding skills before and during feeding (10, 11). If tools do not provide enough detail to guide therapists for decision-making about the starting time of oral feeding, they are not able to identify deficient areas of infants’ oral skills to select the best method for intervention, and more importantly, tools do not determine the effects of feeding interventions precisely. In this situation, it is possible to start infants’ oral feeding before readiness for feeding, which has negative effects on infants and families, such as prolonged hospitalization, increase in health costs, and low interaction between infant and parents (6, 12).

There are some available scales to assess the infants’ oral feeding skills (10). LATCH is one of the scales developed to assess oral feeding skills during breastfeeding (L, latches; A, audible swallowing; T, nipple type; C, level of comfort; H, holding infant) (13). Another scale is Preterm Oral Feeding Readiness scale (POFRS) that is only for assessing preterm infants’ oral feeding readiness. The subscales of this scale include corrected age, behavioral organization, oral posture, oral reflexes, and nonnutritive sucking (14, 15). Moreover, Neonatal Oral Motor Assessment scale (NOMAS) is one of the primary tools to assess infants’ oral motor function and sucking. NOMAS is a 28-item scale that evaluates the infants’ jaw and tongue movements to classify their sucking patterns as normal, disorganized, or dysfunctional. It solely assesses the movements of tongue and jaw (6, 16, 17).

The above-mentioned scales assess oral motor skills before feeding and only the LATCH scale assesses during feeding, which is not used for evaluation during bottle feeding and before starting oral feeding. Oral feeding progress in preterm infants is evaluated based on neurodevelopmental evolution, the avoidance of stresses during feeding, and positive experience (18). Early Feeding Skill Assessment (EFS) and cue-based feeding are the only scales which evaluate infants’ oral feeding readiness before feeding, feeding tolerance, and feeding quality during their feeding.

Evidence demonstrates that the cue-based feeding approach is based on the recognition of ready cues and stress cues to help preterm infants to attain an independent oral feeding that is safe and efficient. In the cue-based feeding protocol, infants’ feeding behaviors are assessed based on the Oral Feeding Readiness scale (OFRS) which investigates infants’ oral feeding cues such as infant’s state, rooting behavior, muscle tone, physiological instability before feeding, and Oral Feeding Quality scale (OFQS) that considers oral feeding behavior during feeding such as sucking, coordination between sucking, swallowing, and breathing, and duration of feeding (19-21).

Early Feeding Skill assessment (EFS) is another scale that evaluates oral feeding skills before, during, and after feeding. EFS measures infants’ feeding skills from first oral feeding until 52 weeks of post-conceptional age. The subscales of EFS indicate areas of strength, areas of some clinical concerns, and areas of major clinical concerns (22-24).

Early identification of infants with feeding disorders is necessary to receive appropriate treatment, optimize their feeding, and improve oral feeding skill. However, since infants are not able to communicate during feeding, confusing feeding behaviors might appear inconsistently. It is difficult to distinguish between confusing feeding behaviors and usual feeding behaviors. Under this condition, some instruments are required to objectively and comprehensively assess the infants’ oral skills and process of feeding (10, 11). EFS and cue-based feeding scales are the only scales which not only assess infants’ feeding readiness before starting oral feeding but also their oral feeding quality during feeding. Using these scales, speech and language pathologists are able to identify and resolve infants’ oral feeding problems early and recognize the best time for infants to attain independent oral feeding, which positively affect infants’ growth (6, 25). In addition, one of the most important feeding methods over the world is cue-based feeding, and since this method has been recently used in Iran, the validated scale of this method is required.

2. Objectives

There is no study in Iran on concurrent investigation of EFS and cue-based feeding scales and inter- and intra-rater reliability of these scales; the present study aimed to measure the validity and reliability of the EFS and cue-based feeding scales.

3. Methods

A cross-sectional study was carried out. The study protocol was approved by the Institutional Review Board, School of Rehabilitation, and the Ethics Committee of Tehran University of Medical Sciences (code: IR.TUMS.VCR.REC.1398.042). The consent form was completed by the infants’ parents.

3.1. Participants

Participants consisted of preterm infants with gestational age (GA) ≤ 34 weeks born in the Neonatal Intensive Care Unit of Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran, from December 2017 to February 2018. The infants were enrolled based on convenience sampling, and the restriction of enrollment method was used for minimizing confounding variables (26). Term infants and preterm infants over the gestational age of 34 weeks were the confounding variables. To control these confounders, the study population was limited to preterm infants aged ≤ 34 weeks. Infants who received a score more than 30 in Preterm Oral Feeding Readiness scale in a primary assessment performed by the speech-language pathologist, infants who did not have neurological disorders and congenital anomalies, and infants with Apgar score of 3 or more in the first minute and Apgar score of 5 or more in the first 5 minutes were included in the study. Dead infants, infants with reluctant families to participate, and a sudden change in infants’ nutritional status, such as cerebral hemorrhage or intestinal problems were excluded from the study.

According to Bonet’s study, with α = 0.05, power = 95%, and minimum ICC = 0.65, the minimum sample size was calculated for two raters and 23 preterm infants (27, 28). To prevent attrition, 30 preterm infants were enrolled in the research to determine psychometrical properties.

3.2. Instruments

Early feeding skill Assessment is a 28-item scale that evaluates feeding skills in infants in three parts, including before starting oral feeding to demonstrate readiness for oral feeding by four items, during feeding consisting of four dimensions: the ability of engagement maintenance in feeding (four items), the ability of oral-motor skills organization (four items), the ability of swallow coordination (six items), and the ability of physiological stabilization (nine items), and after feeding assessment (two items). The score range of items was 1 - 3; score 1 indicates the presence of a problem and score 3 represents the absence of a problem. The content validity of EFS was affirmed by neonatal nurses and feeding experts. The inter-rater reliability and intra-rater reliability of EFS were reported 0.85 and 0.81, respectively (6, 22, 23).

Oral Feeding Readiness scale (OFRS) has five options related to preterm infants’ oral feeding cues including infant state, rooting behavior, muscle tone, and physiological instability. Feeding readiness ranged from 1 to 5. Score 1 indicates drowsy or alert state, rooting behavior, and good tone. Score 5 means that an infant’s physiological condition is not stable, and the infant is not ready for feeding (19, 21).

Oral Feeding Quality scale (OFQS) evaluates the quality of preterm infants’ oral feeding. This scale considers an infant's sucking, coordination between sucking, swallowing, and breathing, and feeding duration. The scale consists of five items ranging from 1 to 5. Scores 1 and 2 demonstrate that oral feeding quality is satisfactory and the infant is able to feed all milk volume by bottle or breast (19, 21).

3.3. Translation and Face Validity

Initially, the researcher had permitted the scales’ designer to use the EFS and the cue-based feeding. The forward and backward translation method was utilized to translate the English version of the scales into Persian (29). According to this method, two Iranian translators, who were expert in English, translated the original version of scales into Persian. Then, the translators and two SLPs participated on a panel to synthesize two translated versions. The synthesized Persian version of scales was back translated into English by two translators and was sent to the scales’ developers. In the next step, the expert panel (an expert methodologist in the validation of instruments, two SLPs, a neonatologist, and a translator) investigated the original version and the Persian version in terms of conceptual, semantic, and clinical equivalence. Then, the pre-final version of the scales was approved. The Persian version of the scales was investigated by 10 speech and language pathologists to determine face validity. Finally, the Persian version of EFS and the cue-based feeding scales was constructed.

3.4. Construct Validity

Convergent validity and discriminant validity were used to examine construct validity. To assess the convergent validity, the subscales of EFS were correlated with the subscales of cue-based feeding. To test the discriminant validity, known-group validity was used, testing the correlation between EFS and the cue-based feeding scales in terms of GA and post-menstrual age (PMA).

3.5. Reliability

To measure the inter-rater reliability of the scales, two speech-language pathologists with 3 years experience in infants’ feeding in NICU assessed each infant before and during feeding. Therapists accomplished the assessment for each infant without consulting each other. Both therapists observed the infants’ behaviors concurrently.

To test the intra-rater reliability, while the infants’ behaviors were video recorded, each infant was assessed once by one of the therapists. After 1 week, the infants’ oral feeding skills on the recorded videos were re-evaluated by the therapist.

3.6. Statistical Analysis

Intraclass Correlation Coefficients were used to test the inter-rater and intra-rater reliability of EFS. Coefficients less than 0.5 indicate poor reliability, between 0.51 and 0.75 moderate reliability, and more than 0.75 good reliability (29). Weighted Kappa was used to measure the inter-rater and intra-rater agreement of the cue-based feeding scales. Evaluation criteria for kappa, using guidelines described in Cicchetti and Sparrow (30) and Fleiss et al. (31), are as follows: Fair = k of .40 - 0.59; Good = k of .60 - 0.74; and Excellent = k > 0.74. Spearman’s correlation coefficient was used to test the convergent validity of EFS and the subscales of the cue-based feeding. The correlation between EFS and the cue-based feeding scales regarding GA and PMA were measured by Pearson’s correlation coefficient. All data were analyzed with SPSS version 23.

4. Results

The demographic and clinical characteristics of infants are illustrated in Table 1. Thirty Infants aged 28 - 34 weeks of gestaion and weighted 1000 - 2290 gram were enrolled in the study. The majority of infants used breast feeding and bottle feeding (26.5%). 10.3% of infants used bottle feeding, and 7.2% of infants used breast feeding.

Table 1.

Demographic and Clinical Characteristics of Infantsa

CharacteristicsValues (N = 30)
Female17 (56.7)
Gestational age, wk31.93 ± 1.71
< 282 (2.9)
28 - 3210 (14.7)
32 - 3418 (26.5)
Post menstrual age, wk32.40 ± 1.45
Birth weight, g1642.00 ± 320.54
1000 - 150010 (14.7)
1500 - 200017 (25)
2000 < 3 (4.4)
Apgar score 1 min6.26 ± 1.98
Apgar score 5 min8.33 ± 0.95

4.1. Inter- and Intra-Rater Reliability of EFS

According to Table 2, the inter-rater reliability of all dimensions of EFS was good (ICC ranged from 0.77 to 0.95). The ability to organize oral-motor function dimension showed the most agreement (ICC: 0.95; 95% CI: 0.89 - 0.97) and the ability to coordinate swallowing dimension had the least agreement (ICC: 0.80; 95% CI: 0.58 - 0.90). The intra-rater reliability (ICC ranged from 0.82 to 0.94) of all dimensions of EFS was good, except the ability to maintain engagement in feeding (ICC: 0.69; 95% CI: 0.38 - 0.85) and the ability to coordinate swallowing (ICC: 0.65; 95% CI: 0.28 - 0.83) dimensions were moderate.

Table 2.

Inter- and Intra-Rater Reliability of EFS

DimensionsInter-Rater ReliabilityIntra-Rater Reliability
Mean (SD)ICCCISEMMean (SD)ICCCISEM
Oral feeding readiness assessment2.50 (0.43)0.940.87 - 0.970.162.33 (0.54)0.820.63 - 0.910.22
Ability to maintain engagement in feeding2.73 (0.31)0.890.77 - 0.940.102.54 (0.36)0.690.38 - 0.850.20
Ability to organize oral-motor functioning2.47 (0.47)0.950.89 - 0.970.102.38 (0.47)0.940.87 - 0.970.11
Ability to coordinate swallowing2.95 (0.08)0.800.58 - 0.900.032.86 (0.24)0.650.28 - 0.830.14
Ability to maintain physiologic stability2.8 (0.37)0.770.26 - 0.910.172.57 (0.41)0.880.77 - 0.940.14
Oral feeding recovery assessment2.66 (0.44)0.860.70 - 0.930.162.61 (0.53)0.830.64 - 0.920.21

4.2. Inter- and Intra-Rater Reliability of the Cue-Based Feeding Scales

Table 3 demonstrates the inter- and the intra-rater reliability of the cue-based feeding scales. Weighted Kappa for both scales revealed a high range of agreement between the two examiners (Weighted Kappa of OFRS = 0.88, Weighted Kappa of OFQS = 0.95). The intra-rater reliability indicated a good agreement for OFRS (Weighted Kappa = 0.73) and an excellent agreement for OFQS (Weighted Kappa = 0.75).

Table 3.

Inter- and Intra-Rater Reliability of Cue-Based Feeding Scales

Cue-Based Feeding ScalesInter-Rater ReliabilityIntra-Rater Reliability
Weighted KappaStandard ErrorWeighted KappaStandard Error
Oral Feeding Readiness scale0.880.090.730.10
Oral Feeding Quality scale0.950.040.750.11

4.3. Convergent Validity of EFS and the Cue-Based Feeding Scales

Table 4 indicates Spearman’s correlation between the subscales of EFS and the cue-based feeding. There was an inverse correlation between the subscales of EFS (readiness before feeding, the ability to maintain engagement in feeding, the ability to organize oral-motor functioning, and oral feeding recovery) and the subscales of the cue-based feeding (OFRS and OFQS) (P < 0.05). However, there was no correlation between the subscales of the ability to maintain physiologic stability (P = 0.07, P = 0.13) and the ability to coordinate swallowing (P = 0.27, P = 0.07) with OFRS and OFQS (P > 0.05).

Table 4.

Convergent Validity of EFS and Cue-Based Feeding Scales

DimensionsCue-Based Feeding ScalesP-Value
Oral feeding readiness assessment
OFRS0.000-0.77
OFQS0.000-0.68
Ability to maintain engagement in feeding
OFRS0.002-0.53
OFQS0.052-0.35
Ability to organize oral-motor functioning
OFRS0.000-0.71
OFQS0.000-0.74
Ability to coordinate swallowing
OFRS0.271-0.20
OFQS0.078-0.32
Ability to maintain physiologic stability
OFRS0.075-0.33
OFQS0.136-0.27
Oral feeding recovery assessment
OFRS0.003-0.51
OFQS0.006-0.49

4.4. Correlation Between EFS and the Cue-Based Feeding Scales Regarding GA and PMA

Table 5 shows the correlation between the subscales of EFS and the subscales of the cue-based feeding, considering infants’ GA and PMA. There was a meaningful correlation between the ability to maintain physiologic stability dimension and PMA (r = 0.38, P = 0.03) and between the oral feeding recovery assessment subscale and GA (r = 0.37, P = 0.04). There was an inverse correlation between OFQS and GA (r = -0.36, P = 0.04); later GA and lower OFQS score (higher feeding quality) were correlated. In addition, more PMA was associated with lower OFQS score (r = -0.39, P = 0.03).

Table 5.

Correlation Between the EFS and Cue-Based Feeding Scales Regarding GA and PMA

GAPMA
P-ValueRP-Valuer
EFS
Oral feeding readiness assessment0.260.200.680.07
Ability to maintain engagement in feeding0.060.730.380.16
Ability to organize oral-motor functioning0.240.210.250.21
Ability to coordinate swallowing0.900.020.720.06
Ability to maintain physiologic stability0.660.080.030.38
Oral feeding recovery assessment0.040.370.530.11
Cue-based feeding
OFRS0.41-0.150.53-0.11
OFQS0.04-0.360.03-0.39

5. Discussion

This research investigated the reliability and validity of EFS and the cue-based feeding scales. There was no noticeable change in terms of translation and face validity. A professional group consisted of 10 speech-language pathologists who approved the clarification and relevance of the items. This was in agreement with the study that Ludwig and Waitzman (32) performed to investigate the content validity of the Cue-Based Feeding scales. Furthermore, it was consistent with the studies conducted by dos Santos Curado (11) in Brazil on the validation of EFS for the Portuguese population, including 698 infants with GA of 24 - 37 weeks. In addition, Abarzua et al. (24) and Thoyre et al. (6) confirmed the face and content validity of EFS.

The inter-rater reliability of all subscales of EFS was good. ICC greater than 0.75 represented good reliability for a tool. The results indicated that EFS had a high level of agreement. The ability to organize oral-motor function dimension showed the most agreement, and the ability to coordinate swallowing dimension had the least agreement.

In addition, the intra-rater reliability of all dimensions of EFS was good (ICC ranged from 0.82 to 0.94) except for maintenance and coordination dimensions that were moderate. The findings demonstrated that EFS had a high intra-rater reliability.

Previous studies used the internal consistency method to determine reliability. In a study by Bahrami et al. (33), Cronbach’s alpha coefficient was 0.88. Thoyre et al. (6) tested the psychometric properties of the EFS, which included 142 32-50-week PMA infants; the internal consistency of the total EFS was good (Cronbach α = 0.81). To examine the internal consistency of the subscales, they measured interiterm correlation mean, ranged from 0.28 to 0.47. The interiterm correlation mean ranged from 0.15 to 0.50 are acceptable (6). In the Portuguese version, the overall Cronbach’s alpha of EFS was 0.85. In this version, the reliability of the ability to organize oral-motor functioning (α = 0.79) and the ability to coordinate swallowing (α = 0.65) dimensions were acceptable, and the ability to maintain physiologic stability dimension (α = 0.81) was reliable (11). The standard reliability for a tool is Cronbach’s alpha coefficient of 0.7 and higher. Previous literature has confirmed the reliability of EFS (11, 33).

The inter- and intra-rater reliability of the cue-based feeding scales revealed a high agreement between the two examiners (Weighted Kappa of OFRS = 0.88, Weighted Kappa of OFQS = 0.95). The intra-rater reliability indicated a good agreement for OFRS (Weighted Kappa = 0.73) and an excellent agreement for OFQS (Weighted Kappa = 0.75). Good to moderate intra-rater reliability represented the acceptable stability of the cue-based feeding scales over time. Davidson et al. performed a study to adapt the cue-based feeding scales with the chronic conditions of preterm infants such as bronchopulmonary dysplasia; the Cronbach’s alpha coefficient was 0.51 (21).

There was no correlation between the ability to maintain physiologic stability and the ability to coordinate swallowing dimensions regarding OFRS and OFQS (P > 0.05). Thoyre et al. (6) demonstrated a significant inverse correlation between all subscales of EFS and OFQS. The lower score of OFQS (high feeding quality) indicated the higher score of the EFS subscales (higher oral feeding skills). This difference can be due to the difference between infants’ PMA in the present study and Thoyre’ (6). Infants’ PMA in this research was lower.

In the present study, only the higher ability to maintain physiologic stability score correlated with later PMA (P < 0.05), while in Thoyre’s study (6), only the ability to maintain engagement dimension was associated with PMA. In this study, the infants with later PMA were a more healthy group, and the ability to maintain engagement in the study of Thoyre et al. (6) was consistent with brain maturation and wake and sleep developments. Moreover, the higher oral feeding recovery assessment score was associated with later GA (P < 0.05), and according to Thoyre et al. (6), the ability to maintain physiologic stability score was correlated with more GA. Difference in the skills of observers in two studies can be the reason for variations in the results. Later GA was correlated with lower OFQS score (higher feeding quality). In addition, more PMA was associated with lower OFQS score.

5.1. Conclusions

The EFS and cue-based feeding scales are valid and reliable scales to assess the oral feeding skills of preterm infants. Not only most EFS subscales were correlated with the cue-based feeding scales but also some subscales of EFS and OFQS were associated with GA and PMA; however, using one of these scales is not solely enough to evaluate infants’ feeding process. One of the limitations of the study was infants’ different behavioral patterns during feeding, causing observers’ confusion. Another limitation was the small sample size of preterm infants. Assessing EFS and cue-based feeding scales with larger samples involving preterm and full-term infants are recommended.

References

  • 1.

    Williamson LR. Early feeding skills assessment in preterm infants. University of Kansas; 2013.

  • 2.

    Kamran F, Khatoonabadi AR, Aghajanzadeh M, Ebadi A, Faryadras Y, Sagheb S. Effectiveness of Cue-Based Feeding Versus Scheduled Feeding in Preterm Infants Using Comprehensive Feeding Assessment Scales: A Randomized Clinical Trial. Iran J Pediatr. 2020;30(6). https://doi.org/10.5812/ijp.107475.

  • 3.

    Touzet S, Beissel A, Denis A, Pillet F, Gauthier-Moulinier H, Hommey S, et al. Effectiveness of a nurse educational oral feeding programme on feeding outcomes in neonates: protocol for an interrupted time series design. BMJ Open. 2016;6(4). e010699. [PubMed ID: 27084282]. [PubMed Central ID: PMC4838690]. https://doi.org/10.1136/bmjopen-2015-010699.

  • 4.

    Gianni ML, Sannino P, Bezze E, Plevani L, Esposito C, Muscolo S, et al. Usefulness of the Infant Driven Scale in the early identification of preterm infants at risk for delayed oral feeding independency. Early Hum Dev. 2017;115:18-22. [PubMed ID: 28843138]. https://doi.org/10.1016/j.earlhumdev.2017.08.008.

  • 5.

    Aykanat Girgin B, Gozen D. Turkish Neonatal Nurses' Knowledge and Practices Regarding the Transition to Oral Feeding in Preterm Infants: A Descriptive, Cross-sectional Study. J Pediatr Nurs. 2020;53:e179-85. [PubMed ID: 32321668]. https://doi.org/10.1016/j.pedn.2020.03.017.

  • 6.

    Thoyre SM, Pados BF, Shaker CS, Fuller K, Park J. Psychometric Properties of the Early Feeding Skills Assessment Tool. Adv Neonatal Care. 2018;18(5):E13-23. [PubMed ID: 30239407]. https://doi.org/10.1097/ANC.0000000000000537.

  • 7.

    Crowe L, Chang A, Wallace K. Instruments for assessing readiness to commence suck feeds in preterm infants: effects on time to establish full oral feeding and duration of hospitalisation. Cochrane Database Syst Rev. 2016;(8). CD005586. [PubMed ID: 27552522]. [PubMed Central ID: PMC6464358]. https://doi.org/10.1002/14651858.CD005586.pub3.

  • 8.

    Parker MG, Hwang SS, Forbes ES, Colvin BN, Brown KR, Colson ER. Use of the Theory of Planned Behavior Framework to Understand Breastfeeding Decision-Making Among Mothers of Preterm Infants. Breastfeed Med. 2020;15(10):608-15. [PubMed ID: 32678988]. [PubMed Central ID: PMC7575351]. https://doi.org/10.1089/bfm.2020.0127.

  • 9.

    Bolzan Gde P, Berwig LC, Prade LS, Cuti LK, Yamamoto RC, Silva AM, et al. Assessment for oral feeding in preterm infants. Codas. 2016;0:0. [PubMed ID: 27383226]. https://doi.org/10.1590/2317-1782/20162015115.

  • 10.

    Pados BF, Park J, Estrem H, Awotwi A. Assessment Tools for Evaluation of Oral Feeding in Infants Younger Than 6 Months. Adv Neonatal Care. 2016;16(2):143-50. [PubMed ID: 26945280]. [PubMed Central ID: PMC4781663]. https://doi.org/10.1097/ANC.0000000000000255.

  • 11.

    dos Santos Curado MA, Maroco JP, Vasconcellos T, Marques Gouveia L, Thoyre S. Validation of the Early Feeding Skills Assessment Scale for the Portuguese population. Revista de Enfermagem Referência. 2017;4(12).

  • 12.

    Shaker CS. Cue-based Co-regulated Feeding in the Neonatal Intensive Care Unit: Supporting Parents in Learning to Feed Their Preterm Infant. Newborn Infant Nurs Rev. 2013;13(1):51-5. https://doi.org/10.1053/j.nainr.2012.12.009.

  • 13.

    Jensen D, Wallace S, Kelsay P. LATCH: a breastfeeding charting system and documentation tool. J Obstet Gynecol Neonatal Nurs. 1994;23(1):27-32. [PubMed ID: 8176525]. https://doi.org/10.1111/j.1552-6909.1994.tb01847.x.

  • 14.

    Fujinaga CI, de Moraes SA, Zamberlan-Amorim NE, Castral TC, de Almeida e Silva A, Scochi CG. Clinical validation of the Preterm Oral Feeding Readiness Assessment Scale. Rev Lat Am Enfermagem. 2013;21 Spec No:140-5. [PubMed ID: 23459901]. https://doi.org/10.1590/s0104-11692013000700018.

  • 15.

    Kamran F, Sagheb S, Aghajanzade M, Ebadi A, Faryadras Y, Khatoonabadi AR. The Interrater and Intrarater Reliability of the Preterm Infant Oral Feeding Readiness Assessment Scale. J Modern Rehabil. 2019:31-8. https://doi.org/10.32598/jmr.13.1.31.

  • 16.

    da Costa SP, van der Schans CP. The reliability of the Neonatal Oral-Motor Assessment Scale. Acta Paediatr. 2008;97(1):21-6. [PubMed ID: 18201309]. https://doi.org/10.1111/j.1651-2227.2007.00577.x.

  • 17.

    Howe T, Sheu C. Predicting Bottle-Feeding Performance Using a Reorganized Neonatal Oral-Motor Assessment Scale (NOMAS). Am J Occup Ther. 2020;74(4_Supplement_1). https://doi.org/10.5014/ajot.2020.74S1-PO3113.

  • 18.

    Whetten CH. Cue-Based Feeding in the NICU. Nurs Womens Health. 2016;20(5):507-10. [PubMed ID: 27719780]. https://doi.org/10.1016/j.nwh.2016.08.006.

  • 19.

    Newland L, L'Huillier M W, Petrey B. Implementation of cue-based feeding in a level III NICU. Neonatal Netw. 2013;32(2):132-7. [PubMed ID: 23477983]. https://doi.org/10.1891/0730-0832.32.2.132.

  • 20.

    Watson J, McGuire W. Responsive versus scheduled feeding for preterm infants. Cochrane Database Syst Rev. 2015;(10). CD005255. [PubMed ID: 26459238]. https://doi.org/10.1002/14651858.CD005255.pub4.

  • 21.

    Davidson E, Hinton D, Ryan-Wenger N, Jadcherla S. Quality improvement study of effectiveness of cue-based feeding in infants with bronchopulmonary dysplasia in the neonatal intensive care unit. J Obstet Gynecol Neonatal Nurs. 2013;42(6):629-40. [PubMed ID: 25811050]. https://doi.org/10.1111/1552-6909.12257.

  • 22.

    Thoyre S, Shaker C, Pridham K. Manual for administration of the early feeding skills assessment (EFS). Chapel Hill, NC: North Carolina Neonatal Nursing and Hospital Early Intervention Institute, University of North Carolina-Chapel Hill; 2012.

  • 23.

    Thoyre SM, Shaker CS, Pridham KF. The early feeding skills assessment for preterm infants. Neonatal Netw. 2005;24(3):7-16. [PubMed ID: 15960007]. [PubMed Central ID: PMC2828611]. https://doi.org/10.1891/0730-0832.24.3.7.

  • 24.

    Abarzua PC, Godoy MA, Rubilar PM, Silva Sch M, Velasquez ZM, Bustos ML. Standardization of Early Feeding Skills (EFS) scale in preterm infants. Rev Chil Pediatr. 2019;90(5):508-14. [PubMed ID: 31859734]. https://doi.org/10.32641/rchped.v90i5.1023.

  • 25.

    Diercks GR, Hersh CJ, Baars R, Sally S, Caloway C, Hartnick CJ. Factors associated with frenotomy after a multidisciplinary assessment of infants with breastfeeding difficulties. Int J Pediatr Otorhinolaryngol. 2020;138:110212. [PubMed ID: 32738672]. https://doi.org/10.1016/j.ijporl.2020.110212.

  • 26.

    Pourhoseingholi MA, Baghestani AR, Vahedi M. How to control confounding effects by statistical analysis. Gastroenterol Hepatol Bed Bench. 2012;5(2):79-83. [PubMed ID: 24834204]. [PubMed Central ID: PMC4017459].

  • 27.

    Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21(9):1331-5. [PubMed ID: 12111881]. https://doi.org/10.1002/sim.1108.

  • 28.

    Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17(1):101-10. [PubMed ID: 9463853]. https://doi.org/10.1002/(sici)1097-0258(19980115)17:1<101::aid-sim727>3.0.co;2-e.

  • 29.

    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. [PubMed ID: 11124735]. https://doi.org/10.1097/00007632-200012150-00014.

  • 30.

    Cicchetti DV, Sparrow SA. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am J Ment Defic. 1981;86(2):127-37. [PubMed ID: 7315877].

  • 31.

    Fleiss JL, Levin B, Paik MC. The measurement of interrater agreement. Stat Method Rates Proportions. 1981;2(212-236):22-3.

  • 32.

    Ludwig SM, Waitzman KA. Changing Feeding Documentation to Reflect Infant-Driven Feeding Practice. Newborn Infant Nurs Rev. 2007;7(3):155-60. https://doi.org/10.1053/j.nainr.2007.06.007.

  • 33.

    Bahrami B, Marofi M, Farajzadegan Z, Barekatain B. Validation of the Early Feeding Skills Assessment Scale for the Evaluation of Oral Feeding in Premature Infants. Iran J Neonatol IJN. 2019;10(2):68-75.