Assessing the Effectiveness of the Combined Apgar Scoring System in Predicting the Short-Term Outcomes of Newborns

authors:

avatar Samira Pournajaf ORCID 1 , avatar Zahra Akbarian Rad ORCID 1 , avatar Hemmat Gholinia Ahangar ORCID 2 , avatar Nesae Bozorgnezhad ORCID 3 , avatar Mohsen Haghshenas Mojaveri ORCID 1 , *

Non-communicable Pediatric Diseases Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
Health Research Institute, Babol University of Medical Sciences, Babol, Iran
Clinical Research Development Unit of Rouhani Hospital, Babol University of Medical Sciences, Babol, Iran

how to cite: Pournajaf S, Akbarian Rad Z, Gholinia Ahangar H, Bozorgnezhad N, Haghshenas Mojaveri M. Assessing the Effectiveness of the Combined Apgar Scoring System in Predicting the Short-Term Outcomes of Newborns. J Compr Ped. 2024;15(1):e138666. https://doi.org/10.5812/jcp-138666.

Abstract

Background:

Many clinicians have used the Apgar scoring system to evaluate newborn babies at the first minutes of birth. Expanded and combined Apgar have been introduced due to the interventions done for babies in the first minutes of life. This study evaluates the predicting values of combined Apgar scores in short-term neonatal outcomes.

Methods:

A diagnostic test was conducted on alive preterm and term babies without major anomalies between October 2021 and August 2022. Infants with congenital heart disease, congenital metabolic disorders, and those transferred to another hospital were excluded. Demographic data, feeding volume, conventional, expanded, and combined Apgar scores were assessed at 5 minutes of birth and recorded. The area under the receiver operating characteristic (ROC) curve was used to determine the sensitivity and specificity of the combined Apgar score to predict short-term outcomes (need to admission, duration of hospitalization, and oral feeding progression).

Results:

Of 599 babies (339 boys and 260 girls) with a mean gestational age of 35.3 ± 3.8 weeks (25 - 42 weeks), 280 (46.7%) babies were admitted. As the average Apgar score decreased, progression to full oral feeding was associated with longer delay. The area under the ROC curve for the Combined Apgar score was 80% and 55% in correlation with the need for admission and duration of hospitalization, respectively.

Conclusions:

This study showed that the 5th-minute combined Apgar score is a good predictor of the need for admission and oral feeding progression but does not seem suitable for predicting the duration of hospitalization.

1. Background

Virginia Apgar introduced the Apgar scoring system about 70 years ago, in 1953, to evaluate the condition of a newborn baby at birth (1), and many clinicians have used this method hitherto. In this method, 5 factors are evaluated, including skin color, muscle tone, heart rate, grimace to stimulation, and respiratory effort; each is given a score from zero to two. A maximum of 10 points are given to the baby (2). However, what interventions were done to achieve this score was not considered. Therefore, the American Academy of Pediatrics (AAP) and the American College of Obstetricians and Gynecologists (ACOG) introduced expanded Apgar determination (3).

In this method, 7 interventions are considered for the baby. If it is done, it gets zero points; if no intervention is done, it gets one point. These interventions include the administration of supplemental oxygen, continuous positive airway pressure (CPAP), positive pressure ventilation (PPV), intubation, surfactant administration, chest compression, and epinephrin administration (3-5).

Combined Apgar score (CA), a new scoring system, is the sum of the conventional Apgar score and the Expanded Apgar score, and the baby is awarded a score of 17 in the best condition and with no interventions (6).

Although many studies have shown that gestational age, birth weight, maternal pregnancy complication, maternal hospitalization during pregnancy, etc., are predictors of hospitalization in the neonatal intensive care unit (NICU) (7, 8), there is still a challenge as to what factors can best predict short term outcomes in neonates. In this study, we intended to check whether a combined Apgar score can predict the need for hospitalization, the length, and the age at which full oral feeding can be achieved.

2. Methods

2.1. Study Population and Sampling

This diagnostic test study was conducted on babies born in Ayatollah Rouhani Hospital, affiliated with Babol University of Medical Science, between October 2021 and August 2022.

Inclusion criteria were all live births of any gestational age without major anomalies. Exclusion criteria subsume congenital cyanotic heart disease, a congenital metabolic disorder diagnosed during hospitalization, and babies transferred to another hospital for any reason.

2.2. Data Collection

According to the checklist the researcher previously designed, all live births were given conventional, expanded, and combined Apgar scores at minute 5 of birth. Considering that in all low-risk births, a midwife who is certified in neonatal resuscitation program, and all high-risk births, in addition to the midwife, a pediatric specialist or a trained pediatric specialist assistant who is certified in neonatal resuscitation program, are present in the delivery room or the cesarean section operating room, Apgar scoring is done by these personnel. All interventions performed during resuscitation were completely recorded. The combined Apgar score was reviewed again and corrected by the neonatologist according to the information contained in the medical reports.

Demographic data (such as gender, gestational age, and birth weight) and admission and discharge data were recorded.

The baby's age at the time of starting oral feeding and the age when the baby achieved oral feeding at the rate of 50 cc/kg/day and 100 cc/kg/day were recorded in the medical reports. Breastfed babies were considered fullfed (> 100cc/kg/day).

2.3. Sample Size and Data Analysis

Based on the formula for determining the sample size, this study had to be done on 570 samples.

z1-α2 2sense1-sensed2×prev

Sense = 85%

Prev = 35%

d = 5%

After collecting data, all statistical analyses were performed using SPSS version 22 statistical software and analyzed with descriptive indices and chi-square tests, t-test, ANOVA, and calculation of sensitivity, specificity, positive and negative predictive value; receiver operating characteristic (ROC) curve was used to analyze the correlations and relationships between variables. A P value < 0.05 was used to evaluate the statistical significance of the associations and correlations between variables.

This study was approved by the Ethics Committee of the Babol University of Medical Sciences. (Ethics code: IR.MUBABOL.HRI.REC.1400.215).

3. Results

Based on the formula, 615 babies were included in the study. Sixteen were excluded from the study due to the exclusion criteria (including 8 babies with congenital heart disease, 2 with gender disorders, 2 with a diaphragmatic hernia, 1 with hydrops fetalis, 1 with esophageal atresia, 1 with imperforate anus and a baby transferred to another hospital for surgery). This study was conducted on 599 babies (339 boys and 260 girls) with a mean gestational age (GA) of 35.3 ± 3.8 weeks (w) (25 - 42 w).

At minute 5, 0.5% of neonates had an EA score of zero, and 47.7% of themes had a score of 7. The lowest conventional Apgar score of 5 minutes was 2, which included only 0.3% of the babies, but more than half of the babies (58.4%) got a perfect conventional Apgar score of 5 minutes (9). At minute 5, The lowest combined Apgar score was 3, which included 0.3% of the babies, and the highest was 17, which included 42.6%.

Of 599 babies, 280 (46.7%) were admitted to NICU. Among admitted cases, 10.7% (n = 64) were hospitalized for 1 to 7 days, and 36.1% (n = 216) were admitted for more than 7 days. The average duration of hospitalization was 9.5 ± 17.2 days, and the maximum duration was 101 days.

Surfactant therapy was done for 49.6% of admitted babies (n = 139) in the first hour of life.

Babies were divided into three groups based on gestational age: GA < 28 w (A), 28 - 34 w (B), > 34 w (C), and outcomes were analyzed separately in these groups.

3.1. Need to Admission

Of 599 babies, 280 (46.7) were admitted to NICU. The mean of 5th-minute combined Apgar in admitted babies was 16.23 ± 1.37; in not-admitted babies, it was 13.81 ± 2.68 (Table 1). Figure 1 illustrates the sensitivity and specificity of the 5th-minute combined Apgar score in predicting the need for admission using an ROC curve. The area under the ROC curve (AUC) for 5th minutes combined Apgar equaled 80% (Table 2). Combined Apgar equal to and less than 15 with 79% sensitivity and 70% specificity can predict the probability of hospitalization in neonates.

ROC curve showing sensitivity and specificity of combined Apgar in predicting the need for admission and duration of hospitalization in all neonates
ROC curve showing sensitivity and specificity of combined Apgar in predicting the need for admission and duration of hospitalization in all neonates
Table 1.

The Mean of 5th Minute Combined Apgar in Admitted and Not Admitted Babies

AdmissionMeanStandard DeviationMean DifferenceP-Value
No16.231.372.415<0.001
Yes13.812.68
Table 2.

Area Under the ROC Curve Showing Combined Apgar in Predicting the Need for Admission and Duration of Hospitalization in All Neonates

Test Result Variable(s)AreaP-ValueAsymptotic 95% Confidence Interval
Lower BoundUpper Bound
5th minute combined Apgar
Need to admission0.805< 0.0010.7690.840
Duration of hospitalization0.5550.1780.4690.642

Because all infants with a gestational age of less than 28 weeks were admitted, it was impossible to assess combined Apgar for the need for admission. Still, the other two groups evaluated it separately (Figure 2 and Table 3). Fifth-minute combined Apgar score can predict the need to be admitted in group B better than group C.

Table 3.

The Area Under the ROC Curve Showing Combined Apgar in Predicting the Need for Admission and Duration of Hospitalization Based on GA

Test Result Variable(s)GA GroupsAreaP-ValueAsymptotic 95% Confidence Interval
Lower BoundUpper Bound
5th minute combined Apgar
Need to admissionB0.8250.0070.6550.994
C0.693< 0.0010.6380.748
Duration of hospitalizationB0.5860.2690.4160.756
C0.5500.3780.4380.662
ROC curve showing sensitivity and specificity of combined Apgar in predicting newborn’s admission in groups B, C
ROC curve showing sensitivity and specificity of combined Apgar in predicting newborn’s admission in groups B, C

3.2. Duration of Hospitalization

Among 280 admitted babies, 64 were hospitalized for 7 days, and less than 216 were hospitalized for more than 7 days. The mean of the 5th-minute combined Apgar score in the first group was 13.16 ± 3.47, and in the second group was 14 ± 2.37. Figure 1 illustrates the sensitivity and specificity of the 5th-minute combined Apgar score in predicting the duration of hospitalization by using an ROC curve. The area under the ROC curve for 5th minutes combined Apgar equaled 55% (Table 2), which was undesirable.

Since the length of hospitalization was ≤ 7 days in babies with a gestational age of less than 28 weeks, which means their death in the hospital, it was not possible to assess combined Apgar for the duration of hospitalization. However, in two other groups, it was evaluated separately. Based on AUC, 5th minutes combined Apgar was not a good predictor for the duration of hospitalization in these groups, too (Figure 2, Table 3).

3.3. Feeding Tolerance

Among 599 babies, 351 were breastfed on the first day of life. Six babies were fed 50 cc/kg on the first day of life, 131 babies (21.9%) on the second to seventh day, and 78 babies (13%) after the seventh day. Among 599 babies, 176 (29.4%) cases on the 2nd to the 14th day and 39 (6.5%) cases after the 14th day were fed 100 cc/kg (Figure 3, Table 4).

The chart shows the mean of the 5th combined Apgar score and the age of achieving the amount of 50 cc/kg/day and 100cc/kg/day oral feeding.
The chart shows the mean of the 5th combined Apgar score and the age of achieving the amount of 50 cc/kg/day and 100cc/kg/day oral feeding.

As seen in Figure 3 and Table 4, those who never achieved oral feeding (category 0, in fact, the same infants who died before oral feeding) had the lowest mean combined Apgar scores. As the average Apgar score decreases, achieving full oral feeding is associated with a longer delay.

This result was also seen in GA groups B and C, especially in categories 0 and 1 (Tables 4 and 5).

Table 4.

Fifth Minute Combined Apgar Correlation with Time to Achieve 50 and 100cc/Kg Oral Feeding

TimeNMean ± Std. Deviation95% Confidence Interval for Mean
Lower BoundUpper Bound
50cc/kg Oral Feeding
0
All3310.30 ± 3.6318.9411.66
< 28 w1610.56 ± 2.1909.4011.73
28 - 34 w1110.09 ± 4.1587.3012.88
> 34 w614.33 ± 5.5748.4820.18
1
All35716.21 ± 1.25616.0816.34
< 28 w0 - - -
28 - 34 w1115.27 ± 1.42114.3216.23
> 34 w34616.17 ± 2.98915.8516.49
2 - 7
All13114.21 ± 2.26713.8214.61
< 28 w113 - -
28 - 34 w5413.63 ± 2.22613.0214.24
> 34 w7614.64 ± 2.22514.1415.15
> 7
All7813.28 ± 2.18612.7913.77
< 28 w1511.80 ± 2.11110.6312.97
28 - 34 w4913.27 ± 1.99812.6913.84
> 34 w1415.14 ± 1.46014.3015.99
Total59915.10 ± 2.41214.9015.29
100 cc/kg Oral Feeding
0
All3310.30 ± 3.6318.9411.66
< 28 w1610.56 ± 2.1909.4011.73
28 - 34 w1110.09 ± 4.1587.3012.88
> 34 w613.80 ± 6.0586.2821.32
1
All35116.23 ± 1.24316.1016.36
< 28 w0 - - -
28 - 34 w1015.40 ± 1.43014.3816.42
> 34 w34116.19 ± 3.00015.8716.51
- 14
All17614.04 ± 2.32313.6914.39
< 28 w311.33 ± 2.8874.1618.50
28 - 34 w8013.36 ± 2.25212.8613.86
> 34 w9314.74± 2.12114.3115.18
> 14
All3913.26 ± 1.87412.6513.86
< 28 w1312.00± 1.95810.8213.18
28 - 34 w2413.79 ± 1.53213.1414.44
> 34 w215.00 ± 0.00015.0015.00
Total59915.10 ± 2.41214.9015.29
Table 5.

Oral Feeding Progression to 50 and 100cc/Kg/Day According to ANOVA Test in Different GA Groups a

GA GroupsSum of SquaresdfMean SquareFP-Value
50 cc/kg Oral Feeding
< 28
Between groups15.13127.5661.6330.213
Within groups134.338294.632
Total149.46931
28 - 34
Between groups161.965353.98810.093< 0.001
Within groups647.2351215.349
Total809.200124
> 34
Between groups166.750355.5836.693< 0.001
Within groups3637.3954388.305
Total3804.145441
100 cc/kg Oral Feeding
< 28
Between groups14.86527.4321.6010.219
Within groups134.604294.642
Total149.46931
28 - 34
Between groups163.445354.48210.209< 0.001
Within groups645.7551215.337
Total809.200124
> 34
Between groups175.515358.5057.062< 0.001
Within groups3628.6304388.285
Total3804.145441

4. Discussion

In this study, we concluded that a low combined Apgar score can be associated with delayed completion of oral feeding. A combined Apgar score can be a good predictor of the need for admission but cannot predict the duration of hospitalization.

Although studies such as the one conducted in Amman, Jordan (8) considered lower gestational age and lower birth weight as risk factors for NICU admission, in our study, we showed that combined Apgar can be a good predictor of need for NICU admission. In the study conducted in Amman, Jordan, 2016, the reasons for the hospitalization of 373 babies were retrospectively analyzed by delivery type. Although in babies born by cesarean section, compared to vaginal delivery, low Apgar score was more likely to lead to hospitalization. Still, in general, the Apgar score was not a strong predictor. In our study, we examined the combined Apgar score (as opposed to the conventional) and prospectively examined the need for examination in the studied babies that were not separated from each other based on the type of delivery.

A Retrospective observational study that was conducted in the Medi-Clinic private hospital group in Southern Africa, 2007- 2008, used 2376 infants born between 1 January – 31 December 2008 to build the regression models, and a further 1 578 infants born between 1 January – 31 December 2007 to test the models. Outcome measures were mortality and length of hospital stay for NICU admissions. They concluded that Apgar score at one minute, birth weight, and delivery mode can significantly influence the odds of neonatal death and are associated with significant effects on length of stay for neonatal admissions (10). Increases in Apgar score at one minute are associated with a decrease in the duration of hospitalization. In our study, instead of the conventional Apgar, the fifth-minute combined Apgar score value was evaluated in a smaller statistical population compared to their study, and we observed that the fifth-minute combined Apgar was not a good predictor for the duration of hospitalization.

An exploratory study was conducted by Rosemary White-Traut et al. in two inner city community-based Chicago medical centers (2008 - 2011) on 142 stable premature infants (29 - 34 weeks gestational age) who were fully or partially gavage-fed immediately after birth. This study investigated the factors affecting Oral feeding progression (transition time from the first attempt to complete oral feeding). The authors concluded that the longer transition from first to complete oral feeding was related to the Latina origin of the mothers, lower birthweight, lower gestational age, and higher morbidity scores. No significant associations with feeding progression were noted for infant sex, plurality, and 5-minute Apgar score (9). In our study, we specifically investigated combined Apgar scores in oral feeding progression and showed the relationship between variables. We examined 599 infants of all gestational ages and specifically looked at the combined Apgar scores on oral feeding and its progression. However, their study examined only infants with a gestational age of 29 to 34 weeks and retrospectively investigated the factors influencing the progress of feeding.

Although the Apgar score was recorded by individual experts in neonatal resuscitation programs, human error was the most significant limitation of our study. Future research involving larger neonatal populations across multiple centers can more accurately estimate the predictive value of combined Apgar scores for short-term neonatal outcomes.

4.1. Conclusions

Based on our study, we have found that while the combined Apgar score is a reliable indicator of the need for admission, it is not a reliable predictor of the length of stay in the hospital. Additionally, we observed that a low combined Apgar score can result in delayed completion of oral feeding.

Acknowledgements

References

  • 1.

    Apgar V. A Proposal for a New Method of Evaluation of the Newborn Infant. Originally published in July 1953, volume 32, pages 250-259. Anesth Analg. 2015;120(5):1056-9. [PubMed ID: 25899272]. https://doi.org/10.1213/ANE.0b013e31829bdc5c.

  • 2.

    American Academy of Pediatrics Committee on Fetus and Newborn; American College of Obstetricians and Gynecologists Committee on Obstetric Practice. The Apgar Score. Pediatrics. 2015;136(4):819-22. [PubMed ID: 26416932]. https://doi.org/10.1542/peds.2015-2651.

  • 3.

    American Academy of Pediatrics; Committee on Fetus and Newborn; American College of Obstetricians and Gynecologists; Committee on Obstetric Practice. The Apgar Score. Adv Neonatal Care. 2006;6(4):220-3. https://doi.org/10.1016/j.adnc.2006.04.008.

  • 4.

    Rudiger M, Wauer RR, Schmidt K, Kuster H. The Apgar score. Pediatrics. 2006;118(3):1314-5. author reply 1315-6. [PubMed ID: 16951034]. https://doi.org/10.1542/peds.2006-1254.

  • 5.

    Rudiger M, Braun N, Gurth H, Bergert R, Dinger J. Preterm resuscitation I: clinical approaches to improve management in delivery room. Early Hum Dev. 2011;87(11):749-53. [PubMed ID: 21920678]. https://doi.org/10.1016/j.earlhumdev.2011.08.019.

  • 6.

    Rudiger M, Aguar M. Newborn Assessment in the Delivery Room. NeoReviews. 2012;13:e336-42. https://doi.org/10.1542/neo.13-6-e336.

  • 7.

    Talisman S, Guedalia J, Farkash R, Avitan T, Srebnik N, Kasirer Y, et al. NICU Admission for Term Neonates in a Large Single-Center Population: A Comprehensive Assessment of Risk Factors Using a Tandem Analysis Approach. J Clin Med. 2022;11(15). [PubMed ID: 35893346]. [PubMed Central ID: PMC9332268]. https://doi.org/10.3390/jcm11154258.

  • 8.

    Quinn CE, Sivasubramaniam P, Blevins M, Al Hajajra A, Znait AT, Khuri-Bulos N, et al. Risk factors for neonatal intensive care unit admission in Amman, Jordan. East Mediterr Health J. 2016;22(3):163-74. [PubMed ID: 27334073]. https://doi.org/10.26719/2016.22.3.163.

  • 9.

    White-Traut R, Pham T, Rankin K, Norr K, Shapiro N, Yoder J. Exploring factors related to oral feeding progression in premature infants. Adv Neonatal Care. 2013;13(4):288-94. [PubMed ID: 23912022]. [PubMed Central ID: PMC3804245]. https://doi.org/10.1097/ANC.0b013e31829d8c5a.

  • 10.

    Pepler PT, Uys DW, Nel DG. Predicting mortality and length-of-stay for neonatal admissions to private hospital neonatal intensive care units: a Southern African retrospective study. Afr Health Sci. 2012;12(2):166-73. [PubMed ID: 23056023]. [PubMed Central ID: PMC3462546]. https://doi.org/10.4314/ahs.v12i2.14.