Searching for Risk Factors and Establishing Predictive Models for Severe and Critical Hand-Foot-and-Mouth Disease

authors:

avatar Qi Dong 1 , 2 , avatar Nuoya Li 3 , avatar Mengjie Yu 4 , avatar Chunhui Zhu 1 , 2 , avatar Meiying Hu 1 , 2 , avatar Ruiqi Liu 5 , avatar Li Luo 1 , 2 , avatar Liang Hong 1 , 2 , avatar Shouhua Zhang 1 , 2 , avatar Qiang Tao 1 , 2 , * , avatar Qiang Chen 1 , 2 , **

The Affiliated Children's Hospital of Nanchang University, Nanchang, China
Jiangxi Provincial Children's Hospital, Nanchang, China
Department of General Surgery, Second Affiliated Hospital of Nanchang University, Nanchang, China
Key Laboratory of Drug Metabolism and Pharmacokinetics, China Pharmaceutical University, Nanjing, China
WenZhou Medical University, WenZhou, China
Corresponding Authors:

how to cite: Dong Q , Li N, Yu M, Zhu C, Hu M , et al. Searching for Risk Factors and Establishing Predictive Models for Severe and Critical Hand-Foot-and-Mouth Disease. Iran J Pediatr. 2021;31(5):e113250. https://doi.org/10.5812/ijp.113250.

Abstract

Objectives:

Severe and critical hand-foot-and-mouth disease (HFMD) patients have an acute onset and poor prognosis. This study intended to establish an appropriate risk prediction model by analyzing the blood biochemical indicators of patients.

Methods:

A total of 3,204 patients with HFMD were enrolled in this study, including 2,131 mild patients, 962 severe patients, and 111 critical patients. We first analyzed the data of each group through multivariate statistics based on SIMCA-P and screened out the variables that had important contributions to the discrimination of each group. Furthermore, the risk factors and predictors were screened out by comparison with the results of univariate statistical analysis. Finally, binary logistic regression analysis was used to establish a suitable prediction model.

Results:

With the aggravation of HFMD patients' conditions, the blood content and risk warning ability of seven indicators of SP, DP, NEUT%, TP, GLB, RBP, and Glu were significantly increased. We found for the first time that the more severe the HFMD patients, the lower the levels of Chr, %MRETIC, and %HRETIC in their blood. The average prediction accuracy of the established models for Mild/Severe, Severe/Critical, and Severe/Critical was 82.89, 96.16, and 89.37%, respectively, and the AUROC was 0.8722 (95%CI, 0.8583 - 0.8861), 0.9499 (95%CI, 0.9339 - 0.9659), and 0.7913 (95% CI, 0.7471 - 0.8356), respectively.

Conclusions:

Multivariate statistical analysis based on SIMCA-P could be used to analyze the clinical data of HFMD patients. Besides, SP, DP, NEUT%, TP, GLB, RBP, and Glu could be used as risk factors for severe and critical HFMD patients. The abnormal changes of Chr, %MRETIC, and %HRETIC reflected the possible damage to bone marrow hematopoietic function in HFMD patients. The predictive model established by us could be used for the differential diagnosis of Mild/Severe, Mild/Critical, and Severe/Critical.

1. Background

Hand-foot-and-mouth disease (HFMD) is an infectious disease in children that can be transmitted through contact, respiratory, and digestive tracts (1). It is mainly caused by enterovirus 71 and coxsackie A16 (2). Most patients with HFMD have mild symptoms and typically recover within 14 days without a secondary cutaneous infection (3). However, a few patients will have severe manifestations such as acute flaccid paralysis, aseptic meningitis, neurogenic pulmonary edema, and circulatory system failure, with poor prognosis (4, 5). The incidence of HFMD in China ranges from 37.01/100,000 to 205.06/100,000, and the mortality rate ranges from 6.46/100,000 to 51.00/100,000 (6). Children with severe or critical HFMD usually have no typical clinical manifestations in the early stages and can rapidly develop into severe or fatal disease in the short term. Therefore, identifying patients who are at high risk of developing severe and frequent disease is a key goal to the management of this disease.

According to the clinical test results, it was found that fever temperature, fever duration, age, blood glucose concentration, neutrophil count, and white blood cell count were related to the deterioration of HFMD patients (7-10). In addition, some researchers found that some cytokines were related to the severity of HFMD (11, 12), and some gene polymorphisms were related to the susceptibility and progression of severe HFMD (13, 14). Some prediction models related to the severity of HFMD had also been established through the machine learning algorithm (15), nomogram (16), and mortality risk score (17).

Although many studies have been conducted on HFMD patients with different degrees of illness, there are still scare studies on finding suitable risk factors and establishing prediction models.

2. Objectives

In this study, a retrospective case-control study was used to comprehensively analyze various blood test indicators of HFMD patients during admission, find risk factors for severe and critical HFMD patients, and establish an appropriate prediction model to guide clinical treatment, carry out early interventions, and improve the prognosis of patients.

3. Methods

3.1. Patients

In this study, patients with HFMD admitted to Jiangxi Children's Hospital from December 2015 to January 2020 were selected as the research subjects. The defined diagnosis of HFMD was based on the guidelines for the diagnosis and treatment of HFMD (version 2018) (6). A total of 3,204 patients were enrolled in this study, including 2,131 mild patients (mild), 962 severe patients (severe), and 111 critical patients (critical). All the data in this study are the original medical records of the subjects when they were admitted to the hospital. The test indices and grouping information of subjects were taken as independent variables and dependent variables, respectively. The basic information of the subjects and the results of various blood test indicators are shown in Table 1 and Appendix 1. This study was approved by the Ethics Committee of Jiangxi Children's Hospital (approval number: JXSETYY-YXKY-20200011).

Table 1.

Basic Information of Subjects

FactorsMildSevereCritical
Number2131962111
Male135963982
Female77232329
Age (y)1.79 ± 0.031.81 ± 0.031.89 ± 0.08
< 1.053312211
1.0 - 5.01540830100
> 5.058100

To ensure the integrity of data and the reliability of analysis results, the missing values of samples and variables included in this study were not more than 10%. In addition, the processing method for missing values in the data was as follows: A mode was used for interpolation for categorical variables, and a mean was used for interpolation for continuous variables.

3.2. Multivariate Statistical Analysis Based on SIMCA-P

All the data were imported into SIMCA-P (version 13, Umetrics, Umea, Sweden), and pre-treated by scaling with UV (Unit Variance Scaling) for multivariate statistical analysis. Non-supervisory principal component analysis (PCA) was used to preliminarily observe the distribution and clustering of data of each group and further detect and exclude abnormal samples (18). Suitable partial least Discrimination analysis (PLS-DA) and orthogonal least squares analysis (OPLS-DA) model were established to differentiate the data of each group (19, 20), and the S-plot score graph was used to screen the indicators that were most important to the differential diagnosis between the groups (21).

3.3. Univariate Analysis and Logistic Regression Analysis

To screen the variables with significant differences in each group, an independent t test or a nonparametric test (Mann-Whitney U test) was used where appropriate. A two-sided P < 0.05 was considered to be statistically significant. The receiver operating characteristic (ROC) was used to evaluate the differential diagnosis performance of variables with significant differences, and the potential risk factors were screened out by calculating the odds ratio (OR). To further establish an appropriate prediction model, the variables with statistical differences were subsequently analyzed by binary logistic regression analysis with the forward Wald method. The inclusion criterion of the selected variables was P < 0.05, and variables with P > 0.10 were eliminated. Before multivariate logistic regression analysis, we performed a normal distribution test on all continuous variables, performed logarithmic conversion for data that did not conform to normal distribution, and eliminated the data that still did not conform to the normal distribution after conversion.

All analyses were performed using SIMCA-P (version 12, Umetrics, Umea, Sweden) and SPSS23.0 (SPSS Inc., Chicago, IL, US). The heatmap was made using MetaboAnalyst 4.0, and the Venn diagram was made using Microsoft Excel 2016.

4. Results

4.1. Investigation of Overall Data Distribution (Multivariate Statistical Analysis)

The PCA score graph (Figure 1A) showed that the data of Mild, Severe, and Critical had obvious clustering. The PLD-DA score graph (Figure 1B) showed that the above three groups could be distinguished to a certain extent by the PLS-DA model, and the dataset represented by the more severe HFMD patients was also shifting to the lower right corner of the graph; that is, the overall change of data of each group could be better reflected by the score graph. The OPLS-DA model and S-plot score graphs were further used to conduct discriminative analysis on the data of each group, and the indicators with better discriminatory performance were selected, as shown in Figure 1C - H. As indicated, BASO#, BASO%, %MRETIC, CR, Temperature, CnTI, and %LRETIC had important contributions to distinguishing between mild and severe, and β-2MG, MONO%, LYMPH%, DBIL, SP, Mb, NEUT%, and Glu had important contributions to distinguishing between severe and critical.

Analysis of overall data distribution of Mild, Severe, and Critical. A, PCA score graph; B, PLD-DA score graph; C, OPLS-DA; and D, S-plot score graph for mild and severe cases; E, OPLS-DA; and F, S-plot score graph for mild and critical cases; G, OPLS-DA; and H, S-plot score graph for severe and critical cases.
Analysis of overall data distribution of Mild, Severe, and Critical. A, PCA score graph; B, PLD-DA score graph; C, OPLS-DA; and D, S-plot score graph for mild and severe cases; E, OPLS-DA; and F, S-plot score graph for mild and critical cases; G, OPLS-DA; and H, S-plot score graph for severe and critical cases.

4.2. Univariate Statistical Analysis

In terms of clinical manifestations, mild HFMD patients are generally in good condition, with only skin rash. Severe HFMD patients have nervous system damage, convulsions, headache, vomiting, and poor mental health. Critical HFMD patients have impaired cardiopulmonary function, increased heart rate and respiration, or brain failure and usually need ventilator-assisted breathing.

Univariate statistical analysis was carried out on each variable, and detailed results are shown in Appendices 2, 3, and 4. We found that there were 61, 49, and 22 variables with significant differences among the mild/severe, mild/critical, and severe/critical groups, respectively. Among them, 22 variables showed significant differences (Figure 2A). In addition, HFMD patients with more severe disease presented a regular increasing trend in SP, DP, NEUT%, TP, GLB, Mb, RBP, and Glu, while LYMPH#, LYMPH%, MONO#, MONO%, EO#, EO%, BASO#, BASO%, DBIL, β-2MG, CRP, K, and CHr showed a regular decreasing trend (Figure 2B), and NEUT# presented an irregular change trend.

Univariate statistical analysis. A, the Wayne diagram of the variables of difference between the groups; B, the heat map of the content changes of variables in each group. The more red means, the higher content, and the more blue means, the lower content.
Univariate statistical analysis. A, the Wayne diagram of the variables of difference between the groups; B, the heat map of the content changes of variables in each group. The more red means, the higher content, and the more blue means, the lower content.

In addition, compared with mild, 27 variables showed significant differences in both severe and critical but did not show significant differences between the two groups. It suggested that these substances might play a role in the progression of mild patients to severe patients, but they did not change significantly with the aggravation of severe patients' conditions. Compared with mild, the contents of temperature, RDW-SD, RDW-CV, ALB, TBIL, IDBL, 5-NT, LDH, CnTI, CR, IgG, IgM, and %LRETIC were higher in severe and critical, while the contents of WBC, MCH, MCHC, ALB/GLB, SAA, BUN/CR, Ca, Mg, Cl, P, RET#, RET%, %MRETIC, and %HRETIC were lower in severe and critical.

Multivariate logistic regression analysis was performed with the variables with statistical significance in univariate statistical analysis, and the OR value of each variable was calculated (OR > 1.0 was identified as the risk factor). The results showed that temperature, SP, DP, NEUT%, RBC, RDW-SD, P-LCR, MPV, PDW, RDW-CV, TP, ALB, GLB, TBIL, IDBL, 5-NT, CnTI, RBP, Glu, Cr, IgA, IgG, IgM, and %LRETIC were independent risk factors for the progression of Mild to Severe (Figure 3A). Temperature, SP, DP, NEUT#, NEUT%, RDW-SD, RDW-CV, TP, ALB, GLB, TBIL, IDBL, 5-NT, CnTI, RBP, Glu, CR, IgG, IgM, %LRETIC, and Mb were independent risk factors for the progression of Mild to Critical (Figure 3C). Besides, SP, DP, NEUT#, NEUT%, TP, GLB, RBP, Glu, and Mb were independent risk factors for the progression of Severe to Critical (Figure 3E).

Risk factors and ROC analysis of mild, severe, and critical. A, risk factors and ROC results of mild/severe; B, risk factors and ROC results of mild/critical; C, risk factors and ROC results of severe/critical.
Risk factors and ROC analysis of mild, severe, and critical. A, risk factors and ROC results of mild/severe; B, risk factors and ROC results of mild/critical; C, risk factors and ROC results of severe/critical.

Compared with Mild, the OR values of SP, DP, NEUT%, RDW-SD, RDW-CV, TP, ALB, GLB, CnTI, RBP, Glu, and %LRETIC of the 12 variables in severe and critical showed an increasing trend. In other words, with the aggravation of the disease, the risk warning abilities of the above indicators for the development of severe and critical patients were also increased. Further analyzing the changes of OR value and content of each variable, we found that with the aggravation of HFMD patients, compared with Mild, the content and risk warning ability of the seven variables of SP, DP, NEUT%, TP, GLB, RBP, and Glu in severe and critical were significantly increased.

To investigate the differential diagnosis performance of each variable between the groups, the ROC curve analysis was used to evaluate the variables with significant differences between the groups, as shown in Figure 3B, D and F. Temperature, BASO#, BASO%, CRP, SAA, CHr, %LRETIC, and %MRETIC had certain effects on distinguishing Mild from Sever (AUROC > 0.7). Temperature, NEUT%, MONO#, MONO%, EO#, EO%, BASO#, BASO%, CnTI, β-2MG, CRP, SAA, Glu, CHr, Glu, %LRETIC, and %MRETIC had certain effects on distinguishing mild from critical (AUROC > 0.7). Only Glu showed some effects for distinguishing severe from critical (AUROC > 0.7). On the whole, it was difficult to differentiate mild, severe, and critical by relying on a single index (AUROC < 0.80).

4.3. Establishment of Logistic Regression Prediction Model

To improve the ability of differential diagnosis and risk warning of HFMD patients in each group, binary logistic regression analysis was conducted in this study with statistically significant indicators in the univariate analysis as parameters, and an appropriate prediction model was established.

For mild/severe, the prediction equation was P = 1 / [1 + e (-18.876 + 0.971X1 - 24.528X2 - 0.005X3 - 0.155X4 - 0.084X5)] where X1, X2, X3, X4, and X5 were temperature, BASO#, SAA, Cl, and CHr, respectively, and P > 0.5 was identified as severe patients. Finally, the average predictive accuracy of the model for mild/severe was 82.89%, the false-positive rate was 9.43% (201/2131), the AUROC was 0.8722 (95%CI, 0.8583-0.8861), and the sensitivity and specificity were 73.70 and 85.83%, respectively (Figure 4A). Using the P value calculated by the model equation as the parameter to calculate the OR value, it was found that the OR value was 402.7963 (95% CI, 269.8202 - 601.3073). The above results indicated that the model could be used to distinguish mild from severe, and the above five variables were risk factors for Mild to progress to Severe, with a good early warning effect.

ROC results of each prediction model
ROC results of each prediction model

For mild/critical, the prediction equation was P = 1 / [1 + e (-49.429 + 1.356X1 - 1.438X2 + 0.465X3 - 0.066X4 - 0.183X5)], where X1, X2, X3, X4, and X5 were Temperature, β-2MG, Glu, CRP, and CHr, respectively, and P > 0.5 was identified as critical patients. Finally, the average predictive accuracy of the model for mild/critical was 96.16%, the false-positive rate was 0.75% (16/2131), the AUROC was 0.9499 (95% CI, 0.9339 - 0.9659), and the sensitivity and specificity were 93.69 and 83.25%, respectively (Figure 4B). Using the P value calculated by the model equation as the parameter to calculate the OR value, it was found that the OR value was 402.7963 (95% CI, 269.8202 - 601.3073). The above results indicated that the model could be used to distinguish mild from critical, and the above five variables were risk factors for mild to progress to critical, with a good early warning effect.

For severe/critical, the prediction equation was P = 1 / [1 + e (-8.903 + 0.037X1 + 0.037X2 + 0.044X3 + 0.541X4 - 0.080X5)], where X1, X2, X3, X4, and X5 were DP, NEUT%, RBP, Glu, and CHr, respectively, and P > 0.5 was identified as critical patients. Finally, the average predictive accuracy of the model for Severe/Critical was 89.37%, the false-positive rate was 1.14% (11/962), the AUROC was 0.7913 (95% CI, 0.7471 - 0.8356), and the sensitivity and specificity were 81.08 and 65.28%, respectively (Figure 4C). Using the P value calculated by the model equation as the parameter to calculate the OR value, it was found that the OR value was 929.4721 (95% CI, 210.7578 - 4099.1052). The above results indicated that the model could be used to distinguish severe from critical, and the above five variables were risk factors for severe to progress to critical, with a good early warning effect.

5. Discussion

As the disease progresses rapidly and the boundaries of disease stages are blurred, severe HFMD patients are often faced with the risk of poor nursing quality and poor prognosis (22). Therefore, it is particularly important to identify severe HFMD in the early stage to provide effective intervention measures. In this study, we analyzed the clinical blood test indicators of HFMD patients for the first time through multivariate statistical analysis based on SIMCA-P and compared the results with univariate statistical analysis. The results showed that the AUROC of the variables selected by the OPLS-DA model was significantly better than other variables with a low contribution to univariate statistical analysis.

Compared with traditional univariate statistical analysis, multivariate statistical analysis based on SIMCA-P has the following advantages: (1) PCA, PLS-DA, and OPLS-DA models have been widely applied in statistical analysis of various clinical data (23-25). The models are stable and have a good fitting degree and prediction accuracy for the original data; (2) simple operation and a high degree of visualization, which can not only accurately reflect the integrity of data but also screen out single variables with good discrimination effect; (3) with good data inclusion, it is not necessary to eliminate the variables with no statistical difference, and the analysis is not affected by the multiple correlations between variables, which is more conducive to the construction of network relationships between variables.

Comprehensive analysis of the changes of the content and OR value of each indicator showed that the more severe the HFMD patients were, the higher the content and risk warning ability of seven indicators, including SP, DP, NEUT%, TP, GLB, RBP, and Glu, were in their blood. Peng et al. found that in patients with severe HFMD, hyperglycemia, hypertension, and tachycardia were the risk factors of neurogenic pulmonary edema (26). As known, HFMD is an infectious disease. With the aggravation of the patient's condition, NEUT%, TP, GLB, RBP, and other indicators related to disease infection might rise. Fang et al. also found that an increased neutrophil count and EV71 infection were the risk factors of severe HFMD (27). Therefore, we could ensure that SP, DP, NEUT%, TP, GLB, RBP, and GLU could be used as risk factors for severe and critical HFMD, and played an important role in suggesting the disease changes in patients with HFMD.

In addition, this study found for the first time that CHr, %MRETIC, %HRETIC, etc., were different in HFMD patients of different disease degrees. Moreover, the more severe the HFMD patients were, the lower the levels of CHr, %MRETIC, and %HRETIC were in their blood. Therefore, we speculated that HFMD might affect the hematopoietic function of bone marrow in patients, but the specific mechanism still needs further studies.

5.1. Limitations

Although this study had done some work to explore the risk factors and prediction model of HFMD, there were still many limitations. First, our study was a retrospective cohort study, and the lack of data on the type of virus that caused HFMD might lead to bias and limited clinical practice. Second, this was a single-center study conducted in Jiangxi, China, and we were not sure whether our results would be well replicated in other regions and populations. Finally, some indicators not commonly used in clinical tests (such as CHr, %MRETIC, etc.) were included in the model establishment of this study, so the established model might have some difficulties in clinical application.

References

  • 1.

    Qin L, Dang D, Wang X, Zhang R, Feng H, Ren J, et al. Identification of immune and metabolic predictors of severe hand-foot-mouth disease. PLoS One. 2019;14(5). e0216993. [PubMed ID: 31120941]. [PubMed Central ID: PMC6532886]. https://doi.org/10.1371/journal.pone.0216993.

  • 2.

    Stock I. [Hand, foot and mouth disease--more than a harmless "childhood disease"]. Med Monatsschr Pharm. 2014;37(1):4-10. quiz 11-2. German. [PubMed ID: 24490433].

  • 3.

    Ni XF, Li X, Xu C, Xiong Q, Xie BY, Wang LH, et al. Risk factors for death from hand-foot-mouth disease: A meta-analysis. Epidemiol Infect. 2020;148. e44. [PubMed ID: 32102711]. [PubMed Central ID: PMC7058831]. https://doi.org/10.1017/S0950268819002279.

  • 4.

    Xu W, Liu CF, Yan L, Li JJ, Wang LJ, Qi Y, et al. Distribution of enteroviruses in hospitalized children with hand, foot and mouth disease and relationship between pathogens and nervous system complications. Virol J. 2012;9:8. [PubMed ID: 22230340]. [PubMed Central ID: PMC3268717]. https://doi.org/10.1186/1743-422X-9-8.

  • 5.

    Xing W, Liao Q, Viboud C, Zhang J, Sun J, Wu JT, et al. Hand, foot, and mouth disease in China, 2008-12: An epidemiological study. Lancet Infect Dis. 2014;14(4):308-18. [PubMed ID: 24485991]. [PubMed Central ID: PMC4035015]. https://doi.org/10.1016/S1473-3099(13)70342-6.

  • 6.

    Li X, Ni X, Qian S, Wang Q, Jiang R, Xu W, et al. Chinese guidelines for the diagnosis and treatment of hand, foot and mouth disease (2018 edition). World J Pediatr. 2018;14(5):437-47.

  • 7.

    Suzuki Y, Taya K, Nakashima K, Ohyama T, Kobayashi JM, Ohkusa Y, et al. Risk factors for severe hand foot and mouth disease. Pediatr Int. 2010;52(2):203-7. [PubMed ID: 19663940]. https://doi.org/10.1111/j.1442-200X.2009.02937.x.

  • 8.

    Yang T, Xu G, Dong H, Ye M, He T. A case-control study of risk factors for severe hand-foot-mouth disease among children in Ningbo, China, 2010-2011. Eur J Pediatr. 2012;171(9):1359-64. [PubMed ID: 22527564]. https://doi.org/10.1007/s00431-012-1731-7.

  • 9.

    Zheng G, Cao J, Yu J, Zhang Z, Liu Q, Chen J. Risk factors for death in children with critical and severe hand-foot-and-mouth disease in Chongqing, China: An observational study. Medicine (Baltimore). 2017;96(49). e8934. [PubMed ID: 29245260]. [PubMed Central ID: PMC5728875]. https://doi.org/10.1097/MD.0000000000008934.

  • 10.

    Song C, Yibing C, Guo Y, Jin Z, Cui Y, Gu X. Risk factors of severe hand, foot and mouth disease complicated with cardiopulmonary collapse. Infect Dis (Lond). 2015;47(7):453-7. [PubMed ID: 25712793]. https://doi.org/10.3109/23744235.2015.1015051.

  • 11.

    Sun JF, Li HL, Sun BX. Correlation analysis on serum inflammatory cytokine level and neurogenic pulmonary edema for children with severe hand-foot-mouth disease. Eur J Med Res. 2018;23(1):21. [PubMed ID: 29724230]. [PubMed Central ID: PMC5934863]. https://doi.org/10.1186/s40001-018-0313-1.

  • 12.

    Zhang Y, Liu H, Wang L, Yang F, Hu Y, Ren X, et al. Comparative study of the cytokine/chemokine response in children with differing disease severity in enterovirus 71-induced hand, foot, and mouth disease. PLoS One. 2013;8(6). e67430. [PubMed ID: 23840697]. [PubMed Central ID: PMC3696071]. https://doi.org/10.1371/journal.pone.0067430.

  • 13.

    Cai Y, Chen Q, Zhou W, Chu C, Ji W, Ding Y, et al. Association analysis of polymorphisms in OAS1 with susceptibility and severity of hand, foot and mouth disease. Int J Immunogenet. 2014;41(5):384-92. [PubMed ID: 25059424]. https://doi.org/10.1111/iji.12134.

  • 14.

    Tan Y, Yang T, Liu P, Chen L, Tian Q, Guo Y, et al. Association of the OAS3 rs1859330 G/A genetic polymorphism with severity of enterovirus-71 infection in Chinese Han children. Arch Virol. 2017;162(8):2305-13. [PubMed ID: 28444539]. https://doi.org/10.1007/s00705-017-3381-6.

  • 15.

    Liu G, Xu Y, Wang X, Zhuang X, Liang H, Xi Y, et al. Developing a Machine Learning System for Identification of Severe Hand, Foot, and Mouth Disease from Electronic Medical Record Data. Sci Rep. 2017;7(1):16341. [PubMed ID: 29180702]. [PubMed Central ID: PMC5703994]. https://doi.org/10.1038/s41598-017-16521-z.

  • 16.

    Wang B, Feng H, Huang P, Dang D, Zhao J, Yi J, et al. Developing a Nomogram for Risk Prediction of Severe Hand-Foot-and-Mouth Disease in Children. Indian J Pediatr. 2019;86(4):365-70. [PubMed ID: 30798415]. https://doi.org/10.1007/s12098-019-02898-4.

  • 17.

    Qiu J, Lu X, Liu X, Zang P, Zhao W, Liu P, et al. Derivation and Validation of a Mortality Risk Score for Severe Hand, Foot and Mouth Disease in China. Sci Rep. 2017;7(1):3371. [PubMed ID: 28611398]. [PubMed Central ID: PMC5469765]. https://doi.org/10.1038/s41598-017-02658-4.

  • 18.

    Eriksson L, Andersson PL, Johansson E, Tysklind M. Megavariate analysis of environmental QSAR data. Part I--a basic framework founded on principal component analysis (PCA), partial least squares (PLS), and statistical molecular design (SMD). Mol Divers. 2006;10(2):169-86. [PubMed ID: 16770514]. https://doi.org/10.1007/s11030-006-9024-6.

  • 19.

    Rodriguez-Perez R, Fernandez L, Marco S. Overoptimism in cross-validation when using partial least squares-discriminant analysis for omics data: a systematic study. Anal Bioanal Chem. 2018;410(23):5981-92. [PubMed ID: 29959482]. https://doi.org/10.1007/s00216-018-1217-1.

  • 20.

    Boccard J, Rutledge DN. A consensus orthogonal partial least squares discriminant analysis (OPLS-DA) strategy for multiblock Omics data fusion. Anal Chim Acta. 2013;769:30-9. [PubMed ID: 23498118]. https://doi.org/10.1016/j.aca.2013.01.022.

  • 21.

    Consonni R, Cagliani LR, Cogliati C. NMR characterization of saccharides in Italian honeys of different floral sources. J Agric Food Chem. 2012;60(18):4526-34. [PubMed ID: 22509771]. https://doi.org/10.1021/jf3008713.

  • 22.

    Chang LY, Lin TY, Hsu KH, Huang YC, Lin KL, Hsueh C, et al. Clinical features and risk factors of pulmonary oedema after enterovirus-71-related hand, foot, and mouth disease. Lancet. 1999;354(9191):1682-6. [PubMed ID: 10568570]. https://doi.org/10.1016/S0140-6736(99)04434-7.

  • 23.

    Casadei-Gardini A, Del Coco L, Marisi G, Conti F, Rovesti G, Ulivi P, et al. (1)H-NMR Based Serum Metabolomics Highlights Different Specific Biomarkers between Early and Advanced Hepatocellular Carcinoma Stages. Cancers (Basel). 2020;12(1). [PubMed ID: 31963766]. [PubMed Central ID: PMC7016798]. https://doi.org/10.3390/cancers12010241.

  • 24.

    Liu S, Huang Z, Zhang Q, Fu Y, Cheng L, Liu BF, et al. Profiling of isomer-specific IgG N-glycosylation in cohort of Chinese colorectal cancer patients. Biochim Biophys Acta Gen Subj. 2020;1864(3):129510. [PubMed ID: 31887339]. https://doi.org/10.1016/j.bbagen.2019.129510.

  • 25.

    Seo JW, Han K, Lee J, Kim EK, Moon HJ, Yoon JH, et al. Application of metabolomics in prediction of lymph node metastasis in papillary thyroid carcinoma. PLoS One. 2018;13(3). e0193883. [PubMed ID: 29509799]. [PubMed Central ID: PMC5839571]. https://doi.org/10.1371/journal.pone.0193883.

  • 26.

    Peng L, Luo R, Jiang Z. Risk factors for neurogenic pulmonary edema in patients with severe hand, foot, and mouth disease: A meta-analysis. Int J Infect Dis. 2017;65:37-43. [PubMed ID: 28970089]. https://doi.org/10.1016/j.ijid.2017.09.020.

  • 27.

    Fang Y, Wang S, Zhang L, Guo Z, Huang Z, Tu C, et al. Risk factors of severe hand, foot and mouth disease: a meta-analysis. Scand J Infect Dis. 2014;46(7):515-22. [PubMed ID: 24832848]. https://doi.org/10.3109/00365548.2014.907929.