ARTICLE AUTHORS
ARTICLE INFO
academic journalism

Comparison of Machine Learning Tools for the Prediction of ICU Admission in COVID-19 Hospitalized Patients

AUTHORS

avatar Mostafa Shanbehzadeh ORCID 1 , avatar Hamideh Haghiri 2 , avatar Mohammad Reza Afrash ORCID 3 , avatar Morteza Amraei 4 , avatar Leila Erfannia ORCID 5 , avatar Hadi Kazemi-Arpanahi 6 , 7 , *

1 Department of Health Information Technology, Faculty of Paramedical, Ilam University of Medical Sciences, Ilam, Iran

2 Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran

3 Student Research Committee, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran

4 Department of Health Information Technology, School of Allied Medical Sciences, Lorestan University of Medical Sciences, Khorramabad, Iran

5 Department of Health Information Management, School of Management and Medical Informatics, Health Human Resources Research Center, Shiraz University of Medical Sciences, Shiraz, Iran

6 Department of Health Information Technology, Abadan University of Medical Sciences, Abadan, Iran

7 Student Research Committee, Abadan Faculty of Medical Sciences, Abadan, Iran

How to Cite: Shanbehzadeh M, Haghiri H, Afrash M R, Amraei M, Erfannia L, et al. Comparison of Machine Learning Tools for the Prediction of ICU Admission in COVID-19 Hospitalized Patients. Shiraz E-Med J. 2022;23(5):e117849.
doi: 10.5812/semj.117849.

ARTICLE INFORMATION

Shiraz E-Medical Journal: 23 (5); e117849
Published Online: February 5, 2022
Article Type: Research Article
Received: July 12, 2021
Revised: November 7, 2021
Accepted: December 16, 2021
DOI: 10.5812/semj.117849
Crossmark
Crossmark
CHECKING
READ FULL TEXT

Abstract

Background:

The rapid coronavirus disease 2019 (COVID-19) outbreak has overwhelmed many healthcare systems worldwide and put them at the edge of collapsing. As the capacity of intensive care units (ICUs) is limited, deciding on the proper allocation of required resources is crucial.

Objectives:

This study aimed to create a machine learning (ML)-based predictive model of ICU admission among COVID-19 in-hospital patients at the initial presentation.

Methods:

This retrospective study was conducted on 1225 laboratory-confirmed COVID-19 hospitalized patients during January 9, 2020 - January 20, 2021. The top clinical parameters contributing to COVID-19 ICU admission were identified based on a correlation coefficient at P-value < 0.05. Next, the predictive models were constructed using five ML algorithms. Finally, to evaluate the performances of models, the metrics derived from the confusion matrix, classification error, and receiver operating characteristic were calculated.

Results:

Following feature selection, a total of 11 parameters were selected as the top predictors to build the prediction models. The results showed that the best performance belonged to the random forest (RF) algorithm with the mean accuracy of 99.5%, mean specificity of 99.7%, mean sensitivity of 99.4%, Kappa metric of 95.7%, and root mean squared error of 0.015.

Conclusions:

The ML algorithms, particularly RF, enable a reasonable level of accuracy and certainty in predicting disease progression and ICU admission for COVID-19 patients. The proposed models have the potential to inform frontline clinicians and health authorities with quantitative tools to assess illness severity and optimize resource allocation under time-sensitive and resource-constrained situations.

1. Background

Since December 2019, the coronavirus disease 2019 (COVID-19) has been spreading aggressively worldwide, and the health systems have encountered an increasing shortage of critical care resources, such as personal protective equipment, intensive care unit (ICU) beds, and ventilators (1). So far, this virus has affected almost all countries, with more than two million deaths worldwide (2). Approximately 20% of COVID-19 patients need hospitalization, and 20%-30% of COVID-19 in-hospital patients are admitted to ICU (3). In Iran, the ICU admission rate is estimated to be 32% of hospitalized patients, and the ICU death rate is about 39% (4). The ICU resources are currently restricted, and more than 50% of ICU beds are occupied under normal conditions (5).

The unexpected outbreak, rapid transmission, ambiguous disease course, and prognosis, as well as emerging new mutations of COVID-19, along with health systems being not prepared for large-scale epidemic responses, created a situation in which the management of intensive care resources is crucial (6). Under this condition, it is urgent to construct and test effective clinical risk prediction tools for appropriately triaging critical patients (7, 8). Accordingly, predicting the individual disease courses and outcomes is essential for triaging patients, customized care service provision, utilizing life-saving resources in the best possible way, and directing them toward vulnerable and at-risk sub-groups deteriorating to critical COVID-19. Furthermore, many problems resulting from the shortage of hospital resources can be overcome by predicting the risk of patient deterioration, determining the length of stay, using hospital resources efficiently, and managing bed turnover (9, 10).

Innovative approaches for the early identification and triaging of patients at the time of admission will be greatly beneficial and effective in estimating which patients are at the high risk of clinical deterioration and have poor outcomes requiring ICU admission (8, 9). In such conditions, the design and implementation of clinical decision support systems equipped with machine learning (ML)-based prediction models will be critical for the optimal use of limited hospital resources and supporting clinical decisions. The ML, as a sub-form of artificial intelligence technologies, provides new insight or knowledge through extracting functional patterns and applicable rules from the large raw datasets (7, 10).

In the previous researches, a large number of ML algorithms were trained for the prediction of COVID-19 disease progression, patient condition deterioration (9, 10), ICU hospitalization (8, 9, 11-13), and death (8, 11, 14-19).

2. Objectives

The present study aimed to develop and validate a data-driven framework using five ML techniques to predict the patients who need transfer to ICU and find out the contributing clinical predictors by analyzing the available data at the time of admission.

3. Methods

This retrospective single-center cross-sectional study was conducted in 2021 to predict admission to ICU based on selected data-driven ML techniques.

3.1. Dataset and Participants

In this study, a COVID-19 hospital-based registry database from Taleghani Hospital, Abadan, Iran, was reviewed retrospectively. Only hospitalized confirmed COVID-19 patients aged ≥18 years and admitted during January 9, 2020 - January 20, 2021, met our inclusion criteria. During this period, a total of 13885 suspected cases with COVID-19 were referred to Taleghani Hospital, 3350 of which were confirmed as COVID-19 by RT-PCR test. The exclusion criteria entailed non-COVID-19 cases, non-hospitalized COVID-19 patients, cases with unknown disposition, patients under 18 years old, incomplete case records (missing more than 70%), and admission time before January 9, 2020, or after January 20, 2021. Following applying the exclusion criteria, finally, 1225 records were entered in the study (Figure 1).

Flowchart describing patient selection
Figure 1. Flowchart describing patient selection

3.2. Feature Selection

Feature selection is an effective technique for determining the most significant variables, reducing the dimensions of the dataset, and improving the efficiency of ML algorithms (20). The included cases are defined based on 53 primary risk factors. In the current study, the variables with a correlation coefficient value less than 0.05 (P-value < 0.05) were identified as influential risk factors in predicting ICU admission.

3.3. Model Development

To predict ICU admission for COVID-19 patients, several ML classification algorithms, including Artificial Neural Network (ANN), K-Nearest Neighbor (KNN), Support Vector Machine (SVM), Decision Tree (DT), and Random Forest (RF), were used. We applied a set of parameters as shown in Table 1.

Table 1. Parameters for ML Algorithms
ModelParameters
KNNK = 1, 3, 5
SVMKernel function = Gaussian
RF-
DT-
ANN57-10-5-2

3.4. Study Roadmap and Experiment Environment

All experiments on the classification algorithms described in this study were implemented using Python version 3.7.7. The Python experiment environment offers a well-defined framework for researchers and developers to run and assess their ML models. The roadmap of the proposed prediction model in this work is depicted in Figure 2.

Block diagram of the proposed system for predicting ICU admission in patients with COVID-19
Figure 2. Block diagram of the proposed system for predicting ICU admission in patients with COVID-19

3.5. Preprocessing

In the preprocessing stage, in order to use the data effectively in classifiers, raw data input was performed utilizing several preprocessing techniques, such as deleting missing values (missing more than 70%), minimum and maximum scalar values, and standard scalar.

3.6. Experiment Evaluation

In this study, the performance of ML algorithms was calculated based on the 10-fold cross-validation method. To better compare the performance of algorithms, we assessed the effectiveness of five ML algorithms in terms of accuracy, specificity, sensitivity, error rate (Equations 1-4), receiver operating characteristic (ROC) curve, time to build the model, correctly classified instances, incorrectly classified instances, Kappa statistic, mean absolute error (MAE), root mean squared error (RMSE), relative absolute error, and root relative squared error (RRSE).

Classification accuracy=TP +TNTP+TN+ FP+FN ×100
Classification sensitivity=TPTP+FN ×100
Classification specificity=TNTN+FP ×100
Classification error=FP+FNTP+TN+FP+FN ×100

3.7. Ethical Considerations

The present study was approved by the Ethics Committee of Abadan University of Medical Sciences (Ethics code: IR.ABADANUMS.REC.1400.054). In order to protect the privacy and confidentiality of patients, we concealed the unique identification information of all patients in the process of data collection and presentation.

4. Results

4.1. Demographic and Clinical Characteristics

After applying the exclusion criteria, a total of 1225 patients were eligible (Figure 1). Of 1225 hospitalized COVID-19 cases, 664 (54.2%) were male, and 561 (45.8%) were women. Moreover, the median age of participants was 57.25 years (interquartile 18 - 100 years). We observed that 170 (13.87%) individuals were hospitalized in the ICU, and 1055 (86.13%) cases were hospitalized in general wards. Among the eligible patients, 1136 (92.75%) recovered, and 89 (7.25%) were deceased. Descriptive statistics for the 1225 records in this dataset are summarized in Table 2.

Table 2. Descriptive Statistics of the Study Variables After Preprocessing a
VariablesValues
Qualitative
Blood type
A-, A+17, 552
B-, B+13, 126
O-, O+29, 421
AB-, AB+6, 61
Gender
Male664
Female561
Cough
Yes958
No267
Contusion
Yes409
No816
Nausea
Yes401
No824
Vomit
Yes346
No879
Headache
Yes312
No913
Gastrointestinal symptoms
Yes252
No973
Muscular pain
Yes623
No602
Chill
Yes591
No634
Fever
Yes628
No597
Pneumonia
Yes1044
No181
Oxygen therapy
Yes1053
No172
Dyspnea
Yes1078
No147
Loss of taste
Yes272
No953
Loss of smell
Yes305
No920
Runny noise
Yes437
No788
Sore throat
Yes444
No781
Other underlying diseases
Yes735
No490
Cardiac disease
Yes306
No919
Hypertension
Yes395
No830
Diabetes
Yes268
No957
Smoking
Yes41
No1184
Alcohol addiction
Yes11
No1214
C-Reactive protein
Positive1063
Negative162
Hypersensitive troponin
Positive58
Negative1167
ICU admission (outcome)
Yes1055
No170
Quantitative
Age (y)57.25 ± 17.8 (18 – 100)
Height 168.53 ± 8.5 (92 - 195)
Weight 75.20 ± 13 (6.5 - 163)
Creatinine 1.39 ± 1.4 (0.1 - 17.9)
Red cell count 4.56 ± 0.9 (1.38 - 13.1)
White cell count8182.34 ± 4897.4 (1300 - 63000)
Hematocrit39.20 ± 6.7 (3.6 - 73.9)
Hemoglobin13.21 ± 2.4 (3.7 - 46)
Platelet count215493.66 ± 88380.1 (108000 - 691000)
Absolute lymphocyte count 23.74 ± 11.8 (2 - 95)
Absolute neutrophil count74.52 ± 12.3 (8 - 98)
Calcium9.68 ± 0.8 (0.9 - 14.1)
Phosphorus3.5 ± 0.5 (2 - 12.4)
Magnesium2.16 ± 0.6 (1.14 - 19.1)
Sodium137.94 ± 5.3 (37 - 157)
Potassium3.98 ± 0.7 (2.5 - 14.2)
Blood urea nitrogen42.52 ± 31.7 (0.5 - 251)
Total bilirubin0.72 ± 0.7 (0.01 - 10)
Aspartate aminotransferase44.45 ± 53.5 (3.8 - 924)
Alanine aminotransferase38.29 ± 41.6 (2 - 672)
Albumin4.02 ± 0.5 (0.2 - 8.9)
Glucose136.09 ± 74.2 (18 - 994)
Lactate dehydrogenase555.68 ± 339 (4.6 - 6973)
Activated partial thromboplastin time28.56 ± 11.4 (1 - 120)
Prothrombin time12.82 ± 1.9 (0.9 - 46.8)
Alkaline phosphatase213.12 ± 139.2 (9.6 - 2846)
Erythrocyte sedimentation rate 40.65 ± 28.8 (2 - 258)

a Values are expressed as No. (%) or mean ± SD (range).

4.2. Top Predictors of ICU Admission

The most important predictors affecting ICU admission and disease progression were determined using the correlation coefficient at P-value < 0.05. As shown in Table 3, the top 11 ICU admission predictors were age, white cell count, neutrophil count, and lymphocyte count, blood urea nitrogen (BUN), aspartate transaminase (AST)/alanine transaminase (ALT), lactate dehydrogenase (LDH), cough, dyspnea, and oxygen therapy.

Table 3. Key Diagnostic Criteria at P-Value < 0.05
VariablesPearson’s CorrelationP-ValueVariablesPearson’s CorrelationP-Value
Age-0.045*0.019Blood type-0.0251280.274
Height-0.240.409Gender-0.1070.38
Weight-0.250.388Cough0.299*0.041417
Temperature-0.320.268Contusion-0.1220.342
Creatinine-0.0660.119Hypertension -0.17443780.0541
Red cell count0.0290.315Cardiovascular 0.27465940.125
White cell count-0.054*0.047Alcohol consumption 0.79234690.218
Hematocrit-0.0170.562Smoking 0.31231460.354
Hemoglobin-0.10.724Diabetes 0.09807160.104
Platelet count0.0180.532Other underline disorders 0.09047620.465
Absolute lymphocyte count-0.057*0.044Sore throat 0.05911510.64
Absolute neutrophil count0.061*0.033Runny noise -0.14468460.253
Calcium-0.0550.055Loss of smell 0.03351750.811
Phosphorus-0.020.476Loss of taste -0.11925580.414
Magnesium-0.0330.243Dyspnea 0.4443414*0.017
Sodium-0.0150.59Oxygen therapy 0.460136*0.008
Potassium0.0150.607Pneumonia 0.26909360.115
Bun-0.059*0.038Fever 0.02417340.842
Total bilirubin-0.0030.915Chill 0.02698470.824
Asp0.054*0.033Muscular pain 0.08854380.466
Alt0.047*0.027GI complications -0.201810.179
Albumin0.0240.394Headache -0.02974490.831
Glucose0.0170.552Vomit 0.05257880.696
Ldh0.056*0.049Nausea0.00831050.949
Activated partial thromboplastin time-0.0360.213 ESR0.040.157
Prothrombin time0.010.714Hyper sensitive troponin -0.21468460.439
Alkaline phosphatase-0.0030.929C-reactive protein 0.02587880.196

4.3. Model Development

In this study, to construct the ICU admission prediction model, we used five classification algorithms, namely ANN, KNN, SVM, DT, and RF, with k-fold (k = 10) cross-validation methods. The mean metrics of 10-fold cross-validation methods were measured. Table 4 shows the 10-fold cross-validation results of five classifiers.

Table 4. Average Performance of Ten Independent Runs of Classifiers Based on 10-Fold Cross-validation
Evaluation CriteriaClassifier
ANNDTKNNSVMRF
Best time to build a model (s)3822271431
Correctly classified instances1,7471,6541,7831,6371,885
Incorrectly classified instances14824111225810
Mean accuracy (%)92.287.394.186.499.5
Mean specificity (%)96.885.488.787.599.7
Mean sensitivity (%)87.689.399.585.399.4

4.4. ANN Configuration

In this structure, according to Table 5, the input data consisted of 57 variables, two hidden layers with ten and five neurons, and two outputs (configuration: 57-10-5-2).

Table 5. ANN Configuration
ModelParametersValues
ANNGrid weightsRandom (between 1 and -1)
Network errorAccording to MSE
Training ratio0.7
Validation ratio0.15
Test ratio0.15
OptimizationUsing Trainlm, which is a network training function that updates weight and bias values according to Levenberg-Marquardt optimization
Maximum epochs1000
Maximum training timeInf
Performance goal0
Minimum gradient min_grad: 1e-07
Maximum validation checks max_fail: 6
Mu 0.001
Mu decrease ratio mu_dec: 0.1
Mu increase ratio mu_inc: 10
Maximum mu mu_max: 10000000000

According to the experimental results of evaluating selected ML models in 10-iterations, the KNN algorithm (with K = 5) had 94.1% accuracy, 88.7% specificity, and 99.5% sensitivity. After running ANN, the algorithm achieved an accuracy of 92.2%, a specificity of 96.8%, and a sensitivity of 87.6%. The RF algorithm showed high performance with 99.5% accuracy, 99.7% specificity, and 99.4% sensitivity. The SVM algorithm had 87.5%, 85.3%, and 86.4% specificity, sensitivity, and accuracy, respectively. Furthermore, the DT algorithm demonstrated 87.3% accuracy, 85.4% specificity, and 89.3% sensitivity. Based on the analysis of variance, the five selected algorithms were significantly different (P < 0.05). The error rate of classifiers and computation time of implemented models on the given dataset are shown in Figure 3.

Error rate of the classifiers on the given dataset
Figure 3. Error rate of the classifiers on the given dataset

The results obtained for the error rate of selected classifiers revealed that the RF algorithm had the highest Kappa metric of 95.7%. In addition, it has the lowest MAE (0.02), RMSE (0.015), and RRSE (22%). The results of comparing confusion matrix metrics and area under the curve (AUC)-ROC of different classifiers are shown in Figures 4 and 5.

The ROC curve chart of the selected ML algorithms
Figure 4. The ROC curve chart of the selected ML algorithms
Confusion matrix calculation for the selected ML algorithms
Figure 5. Confusion matrix calculation for the selected ML algorithms

According to Figures 4 and 5, the RF algorithm was the best classifier for predicting ICU admission based on evaluation criteria. The SVM algorithm has the best computation time of processing with 14 s. The results for ten independent runs of RF are summarized in Table 6.

Table 6. Performance of RF in Ten Independent Runs
RunAccuracySpecificitySensitivity
199.142599.581799.77514
299.214199.45899.8541
399.323699.674599.75114
499.245199.854299.347
599.617399.584199.471
699.65799.3741499.3445
799.423599.33599.5457
899.74199.42199.247
999.235199.952499.741
1099.54199.354199.8242
Std99.4140299.5589199.59008
Min0.2123690.213950.226258
Max99.142599.33599.247
Mean99.74199.952499.8541

5. Discussion

Given the heterogeneity of the clinical manifestations of COVID-19, it is critical to develop models for predicting the likelihood of ICU admission by ML techniques. This study created five ML-based models using the most relevant variables in determining the risk of ICU admission derived from a correlation coefficient analysis. The techniques used herein included ANN, DT, KNN, SVM, and RF, which were trained through the most significant predictors from 1225 laboratory-confirmed COVID-19 patients at the time of admission. Finally, based on our analysis of selected algorithms, we found that RF with a mean accuracy of 99.5%, a mean specificity of 99.7%, and a mean sensitivity of 99.4% have better performance than other ML algorithms in predicting the probability of ICU transfer after hospital admission.

In the ICU, the need for informed decision-making is critical, especially in crisis circumstances, such as the current COVID-19 pandemic, where the healthcare systems encountered an increasing surge of patients and severe shortage in hospital resources (21, 22). The models developed in this study could be simply computerized as an alternative to manual and subjective clinical assessment methods. To correctly extract clinical predictors for estimating the potential need for ICU services, we evaluated clinical features at the time of admission and not at the progressive/severe course of the disease. In addition, the critical patients at admission time were discarded from the analysis. Thus, if validated, these features could be applied for predicting the likelihood to enter in ICU at the first hospitalization. For this purpose, Feature selection is a significant step to prepare the data before entering into the model (23). Hence, we identified the most important variables (n = 11) through correlation coefficient at P-value < 0.05. The most significant predictors of ICU admission were older age, high creatinine, leukocytosis, increased BUN, elevated ASP/ALT, augmented LDH, dry cough, hypertension, cardiovascular disorders, diabetes, dyspnea, decreased SPO2, pneumonia, and high C-reactive protein.

Many studies have focused on determining the key risk factors for ICU admission (8, 9, 11, 13, 24, 25). The ten top clinical variables predicting ICU risk in reviewed studies encompassed age (older age), body temperature (high), oxygen saturation (decreased), neutrophil count and lymphocyte count (raised), C-reactive protein (elevated), D-dimer (increased), ALT and/or AST (augmented), LDH (elevated), loss of consciousness, and hypertension/cardiovascular diseases. In general, high compliance was observed between the results of reviewed studies and the most common variables in the current study.

In general, the developed ML algorithms in this study, similar to those reported in the previous studies (26), have achieved optimum results with an accuracy range of 86.4% - 90.37%. In particular, the experimental findings showed that RF had the best performance compared to the other four ML techniques with the mean accuracy of 99.5%, mean specificity of 99.7%, mean sensitivity of 99.4%, Kappa metric of 95.7%, and RMSE of 0.015. According to the results of the previous studies, the ANN and RF techniques have the most remarkable performance in predicting COVID-19 outcomes, which is consistent with the present study.

As a screening instrument for the development of severe disease, model developed in our study has several opportunities for clinical use. These models decrease the existing uncertainty and ambiguity in COVID-19 clinical practice by presenting measurable, non-subjective, and evidence-based approaches (12, 18). Accurate ICU admission prediction can support the sharing of limited hospital resources and improve the quality of care along with patient survival chance (12). The timely identification of at-risk patients could diminish the need for imminent ICU beds and invasive mechanical ventilators. Moreover, using proposed model in present study can surge the tolls of timely ICU transfers, resulting in reduced mortality and shorter lengths of ICU stay. Designing a scientific and valid ML-based prediction model would assist in early detection and effective supportive intervention to improve patient outcomes, the quality of care, and ultimately a reduction in the mortality rate of COVID-19 patients. Ambiguity declines due to offering quantitative, objective, and evidence-based models for risk stratification, prediction, and care planning (9, 10).

This study had several limitations. First, we retrospectively analyzed a dataset without control over data fields or incomplete data. Second, the dataset was extracted from a single hospital with a low sample size of 1225, making the results ungeneralizable. Third, this study only included 11 clinical features at admission to the hospital. It does not mean that these should be the only criteria for determining ICU admission. Longitudinal changes in these clinical features need to be investigated. Moreover, we only used five ML algorithms for prediction analyses. Finally, the selected dataset lacked some critical clinical variables, such as radiological indicators. In the future, the performance accuracy of our model and its generalizability will be enhanced if we test more ML techniques for larger, multicenter, and prospective datasets equipped with more qualitative and validated data.

5.1. Conclusions

We trained and validated different ML algorithms to predict the need for ICU transfer in COVID-19 hospitalized patients based on the data collected easily and routinely at the time of hospital admission. This study first identified the highly ranked clinical predictors that can predict the likelihood of ICU admission more precisely. Second, we developed and compared five ML-driven prediction models based on these selected predictors. It was observed that the RF model performed best on classification accuracy compared to the other ML algorithms. This method has the potential to provide frontline clinicians with an objective instrument to manage COVID-19 patients more efficiently in such time-sensitive, resource-demanding, stressful, and potentially resource-constrained situations. Finally, the results of comparing the performance of prediction models in this study were satisfactory to some extent, and we believe that further investigations are needed to validate our model for a larger, multi-central, and more qualitative dataset.

Acknowledgements

References

  • 1.

    Basu S. Approaches to critical care resource allocation and triage during the COVID-19 pandemic: an examination from a developing world perspective. J Med Ethics Hist Med. 2021;14:5. doi: 10.18502/jmehm.v14i5.5652. [PubMed: 34849214]. [PubMed Central: PMC8595072].

  • 2.

    Vidal-Cevallos P, Higuera-De-La-Tijera F, Chavez-Tapia NC, Sanchez-Giron F, Cerda-Reyes E, Rosales-Salyano VH, et al. Lactate-dehydrogenase associated with mortality in hospitalized patients with COVID-19 in Mexico: a multi-centre retrospective cohort study. Ann Hepatol. 2021;24:100338. doi: 10.1016/j.aohep.2021.100338. [PubMed: 33647501]. [PubMed Central: PMC7908830].

  • 3.

    Smith EMT, Lee ACW, Smith JM, Thiele A, Zeleznik H, Ohtake PJ. COVID-19 and Post-intensive Care Syndrome: Community-Based Care for ICU Survivors. Home Health Care Manag. Pract. 2020;33(2):117-24. doi: 10.1177/1084822320974956.

  • 4.

    Abate SM, Ahmed Ali S, Mantfardo B, Basu B. Rate of Intensive Care Unit admission and outcomes among patients with coronavirus: A systematic review and Meta-analysis. PLoS One. 2020;15(7). e0235653. doi: 10.1371/journal.pone.0235653. [PubMed: 32649661]. [PubMed Central: PMC7351172].

  • 5.

    Sadeghi A, Eslami P, Dooghaie Moghadam A, Pirsalehi A, Shojaee S, Vahidi M, et al. COVID-19 and ICU admission associated predictive factors in Iranian patients. Caspian J Intern Med. 2020;11(Suppl 1):512-9. doi: 10.22088/cjim.11.0.512. [PubMed: 33425268]. [PubMed Central: PMC7780877].

  • 6.

    Elhadi M, Msherghi A, Alkeelani M, Alsuyihili A, Khaled A, Buzreg A, et al. Concerns for low-resource countries, with under-prepared intensive care units, facing the COVID-19 pandemic. Infect Dis Health. 2020;25(4):227-32. doi: 10.1016/j.idh.2020.05.008. [PubMed: 32631682]. [PubMed Central: PMC7274573].

  • 7.

    Chin V, Samia NI, Marchant R, Rosen O, Ioannidis JPA, Tanner MA, et al. A case study in model failure? COVID-19 daily deaths and ICU bed utilisation predictions in New York state. Eur J Epidemiol. 2020;35(8):733-42. doi: 10.1007/s10654-020-00669-6. [PubMed: 32780189]. [PubMed Central: PMC7417851].

  • 8.

    Zhao Z, Chen A, Hou W, Graham JM, Li H, Richman PS, et al. Prediction model and risk scores of ICU admission and mortality in COVID-19. PLoS One. 2020;15(7). e0236618. doi: 10.1371/journal.pone.0236618. [PubMed: 32730358]. [PubMed Central: PMC7392248].

  • 9.

    Agieb RS. Machine learning models for the prediction the necessity of resorting to icu of covid-19 patients. Int. J. Adv. Trends Comput. 2020;9(5):6980-4. doi: 10.30534/ijatcse/2020/15952020.

  • 10.

    Assaf D, Gutman Y, Neuman Y, Segal G, Amit S, Gefen-Halevi S, et al. Utilization of machine-learning models to accurately predict the risk for critical COVID-19. Intern Emerg Med. 2020;15(8):1435-43. doi: 10.1007/s11739-020-02475-0. [PubMed: 32812204]. [PubMed Central: PMC7433773].

  • 11.

    Ryan L, Lam C, Mataraso S, Allen A, Green-Saxena A, Pellegrini E, et al. Mortality prediction model for the triage of COVID-19, pneumonia, and mechanically ventilated ICU patients: A retrospective study. Ann Med Surg (Lond). 2020;59:207-16. doi: 10.1016/j.amsu.2020.09.044. [PubMed: 33042536]. [PubMed Central: PMC7532803].

  • 12.

    Allenbach Y, Saadoun D, Maalouf G, Vieira M, Hellio A, Boddaert J, et al. Development of a multivariate prediction model of intensive care unit transfer or death: A French prospective cohort study of hospitalized COVID-19 patients. PLoS One. 2020;15(10). e0240711. doi: 10.1371/journal.pone.0240711. [PubMed: 33075088]. [PubMed Central: PMC7571674].

  • 13.

    Pan P, Li Y, Xiao Y, Han B, Su L, Su M, et al. Prognostic Assessment of COVID-19 in the Intensive Care Unit by Machine Learning Methods: Model Development and Validation. J Med Internet Res. 2020;22(11). e23128. doi: 10.2196/23128. [PubMed: 33035175]. [PubMed Central: PMC7661105].

  • 14.

    Gao Y, Cai GY, Fang W, Li HY, Wang SY, Chen L, et al. Machine learning based early warning system enables accurate mortality risk prediction for COVID-19. Nat Commun. 2020;11(1):5033. doi: 10.1038/s41467-020-18684-2. [PubMed: 33024092]. [PubMed Central: PMC7538910].

  • 15.

    Hernandez-Suarez DF, Ranka S, Kim Y, Latib A, Wiley J, Lopez-Candales A, et al. Machine-Learning-Based In-Hospital Mortality Prediction for Transcatheter Mitral Valve Repair in the United States. Cardiovasc Revasc Med. 2021;22:22-8. doi: 10.1016/j.carrev.2020.06.017. [PubMed: 32591310]. [PubMed Central: PMC7736498].

  • 16.

    Parchure P, Joshi H, Dharmarajan K, Freeman R, Reich DL, Mazumdar M, et al. Development and validation of a machine learning-based prediction model for near-term in-hospital mortality among patients with COVID-19. BMJ Support Palliat Care. 2020. doi: 10.1136/bmjspcare-2020-002602. [PubMed: 32963059]. [PubMed Central: PMC8049537].

  • 17.

    Vaid A, Jaladanki SK, Xu J, Teng S, Kumar A, Lee S, et al. Federated Learning of Electronic Health Records to Improve Mortality Prediction in Hospitalized Patients With COVID-19: Machine Learning Approach. JMIR Med Inform. 2021;9(1). e24207. doi: 10.2196/24207. [PubMed: 33400679]. [PubMed Central: PMC7842859].

  • 18.

    Yadaw AS, Li YC, Bose S, Iyengar R, Bunyavanich S, Pandey G. Clinical features of COVID-19 mortality: development and validation of a clinical prediction model. Lancet Digit Health. 2020;2(10):e516-25. doi: 10.1016/S2589-7500(20)30217-X. [PubMed: 32984797]. [PubMed Central: PMC7508513].

  • 19.

    Yan L, Zhang H-T, Goncalves J, Xiao Y, Wang M, Guo Y, et al. An interpretable mortality prediction model for COVID-19 patients. Nat. Mach. Intell. 2020;2(5):283-8. doi: 10.1038/s42256-020-0180-7.

  • 20.

    Karegowda AG, Manjunath AS, Jayaram MA. Comparative study of attribute selection using gain ratio and correlation based feature selection. International Journal of Information Technology and Knowledge Management. 2010;2(2):271-7.

  • 21.

    Leclerc T, Donat N, Donat A, Pasquier P, Libert N, Schaeffer E, et al. Prioritisation of ICU treatments for critically ill patients in a COVID-19 pandemic with scarce resources. Anaesth Crit Care Pain Med. 2020;39(3):333-9. doi: 10.1016/j.accpm.2020.05.008. [PubMed: 32426441]. [PubMed Central: PMC7230138].

  • 22.

    Tambone V, Boudreau D, Ciccozzi M, Sanders K, Campanozzi LL, Wathuta J, et al. Ethical Criteria for the Admission and Management of Patients in the ICU Under Conditions of Limited Medical Resources: A Shared International Proposal in View of the COVID-19 Pandemic. Front Public Health. 2020;8:284. doi: 10.3389/fpubh.2020.00284. [PubMed: 32612972]. [PubMed Central: PMC7308475].

  • 23.

    Sun L, Mo Z, Yan F, Xia L, Shan F, Ding Z, et al. Adaptive Feature Selection Guided Deep Forest for COVID-19 Classification With Chest CT. IEEE J Biomed Health Inform. 2020;24(10):2798-805. doi: 10.1109/JBHI.2020.3019505. [PubMed: 32845849].

  • 24.

    Li X, Ge P, Zhu J, Li H, Graham J, Singer A, et al. Deep learning prediction of likelihood of ICU admission and mortality in COVID-19 patients using clinical variables. PeerJ. 2020;8. e10337. doi: 10.7717/peerj.10337. [PubMed: 33194455]. [PubMed Central: PMC7651477].

  • 25.

    Zhou Y, He Y, Yang H, Yu H, Wang T, Chen Z, et al. Exploiting an early warning Nomogram for predicting the risk of ICU admission in patients with COVID-19: a multi-center study in China. Scand J Trauma Resusc Emerg Med. 2020;28(1):106. doi: 10.1186/s13049-020-00795-w. [PubMed: 33109234]. [PubMed Central: PMC7590555].

  • 26.

    Zhang Y, Xin Y, Li Q, Ma J, Li S, Lv X, et al. Empirical study of seven data mining algorithms on different characteristics of datasets for biomedical classification applications. Biomed Eng Online. 2017;16(1):125. doi: 10.1186/s12938-017-0416-x. [PubMed: 29096638]. [PubMed Central: PMC5668968].

Copyright © 2022, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.
COMMENTS

LEAVE A COMMENT HERE: