An Innovative Journal in the Field of Radiology
Calibration of Probabilistic Model Output: Introduction and Online Tool
Authors
Abstract
Many machine learning algorithms provide probabilistic predictions as their outputs. Analysis techniques familiar to physicians (e.g., calculation of sensitivity and specificity and construction of receiver operating characteristics curves) do not allow for the assessment of model calibration and prevent proper evaluation of these models. We reviewed statistical and graphical (shown in Figure 1) methods for calibration analysis and presented a framework for the implementation of these techniques using open-source codes and an online tool.
Highlights
Copyright
Copyright © 2019, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.
Similar Articles
Presentation of hidden knowledge from a localbreast cancer dataset by the classification and regression trees
LotfnezhadAfshar H, Rahmatnejad L, Rahimi B, Khalkhali HR. Presentation of hidden knowledge from a localbreast cancer dataset by the classification and regression trees. J Clin Res Paramed Sci. 2017;6(2):e81268. doi:
Comparing the Performance of Machine Learning Models in Predicting the Risk of Chronic Kidney Disease
Moosavi Kashani S, Zargar Balaye Jame S. Comparing the Performance of Machine Learning Models in Predicting the Risk of Chronic Kidney Disease. J Arch Mil Med. 2023;11(4):e140885. doi: https://doi.org/10.5812/jamm-140885
Stata Modules for Calculating Novel Predictive Performance Indices for Logistic Models
Barkhordari M, Padyab M, Hadaegh F, Azizi F, Bozorgmanesh M. Stata Modules for Calculating Novel Predictive Performance Indices for Logistic Models. Int J Endocrinol Metab. 2016;14(1):e59235. doi: https://doi.org/10.5812/ijem.26707
Survival Regression Modeling Strategies in CVD Prediction
Barkhordari M, Padyab M, Sardarinia M, Hadaegh F, Azizi F, et al. Survival Regression Modeling Strategies in CVD Prediction. Int J Endocrinol Metab. 2016;14(2):e32156. doi: https://doi.org/10.5812/ijem.32156
Predictive Modeling of Anesthesia Types and Their Associations with Clinical Outcomes Using the MIMIC-IV Database
Asgari G, Amini A, Vahedi P, Tabatabavakili Y, Muzik J, et al. Predictive Modeling of Anesthesia Types and Their Associations with Clinical Outcomes Using the MIMIC-IV Database. J Cell Mol Anesth. 2025;10(4):e166293. doi: https://doi.org/10.5812/jcma-166293
- Scopus by DOI: 0
Last Update: 1 month ago
- Scopus by Title: 0
Last Update: 1 month ago
- Scopus by Title (Ref): 0
Last Update: 1 month ago
- CrossRef: 0
Last Update: 6 days ago
- OpenAlex: 0
Last Update: 2 days ago
- OpenCitations: 0
Last Update: 3 days ago