Calibration of Probabilistic Model Output: Introduction and Online Tool

Authors

Behrang Amini1,*, Michael Richardson2
1Department of Musculoskeletal Imagind, MD Anderson Cancer Center, Houston, United States
2Department of Diagnostic Radiology, University of Washington, Seattle, United States
*Corresponding Author: Department of Musculoskeletal Imagind, MD Anderson Cancer Center, Houston, United States. Email: bamini@mdanderson.org

Iranian Journal of Radiology:Vol. 16, issue Special Issue; e99162
Published online:Dec 10, 2019
Article type:Abstract
Received:Oct 26, 2019
Accepted:Dec 10, 2019
How to Cite:Amini B, Richardson M. Calibration of Probabilistic Model Output: Introduction and Online Tool. I J Radiol. 2019;16(Special Issue):e99162. doi: https://doi.org/10.5812/iranjradiol.99162

Abstract

Many machine learning algorithms provide probabilistic predictions as their outputs. Analysis techniques familiar to physicians (e.g., calculation of sensitivity and specificity and construction of receiver operating characteristics curves) do not allow for the assessment of model calibration and prevent proper evaluation of these models. We reviewed statistical and graphical (shown in Figure 1) methods for calibration analysis and presented a framework for the implementation of these techniques using open-source codes and an online tool.

Highlights

To see Figure 1 please refer to the PDF file.

Copyright

Copyright © 2019, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.

Similar Articles

24
Jul
2017
Presentation of hidden knowledge from a localbreast cancer dataset by the classification and regression trees

Presentation of hidden knowledge from a localbreast cancer dataset by the classification and regression trees

Hadi LotfnezhadAfshar,
Lili Rahmatnejad,
Bahlol Rahimi,
Hamid Reza Khalkhali

LotfnezhadAfshar H, Rahmatnejad L, Rahimi B, Khalkhali HR. Presentation of hidden knowledge from a localbreast cancer dataset by the classification and regression trees. J Clin Res Paramed Sci. 2017;6(2):e81268. doi:

18
Feb
2024
Comparing the Performance of Machine Learning Models in Predicting the Risk of Chronic Kidney Disease

Comparing the Performance of Machine Learning Models in Predicting the Risk of Chronic Kidney Disease

Sina Moosavi Kashani,
Sanaz Zargar Balaye Jame

Moosavi Kashani S, Zargar Balaye Jame S. Comparing the Performance of Machine Learning Models in Predicting the Risk of Chronic Kidney Disease. J Arch Mil Med. 2023;11(4):e140885. doi: https://doi.org/10.5812/jamm-140885

23
Jan
2016

Stata Modules for Calculating Novel Predictive Performance Indices for Logistic Models

Mahnaz Barkhordari,
Mojgan Padyab,
Farzad Hadaegh,
Fereidoun Azizi,
Mohammadreza Bozorgmanesh

Barkhordari M, Padyab M, Hadaegh F, Azizi F, Bozorgmanesh M. Stata Modules for Calculating Novel Predictive Performance Indices for Logistic Models. Int J Endocrinol Metab. 2016;14(1):e59235. doi: https://doi.org/10.5812/ijem.26707

23
Mar
2016
Survival Regression Modeling Strategies in CVD Prediction

Survival Regression Modeling Strategies in CVD Prediction

Mahnaz Barkhordari,
Mojgan Padyab,
Mahsa Sardarinia,
Farzad Hadaegh,
Fereidoun Azizi,
Mohammadreza Bozorgmanesh

Barkhordari M, Padyab M, Sardarinia M, Hadaegh F, Azizi F, et al. Survival Regression Modeling Strategies in CVD Prediction. Int J Endocrinol Metab. 2016;14(2):e32156. doi: https://doi.org/10.5812/ijem.32156

4
Nov
2025
Predictive Modeling of Anesthesia Types and Their Associations with Clinical Outcomes Using the MIMIC-IV Database

Predictive Modeling of Anesthesia Types and Their Associations with Clinical Outcomes Using the MIMIC-IV Database

Goli Asgari,
Ata Amini,
Pooya Vahedi,
Yasmin Tabatabavakili,
Jan Muzik,
Elham Nazari
,et al.

Asgari G, Amini A, Vahedi P, Tabatabavakili Y, Muzik J, et al. Predictive Modeling of Anesthesia Types and Their Associations with Clinical Outcomes Using the MIMIC-IV Database. J Cell Mol Anesth. 2025;10(4):e166293. doi: https://doi.org/10.5812/jcma-166293

More by these authors

Behrang AminiPubMedScholar
Michael RichardsonPubMedScholar
Share
Cited by
Metrics