Abstract
Many machine learning algorithms provide probabilistic predictions as their outputs. Analysis techniques familiar to physicians (e.g., calculation of sensitivity and specificity and construction of receiver operating characteristics curves) do not allow for the assessment of model calibration and prevent proper evaluation of these models. We reviewed statistical and graphical (shown in Figure 1) methods for calibration analysis and presented a framework for the implementation of these techniques using open-source codes and an online tool.
To see Figure 1 please refer to the PDF file.
Copyright
Copyright © 2019, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.