In this study, four clinical features related to knee osteoarthritis were extracted from knee radiographs: The angle between the femoral and tibial axes, the joint space distance, the amount of subarticular erosion, and the osteophyte assessment. To convert these clinical features into processable numerical values, image processing-based approaches were applied, and each feature was defined as a normalized scalar in the range [0,1].
4.4. Osteophyte Feature
By creating a morphological gradient image and applying thresholding, bone growths were identified at the edges of the image. The area-to-perimeter ratio of these areas was defined as a geometric feature. Although this feature had limited clinical relevance in some cases, it performed well in diagnosing suspected cases without osteophytes.
The present study showed that each feature alone is able to relatively distinguish between different stages of the disease, and when combined, the recognition ability of the model increases significantly.
To evaluate the performance of the SVM model, k-fold cross-validation with k = 10 was used. In this method, the data were divided into 10 equal parts; in each iteration, one part was used for testing and 9 parts were used for training. Different kernels, including linear, polynomial, radial, RBF, and quadratic, and multilayer perceptron (MLP) were used for modeling, and the accuracy, sensitivity, and specificity for each case were reported as mean and standard deviation.
Initially, by changing the parameter σ in the RBF kernel, its effect on the accuracy of the model was investigated. The results in
Table 1 show that the highest overall classification accuracy was achieved with a value of σ = 0.85 (83.53%), while at very small or larger values than the optimal limit, the accuracy decreased.
| RBF Sigma | Accuracy by First Features | Accuracy by Second Features | Accuracy by Third Features | Accuracy by Forth Features | Accuracy by All Features |
|---|
| 0.25 | 70.76 ± 0.77 | 73.46 ± 0.65 | 66.21 ± 0.19 | 66.74 ± 1.45 | 78.35 ± 0.40 |
| 0.45 | 71.01 ± 0.50 | 72.24 ± 0.77 | 65.21 ± 0.77 | 62.54 ± 0.96 | 80.78 ± 0.57 |
| 0.65 | 73.03 ± 0.54 | 71.58 ± 1.23 | 63.84 ± 0.70 | 63.01 ± 1.01 | 82.42 ± 0.72 |
| 0.85 | 73.24 ± 0.71 | 70.37 ± 0.13 | 64.04 ± 0.29 | 64.66 ± 0.97 | 83.53 ± 0.36 |
| 0.95 | 73.82 ± 0.49 | 73.37 ± 0.40 | 63.32 ± 0.28 | 64.29 ± 0.59 | 80.73 ± 1.21 |
| 1.00 | 71.65 ± 0.70 | 69.93 ± 0.70 | 63.12 ± 0.49 | 64.14 ± 0.62 | 78.74 ± 1.44 |
| 2.50 | 72.72 ± 0.13 | 69.11 ± 0.99 | 63.43 ± 0.37 | 62.80 ± 1.64 | 73.69 ± 0.61 |
a Values are expressed as mean ± SD.
b First feature: Angle between the femoral and tibial axes; second feature: Joint space distance; third feature: Subfemoral erosion feature; and forth feature: Osteophyte feature (expressed in percentage).
As can be seen in
Figure 2, the effect of RBF sigma changes on the RBF kernel resulted in the model performance curve behaving nonlinearly with respect to σ changes, and the maximum accuracy was obtained at the midpoint. In addition, the performance analysis of each feature individually showed that the first feature (the angle between the femoral and tibial axes) performed best at σ = 0.95 with an accuracy of 73.82%, and the third feature (bone erosion) provided the lowest accuracy at most σ values.
Effect of varying the radial basis function (RBF) sigma parameter on Support Vector Machine (SVM) classification accuracy across four individual features and their combination. Results are based on 10-fold cross-validation. Bars represent mean accuracy ± standard deviation.
To investigate the effectiveness of different types of kernels in SVM modeling, a comparison was made between the results obtained by each kernel in the separation of each feature (
Table 2). The following can be extracted from this table:
- The radial kernel demonstrated the highest performance among all kernels, with an overall accuracy of 79.89%.
- The linear kernel provided the lowest accuracy (70.29%) and performed particularly poorly for the fourth feature (osteophyte), with an accuracy of only 59.22%.
- The MLP had a high ability in the separation of the femur-tibia angle feature (74.14%), indicating the quasi-linear behavior of this feature in the feature space.
| Types of Kernels (or Models) | Accuracy by First Features | Accuracy by Second Features | Accuracy by Third Features | Accuracy by Forth Features | Accuracy by All Features |
|---|
| Linear | 72.61 ± 1.1 | 66.59 ± 1.32 | 62.97 ± 0.60 | 59.22 ± 1.25 | 70.29 ± 1.98 |
| Poly | 71.67 ± 1.28 | 69.81 ± 0.51 | 63.54 ± 2.49 | 63.11 ± 0.90 | 77.80 ± 1.86 |
| RBF | 71.65 ± 0.7 | 69.93 ± 0.70 | 63.12 ± 0.49 | 64.14 ± 0.62 | 78.74 ± 1.44 |
| MLP | 74.14 ± 0.82 | 68.62 ± 0.36 | 63.16 ± 0.39 | 62.18 ± 0.114 | 71.87 ± 1.29 |
| Radial | 72.61 ± 0.67 | 70.69 ± 0.66 | 63.77 ± 0.45 | 63.91 ± 0.49 | 79.89 ± 0.99 |
| Quadratic | 72.46 ± 0.83 | 71.70 ± 0.42 | 63.38 ± 0.67 | 64.42 ± 2.29 | 77.17 ± 1.01 |
Abbreviations: RBF, radial basis function; MLP, multilayer perceptron.
a Values are expressed as mean ± SD.
b First feature: Angle between the femoral and tibial axes; second feature: Joint space distance; third feature: Subfemoral erosion feature; and forth feature: Osteophyte feature (expressed in percentage).
This comparison is presented in
Figure 3 as a bar chart that clearly shows the changes in the performance of the kernels for each feature and the full set of features.
Comparison of the effectiveness of different kernel types
The graph in
Figure 3 shows that:
- The data related to the first feature exhibited stable and separable performance across different kernels.
- The third and fourth features require a model with high nonlinear resolution (such as the radial kernel) due to the dispersion in the feature space.
- Combining all features with the radial kernel, in addition to high accuracy, increased the sensitivity and specificity of the model.
To further evaluate the model’s performance across individual KL grades, a confusion matrix was constructed and visualized as a heatmap (
Figure 4). This matrix summarizes the number of correct and incorrect predictions for each class. As shown, the model achieved high accuracy in distinguishing KL = 1 and KL = 4 grades, while minor misclassifications occurred between adjacent grades such as KL = 2 and KL = 3.
Confusion matrix heatmap for Kellgren-Lawrence (KL) grade classification using Support Vector Machine (SVM, 10-fold cross-validation); the matrix illustrates the number of correctly and incorrectly classified samples for each KL severity grade.
Overall, these results indicate the success of combining clinical features and image processing in building an effective model for diagnosing the severity of knee osteoarthritis, and underscore the superiority of nonlinear kernels, especially radial, over other kernels in modeling complex medical data.