The high degree of accuracy of breast US in differentiating between benign and malignant lesions has been clearly demonstrated (
19). As a result, ultrasonographic evaluation was included in the classification of breast masses in the 2003 edition of American College of Radiology (ACR) breast imaging reporting and data system (BI-RADS®) (
20).
In 2013, the fifth edition of BI-RADS was released (
3). Shapes, orientations, margins, echo patterns, posterior features, and calcifications are included in the lesion descriptions of breast masses detected on breast US. Certain features, including an irregular shape, microlobulated or spiculated margins, and a width-to-anteroposterior (AP) dimension ratio of 1.4 or less, suggest malignancy (
21).
Despite the excellent performances reported using the ultrasonographic BI-RADS, the final assessments made for breast masses by different performers vary significantly, mostly due to the multiple BI-RADS ultrasonographic descriptors used for describing breast lesions and the subjectiveness of US (
4,
5). To increase the diagnostic accuracy of breast US, several additional ultrasonographic techniques have been developed and applied in clinical practice, such as elastography, automated breast US, and CAD systems (
22). Among these additional imaging modalities, CAD systems enable efficient interpretation, in which consistent improved accuracy can be expected (
22).
S-Detect is a recently developed CAD system for breast US that provides assistance in the morphological analysis based on the BI-RADS lexicon and the final assessment (
14). S-Detect exhibits a significantly higher specificity, PPV, AUC and accuracy than radiologists (all P < 0.05) (
14,
23). In a recent study, the AUC, sensitivity, specificity, PPV, and NPV of S-Detect were 0.73, 79%, 66%, 58%, and 84% (
14). We assessed the diagnostic performance, including the AUC, sensitivity, specificity, PPV, and NPV, of the BI-RADS descriptors, categories, and quantitative variables.
In this study, the AUC, sensitivity, specificity, PPV and NPV of US vs. CAD were 0.82 vs. 0.78, 95% vs. 78%, 69% vs. 78%, 36% vs. 39%, and 99% vs. 95%, respectively. CAD exhibited a higher specificity (78% vs. 69%) and PPV (39% vs. 36%) than US. The AUC, sensitivity, specificity, PPV and NPV of the subjective combination of US with CAD were 0.83, 95%, 72%, 38%, and 99%. The subjective and disjunctive combination of US with CAD showed the highest AUC. When CAD was subjectively and disjunctively combined with breast US, the specificity was significantly improved (P < 0.05). The diagnostic performance of each quantitative variable of CAD could not be better than that of the final assessment category that combined the entire lexicon. However, the height and H/W ratio exhibited the greatest AUC (0.76, 0.75) among all descriptors and quantitative variables. The H/W ratio exhibited the highest sensitivity (91%) among all descriptors and quantitative variables. Orientation in US is directly correlated with the H/W ratio in CAD; therefore, we analyzed orientation because it is an important factor. When combining CAD with quantitative variables (height and H/W ratio), no significant improvement was observed in the diagnostic performance. However, the sensitivities were improved for conjunctive combinations. The specificities and PPVs were improved for disjunctive combinations.
Although the PPV obtained for lesions with a final assessment category of 4 according to the US BI-RADS criteria is consistent with previous studies, the percentage of malignant lesions varied, ranging from 16.2% to 60% (
5,
19,
24-
26). This variation is probably due to sample heterogeneity and different interpretations of lesions that should be classified into categories 4 and 5 (
24). Thus, we aimed to analyze the PPVs of each BI-RADS descriptor and quantitative variable in this study. Among the BI-RADS descriptors, a spiculated margin was the most important covariate for diagnosis (
27). The PPVs of a spiculated margin as a single factor in US and CAD were 60% and 38% and depended on the modality. A not-parallel orientation was the second most important descriptor (
27). The PPVs of a not-parallel orientation as a single factor in US and CAD were both 40%.
According to the concordance analysis, the orientations, shapes, and echogenicities exhibited moderate agreement (kappa = 0.57, 0.51, and 0.44, respectively). The margins, posterior features, and final categories exhibited fair agreement (kappa = 0.38, 0.38, and 0.37). By performing an interobserver variability analysis in the recent study, substantial agreement was observed for lesion orientation and shape (kappa = 0.61 and 0.66). Moderate agreement was observed for lesion margins and posterior features (kappa = 0.40 for both). Fair agreement was observed for lesion echo patterns (kappa = 0.29) (
19). Other studies have demonstrated that the margin was the most important factor, but high variability exists across studies (
1,
19). In general, the determination of parallel or not-parallel orientation to the skin of the mass can be easily assessed, which explains the relatively robust interobserver variability (
1). In our study, the orientation was a consistent factor, and we could obtain the H/W ratio, which is one of the accurate quantitative variables in CAD.
In addition, the mean H/W ratios of parallel and not-parallel orientations were significantly different in both grayscale US (0.6 ± 0.1 vs. 0.9 ± 0.2, P < 0.05) and CAD (0.6 ± 0.2 vs. 0.9 ± 0.2, P < 0.05) (
Table 5). Therefore, the orientation and H/W ratio were particularly useful in both grayscale US and CAD. Additionally, we determined that readers perceive a not-parallel orientation of the lesion when the H/W ratio is approximately 0.9 or higher.
Our study had some limitations. First, for CAD to analyze a lesion, a radiologist must first identify the breast lesion, which can differ based on the experience of the radiologist. In this study, the four readers had similar levels of experience to reduce reader dependency. Second, we did not include calcifications or non-mass lesions in the analysis due to the lack of detection of these cases on US during the study period. This situation may differ from CAD applications in clinical practice. Third, the small number of malignant lesions (75 of 521) and the disparity between the number of malignant and benign lesions might be influenced the results. Fourth, a biopsy was performed for lesions that were suspicious on US as usual practice; therefore, lesions that were suspicious only on CAD or according to the quantitative value were not biopsied but were followed up only by breast US in this study.
In conclusion, we can obtain the BI-RADS descriptors, categories, and accurate quantitative variables in CAD. The combined CAD and US results showed the greatest diagnostic performance. When CAD was subjectively and disjunctively combined with breast US, the specificity was significantly improved. Additionally, the orientation and H/W ratio are consistent key factors that could be used to differentiate benign from malignant lesions using both US and CAD.