Abstract
Background:
Ultrasound imaging has become one of the most widely utilized adjunct tools in breast cancer screening due to its advantages. The computer-aided detection of breast ultrasound is rapid development via significant features extracted from images.Objectives:
The main aim was to identify features of breast ultrasound image that can facilitate reasonable classification of ultrasound images between malignant and benign lesions.Patients and Methods:
This research was a retrospective study in which 85 cases (35 malignant [positive group] and 50 benign [negative group] with diagnostic reports) with ultrasound images were collected. The B-mode ultrasound images have manually selected regions of interest (ROI) for estimated features of an image. Then, a fractal dimensional (FD) image was generated from the original ROI by using the box-counting method. Both FD and ROI images were extracted features, including mean, standard deviation, skewness, and kurtosis. These extracted features were tested as significant by t-test, receiver operating characteristic (ROC) analysis and Kappa coefficient.Results:
The statistical analysis revealed that the mean texture of images performed the best in differentiating benign versus malignant tumors. As determined by the ROC analysis, the appropriate qualitative values for the mean and the LR model were 0.85 and 0.5, respectively. The sensitivity, specificity, accuracy, positive predicted value (PPV), negative predicted value (NPV), and Kappa for the mean was 0.77, 0.84, 0.81, 0.77, 0.84, and 0.61, respectively.Conclusion:
The presented method was efficient in classifying malignant and benign tumors using image textures. Future studies on breast ultrasound texture analysis could focus on investigations of edge detection, texture estimation, classification models, and image features.Keywords
1. Background
Breast cancer is one of the high risks that leads to death among females in the world (1, 2). The primary purpose of breast ultrasound imaging is as an adjunct to mammographic imaging to identify the nature of the lesion (i. e., cystic versus solid), which in turn determines the need for core biopsy. A radiologist then examines the images for any abnormalities. The diagnosis of fibroadenoma is primarily made with ultrasound imaging after mammography; an invasive biopsy is not customarily required (3). The diagnosis of ultrasound images was dominated by inter-observed and intra-observed bias, such as instrumental parameters, human factors, or the experience of the physicians. Hence, efforts are underway to develop ultrasound computer-assisted diagnosis (CAD) systems that can assist radiologists in diagnosing breast diseases (4, 5). Therefore, the analyzing of features of breast images could provide the radiologist with ancillary information to improve the diagnosis accuracy (6).
Ultrasound images of benign lesions are symmetrical and have smooth edges; whereas, images of malignant lesions are irregular. Furthermore, benign lesions yield high echoes, and malignant lesions yield low echoes (6). There are many studies in the literature on ultrasound image analysis via textural or feature analysis (7-10). In addition, fractal dimension imaging describes geometric patterns or self-similarities by subtle physical shapes; meanwhile, it can also display the irregularity and complexity of image textures (11). The box-counting method with fixed grid scans is a commonly used calculation for measuring fractal objects but is easily affected by factors such as image noise and size (12). Texture analysis on pixels with fixed sizes using a gray-level co-occurrence matrix (GLCM) can serve as a tool in the classification of benign versus malignant ultrasound texture images and can improve the accuracy of diagnosis (13, 14). However, when analyzing textures using GLCM, the resulting output is influenced by parameters such as raw image resolution, gray image level, scan condition, or feature statistics. Therefore, it is recommended to use the result as a reference in clinical practice (9, 15).
2. Objectives
Due to different textures between benign versus malignant breast B-mode ultrasound tomography, this study was to evaluate the significant extracted textural features to identify breast tumors as malignant or benign. The aim was to identify image features that can facilitate a reasonable quantitative analysis of ultrasound images of malignant and benign lesions.
3. Patients and Methods
3.1. Patients
The Institutional Review Board approved this study of E-Da Hospital, Taiwan (no.: EMRP-105-099) and informed consent was not required for this retrospective Health Insurance Portability and Accountability Act (HIPAA) investigation. A total of 85 cases (35 malignant and 50 benign with diagnostic reports) of ultrasound images taken during the years 2010 to 2013 were collected. Benign patients were required to receive two of the following: mammography or breast ultrasound imaging. Medical radiologists then diagnosed the images. For patients with malignant lesions, the condition was confirmed by biopsy before inclusion in this study. There was no age limitation. Each diagnosis report was for one side of the breast. The ultrasound images of breast cancer determined the regions of interest (ROIs) (i.e., the specific image, including the entire breast). Figure 1 shows B-mode breast ultrasound between benign and malignant lesions. Target lesions with round, macro-lobulated shape or ovoid, circumscribed boundary, abrupt interface to the normal parenchyma were categorized as probably benign. On the contrary, target lesions with complex echotexture, lacking circumscribed margin, irregular shape, displaying thick echogenic halo, or posterior acoustic shadowing were considered as malignant.
A-C, Original breast B-mode ultrasound shows benign lesions; and D-F, Malignant lesions.
3.2. The Extracted Image Features
The ROIs containing breast the entire B-mode ultrasound image were selected. Regions for non-mammary tissues, including ribs and the musculus pectoralis major, along with other labels were excluded. Image edges were estimated using the Laplacian of Gaussian (LoG) method, and texture images were calculated using box-counting (Figure 2). Finally, texture analysis was performed, as shown in Figure 2C and F.
Breast B-mode ultrasound image conversion diagram; A, Regions of interest (ROI) selected from a raw image of a malignant breast cancer; B, Laplacian of Gaussian (LoG) estimate of edges; C, Box-counting method for texture images; D, ROI selected from a raw image of a non-malignant breast lesion; E, LoG of edges; and F, Box-counting method for texture images.
Feature values were extracted from the texture image; the extracted values included the mean, standard deviation (SD), skewness, and kurtosis. The quantitative effects of the fractal dimension image feature values for malignant and benign lesions were compared. The t-test explored the differences in feature values of images. Critical image feature values were determined through box-plot and receiver operating characteristic (ROC) curve analyses. The thresholds of image feature quantitative values for malignant and benign tumors were estimated using 95% confidence intervals (CIs).
Additionally, a quantitative model for classifying malignant versus benign tumors was developed using logistic regression. The effectiveness of the quantitative analysis was examined using indicators such as sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and Kappa consistency statistics. The aim was to identify image features that can facilitate a reasonable quantitative analysis of ultrasound images of malignant and benign lesions. The analysis flowchart is illustrated in Figure 3. Image features were calculated by examining fractal dimension images. The following describes the image features explored in this study (16-18).
Research flowchart. ROI, regions of interest; ROC, receiver operating characteristics; PPV, positive predictive value; NPV, negative predictive value; AUC, area under the curve.
3.3. Statistical Analysis
The t-test and ROC curve analysis were employed in this study. Effectiveness was examined by confusion matrix analysis. The true positive (TP), true negative (TN), false positive (FP), false negative (FN), sensitivity, accuracy, specificity, PPV, and NPV of quantitative analysis by breast ultrasound image features were investigated. The area under the ROC curve was used to examine the discrimination power of the ROC curve and was used in the Kappa consistency calculation. The area under the curve (AUC) and the Kappa value ranged from 0 - 1; larger values are preferred. Statistical analyses were performed using SPSS statistics for Windows, version 22.0. Armonk, NY: IBM Corp. IBM Corp. Released 2013. IBM Data with P values less than 0.05 were considered significant.
As determined by the t-test, using the mean, SD, skewness, and kurtosis of breast ultrasound fractal images could be effective in differentiating ultrasound images of malignant and benign lesions. The x-axes of the ROC plots (Figure 4) represent 1-specificity, and the y-axes represent sensitivity. The higher curve indicated that the feature value was more sensitive for the diagnosis of cancer by texture image. The skewing of the curve to the left indicated that the feature value was more accurate for the diagnosis of cancer by texture image. The power of the feature value in differentiating malignant versus benign lesions can be recognized using the area under the ROC curve. A greater area indicated that the classification performance was better, while a smaller area indicated that the classification performance was poor.
The receiver operating characteristics (ROC) curves of image features
4. Results
Fractal image features of breast ultrasound were subjected to descriptive statistics, t-test, and AUC statistical analysis. The image features yielded means of 0.88 ± 0.05 and 0.79 ± 0.06, SDs of 0.24 ± 0.04 and 0.26 ± 0.03, skewness values of 0.30 ± 0.05 and 0.35 ± 0.07, and kurtosis values of -1.09 ± 0.28 and -0.72 ± 0.28 for malignant and benign images, respectively. There were overlaps in the upper and lower thresholds of 95% CIs of SD, skewness, and kurtosis; the differentiation power was not apparent. The upper and lower thresholds of the 95% CIs of the mean were 0.9 and 0.86, respectively, for malignant images and 0.81 and 0.77, respectively, for benign images. There were no overlaps in the thresholds, indicating that the mean could serve as a classification feature (Table 1).
Descriptive Statistics and P Value Testing by t-test of Breast Ultrasound Fractal Image Features From 35 Malignant and 50 Benign Imagesa
| Image feature value | Breast disease | Cases | Values | Minimum | Maximum | P value |
|---|---|---|---|---|---|---|
| Mean | Malignant | 35 | 0.88 ± 0.05 | 0.77 | 1.02 | < 0.001 |
| Benign | 50 | 0.79 ± 0.06 | 0.64 | 0.93 | ||
| SD | Malignant | 35 | 0.24 ± 0.04 | 0.17 | 0.35 | 0.040 |
| Benign | 50 | 0.26 ± 0.03 | 0.17 | 0.32 | ||
| Skewness | Malignant | 35 | 0.3 ± 0.05 | 0.21 | 0.44 | < 0.001 |
| Benign | 50 | 0.35 ± 0.07 | 0.23 | 0.53 | ||
| Kurtosis | Malignant | 35 | -1.09 ± 0.28 | -1.69 | -0.33 | < 0.001 |
| Benign | 50 | -0.72 ± 0.28 | -1.37 | -0.11 |
The mean of breast ultrasound fractal images showed higher distributions in the malignant group than the benign group. The distribution of SDs in the malignant group was smaller than that in the benign group. The skewness values were positive for both the malignant and benign groups, but the skewness values were lower in the malignant group compared to the benign group. The kurtosis values were platykurtic for both the malignant and benign groups; however, the kurtosis values were lower for the malignant group than for the benign group, which indicated that the distribution was dispersed.
4.1. Analysis of Differences in Image Feature Values
The t-test was utilized to determine whether the differences between malignant and benign feature values were significant (P < 0.05). The differences in mean, SD, skewness, and kurtosis, were significant (P < 0.05). The results of the abovementioned examination are provided in Table 1.
4.2. Cross-Comparisons of the Cut-Off Points
The mean, SD, skewness, and kurtosis values of breast ultrasound fractal images and the AUCs of their logistic regression models were 0.87, 0.67, 0.72, and 0.83, respectively (Table 2). Based on these results, the mean performed the best for LR-1 image classification. The mean, SD, skewness, kurtosis, and LR classification cut-off points were provided by the ROC coordinates. The appropriate cut-off points were 0.85+ for the mean, 0.25- for SD, 0.31- for skewness, and -0.94- for kurtosis. Through cross-comparison, the sensitivity, specificity, accuracy, PPV, and NPV of the feature values mean, SD, skewness, and kurtosis were obtained for validation (Table 2). The Kappa value can be utilized to express the consistency of the tool in repeated measurements.
Cross-Comparisons of the Cut-Off Points of Feature Values and Regression Models
| Item | Cut-off Point | Sensitivity | Specificity | Accuracy | PPV | NPV | AUC | Kappa |
|---|---|---|---|---|---|---|---|---|
| Mean | 0.85+ | 0.77 | 0.84 | 0.81 | 0.77 | 0.84 | 0.87 | 0.61 |
| SD | 0.25- | 0.71 | 0.64 | 0.58 | 0.47 | 0.60 | 0.67 | 0.34 |
| Skewness | 0.31- | 0.71 | 0.64 | 0.67 | 0.58 | 0.76 | 0.72 | 0.34 |
| Kurtosis | -0.94- | 0.74 | 0.76 | 0.75 | 0.74 | 0.81 | 0.83 | 0.50 |
5. Discussion
This research utilized B-mode ultrasound images and estimated the edges using the LoG method. The box-counting method was employed to estimate texture images. The goal of this research was to increase the quantitative accuracy and to decrease the false-negative rate (FNR) and the false positive rate (FPR) of breast tissue imaging analysis. Finally, quantitative analysis was performed on the mean extracted from texture images. The results indicated that the mean and its logistic regression model yielded reasonable results and were feasible for clinical application. The cut-off points of the mean, SD, skewness, kurtosis were determined by ROC analysis to be 0.85, 0.25, 0.31, and -0.94, respectively. The AUC (area under ROC) provided by mean was 0.87. The AUC of presented methods was acceptable with compared literatures (19-21).
The analysis and discussion for each image feature are provided below:
(I) If the mean value of the texture image was higher than 0.85, the fractal image was brighter. In other words, there were more edges found in the breast ultrasound images. Thus, the textures were more complicated and inconsistent, which indicated a higher chance of the lesion being malignant. Analysis of the effectiveness of diagnosis by setting 0.85 as the threshold for the mean mentioned that the sensitivity was 0.77, the specificity was 0.84, the accuracy was 0.81, the PPV was 0.77, the NPV was 0.84, and the Kappa value was 0.61. The accuracy of the presented methods was reasonable compared with literatures (6, 22-24).
(II) If the SD of the texture image was less than 0.25, there was a high chance of the tumor being malignant. The analysis of the effectiveness of diagnosis by setting 0.25 as the threshold for the SD mentioned that the sensitivity was 0.71, the specificity was 0.64, the accuracy was 0.51, the PPV was 0.47, the NPV was 0.60, and the Kappa value was 0.34.
(III) If the image skewness was less than 0.31, there was a possible chance of the tumor being malignant. The analysis of the effectiveness of diagnosis by setting 0.31 as the threshold for the skewness mentioned that the sensitivity was 0.71, the specificity was 0.64, the accuracy was 0.67, the PPV was 0.58, the NPV was 0.76, and the Kappa value was 0.34.
(IV) If the image kurtosis was higher than -0.94, there was a greater chance of the tumor being malignant. The analysis of the effectiveness of diagnosis by setting -0.94 as the threshold for kurtosis showed that the sensitivity was 0.74, the specificity was 0.76, the accuracy was 0.75, the PPV was 0.74, the NPV was 0.81, and the Kappa was 0.50.
Study limitations in this research included different image borders, fractal dimensions, classification models, and increased sample size could yield higher value for reference in imaging diagnosis. Image edge detection could be performed using points, lines, and edges, which could be applied in detecting local pixel changes. LoG, Sobel edge detection, and Canny edge detection are methods for image segregation. Other than box-counting, the self-similar dimension, Hausdorff dimension, Fourier transform, wavelet transform, and other methods could be utilized to calculate fractal dimensions. Furthermore, experiments on prostheses can be performed to investigate the feasibility of different texture image processing methods (25).
In this study, only 85 cases were included, which is a relatively small number for statistical analysis. Continuous data collection could be performed to improve the accuracy of the study. Clinically, many medical imaging tools are available, including ultrasound, X-ray, MRI, positron emission tomography (PET), single-photon emission computed tomography, and CT. It is possible to perform texture analysis of the images generated by each of these types of imaging methods. If a texture-based CAD system can be developed, it could provide a reference for physicians (19-21).
In conclusion, in this research, we successfully exploited the mean of the fractal image and built a logistic regression model to classify malignant and benign B-mode ultrasound. Moreover, the quantitative analysis of texture images for the determination of malignant versus benign tumor is simple, feasible, reasonable, and accurate and could be employed as a reference for diagnosis when performing breast ultrasound texture analysis.
Acknowledgements
References
-
1.
Guo R, Lu G, Qin B, Fei B. Ultrasound imaging technologies for breast cancer detection and management: A review. Ultrasound Med Biol. 2018;44(1):37-70. [PubMed ID: 29107353]. [PubMed Central ID: PMC6169997]. https://doi.org/10.1016/j.ultrasmedbio.2017.09.012.
-
2.
Hooley RJ, Scoutt LM, Philpotts LE. Breast ultrasonography: State of the art. Radiology. 2013;268(3):642-59. [PubMed ID: 23970509]. https://doi.org/10.1148/radiol.13121606.
-
3.
Moon WK, Huang YS, Lo CM, Huang CS, Bae MS, Kim WH, et al. Computer-aided diagnosis for distinguishing between triple-negative breast cancer and fibroadenomas based on ultrasound texture features. Med Phys. 2015;42(6):3024-35. [PubMed ID: 26127055]. https://doi.org/10.1118/1.4921123.
-
4.
Lee SE, Moon JE, Rho YH, Kim EK, Yoon JH. Which supplementary imaging modality should be used for breast ultrasonography? Comparison of the diagnostic performance of elastography and computer-aided diagnosis. Ultrasonography. 2017;36(2):153-9. [PubMed ID: 27764908]. [PubMed Central ID: PMC5381849]. https://doi.org/10.14366/usg.16033.
-
5.
Chabi ML, Borget I, Ardiles R, Aboud G, Boussouar S, Vilar V, et al. Evaluation of the accuracy of a computer-aided diagnosis (CAD) system in breast ultrasound according to the radiologist's experience. Acad Radiol. 2012;19(3):311-9. [PubMed ID: 22310523]. https://doi.org/10.1016/j.acra.2011.10.023.
-
6.
Daoud MI, Bdair TM, Al-Najar M, Alazrai R. A fusion-based approach for breast ultrasound image classification using multiple-ROI texture and morphological analyses. Comput Math Methods Med. 2016;2016:6740956. [PubMed ID: 28127383]. [PubMed Central ID: PMC5227307]. https://doi.org/10.1155/2016/6740956.
-
7.
Sadeghi-Naini A, Suraweera H, Tran WT, Hadizad F, Bruni G, Rastegar RF, et al. Breast-lesion characterization using textural features of quantitative ultrasound parametric maps. Sci Rep. 2017;7(1):13638. [PubMed ID: 29057899]. [PubMed Central ID: PMC5651882]. https://doi.org/10.1038/s41598-017-13977-x.
-
8.
Ardakani AA, Gharbali A, Mohammadi A. Classification of breast tumors using sonographic texture analysis. J Ultrasound Med. 2015;34(2):225-31. [PubMed ID: 25614395]. https://doi.org/10.7863/ultra.34.2.225.
-
9.
Sannachi L, Gangeh M, Tadayyon H, Sadeghi-Naini A, Gandhi S, Wright FC, et al. Response monitoring of breast cancer patients receiving neoadjuvant chemotherapy using quantitative ultrasound, texture, and molecular features. PLoS One. 2018;13(1). e0189634. [PubMed ID: 29298305]. [PubMed Central ID: PMC5751990]. https://doi.org/10.1371/journal.pone.0189634.
-
10.
Morris MA, Ring CM, Managuli R, Saboury B, Mehregan D, Siegel E, et al. Feature analysis of ultrasound elastography image for quantitative assessment of cutaneous carcinoma. Skin Res Technol. 2018;24(2):242-7. [PubMed ID: 29067713]. https://doi.org/10.1111/srt.12420.
-
11.
Popescu DP, Flueraru C, Mao Y, Chang S, Sowa MG. Signal attenuation and box-counting fractal analysis of optical coherence tomography images of arterial tissue. Biomed Opt Express. 2010;1(1):268-77. [PubMed ID: 21258464]. [PubMed Central ID: PMC3005165]. https://doi.org/10.1364/boe.1.000268.
-
12.
King RD, George AT, Jeon T, Hynan LS, Youn TS, Kennedy DN, et al. Characterization of atrophic changes in the cerebral cortex using fractal dimensional analysis. Brain Imaging Behav. 2009;3(2):154-66. [PubMed ID: 20740072]. [PubMed Central ID: PMC2927230]. https://doi.org/10.1007/s11682-008-9057-9.
-
13.
Gomez W, Pereira WC, Infantosi AF. Analysis of co-occurrence texture statistics as a function of gray-level quantization for classifying breast ultrasound. IEEE Trans Med Imaging. 2012;31(10):1889-99. [PubMed ID: 22759441]. https://doi.org/10.1109/TMI.2012.2206398.
-
14.
Abdel-Nasser M, Melendez J, Moreno A, Omer OA, Puig D. Breast tumor classification in ultrasound images using texture analysis and super-resolution methods. Eng Appl Artif Intell. 2017;59:84-92. https://doi.org/10.1016/j.engappai.2016.12.019.
-
15.
Liao YY, Wu JC, Li CH, Yeh CK. Texture feature analysis for breast ultrasound image enhancement. Ultrason Imaging. 2011;33(4):264-78. [PubMed ID: 22518956]. https://doi.org/10.1177/016173461103300405.
-
16.
Alamudun F, Paulus P, Yoon HJ, Tourassi G. Modeling sequential context effects in diagnostic interpretation of screening mammograms. J Med Imaging (Bellingham). 2018;5(3):31408. [PubMed ID: 29564370]. [PubMed Central ID: PMC5858736]. https://doi.org/10.1117/1.JMI.5.3.031408.
-
17.
Djuricic GJ, Radulovic M, Sopta JP, Nikitovic M, Milosevic NT. Fractal and gray level cooccurrence matrix computational analysis of primary osteosarcoma magnetic resonance images predicts the chemotherapy response. Front Oncol. 2017;7:246. [PubMed ID: 29098142]. [PubMed Central ID: PMC5653945]. https://doi.org/10.3389/fonc.2017.00246.
-
18.
Baneva Y, Bliznakova K, Cockmartin L, Marinov S, Buliev I, Mettivier G, et al. Evaluation of a breast software model for 2D and 3D X-ray imaging studies of the breast. Phys Med. 2017;41:78-86. [PubMed ID: 28483356]. https://doi.org/10.1016/j.ejmp.2017.04.024.
-
19.
Fleury EFC, Gianini AC, Marcomini K, Oliveira V. The feasibility of classifying breast masses using a computer-assisted diagnosis (CAD) system based on ultrasound elastography and BI-RADS lexicon. Technol Cancer Res Treat. 2018;17:1533033818763500. [PubMed ID: 29551088]. [PubMed Central ID: PMC5882047]. https://doi.org/10.1177/1533033818763461.
-
20.
Xiao Y, Zeng J, Niu L, Zeng Q, Wu T, Wang C, et al. Computer-aided diagnosis based on quantitative elastographic features with supersonic shear wave imaging. Ultrasound Med Biol. 2014;40(2):275-86. [PubMed ID: 24268454]. https://doi.org/10.1016/j.ultrasmedbio.2013.09.032.
-
21.
Park HJ, Kim SM, La Yun B, Jang M, Kim B, Jang JY, et al. A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of breast masses on ultrasound: Added value for the inexperienced breast radiologist. Medicine (Baltimore). 2019;98(3). e14146. [PubMed ID: 30653149]. [PubMed Central ID: PMC6370030]. https://doi.org/10.1097/MD.0000000000014146.
-
22.
Wang X, Guo Y, Wang Y. Automatic detection of regions of interest in breast ultrasound images based on local phase information. Biomed Mater Eng. 2015;26 Suppl 1:S1265-73. [PubMed ID: 26405886]. https://doi.org/10.3233/BME-151424.
-
23.
Wu WJ, Lin SW, Moon WK. Combining support vector machine with genetic algorithm to classify ultrasound breast tumor images. Comput Med Imaging Graph. 2012;36(8):627-33. [PubMed ID: 22939834]. https://doi.org/10.1016/j.compmedimag.2012.07.004.
-
24.
Chen DR, Huang YL, Lin SH. Computer-aided diagnosis with textural features for breast lesions in sonograms. Comput Med Imaging Graph. 2011;35(3):220-6. [PubMed ID: 21131178]. https://doi.org/10.1016/j.compmedimag.2010.11.003.
-
25.
Sannachi L, Gangeh M, Tadayyon H, Gandhi S, Wright FC, Slodkowska E, et al. Breast cancer treatment response monitoring using quantitative ultrasound and texture analysis: Comparative analysis of analytical models. Transl Oncol. 2019;12(10):1271-81. [PubMed ID: 31325763]. [PubMed Central ID: PMC6639683]. https://doi.org/10.1016/j.tranon.2019.06.004.
reply