Abstract
Keywords
Artificial Intelligence Deep Learning Medical Imaging Neurodegenerative Diseases
1. Background
Neurological disorders take a heavy toll on public health. The Global Burden of Diseases (2010) classified the following diseases as neurological disorders: Alzheimer’s disease (AD, also known as dementia), Parkinson’s disease (PD), multiple sclerosis (MS), epilepsy, migraine, and tension-type headache (TTH) (1). Neurodegenerative diseases, a class of neurological disorders, occur when the neurons of the central nervous system get damaged or die as a result of the disease, leading to severe disabilities of the individual and, ultimately, their death. Neurodegenerative diseases affect millions of people worldwide but are mainly reported in the elderly. Health care professionals, such as radiologists and clinicians, must carry out a detailed interpretation of magnetic resonance imaging (MRI) in clinical practice. However, due to the large number of MRIs, interpretations are time-consuming and easily affected by human experts’ biases and potential fatigue. As a result, beginning in the early 1980s, doctors and researchers began to use computer-assisted diagnosis (CAD) structures to analyze medical images and boost their effectiveness (2).
Early detection and treatment of neurodegenerative diseases can significantly slow their development. Computational approaches aimed at diagnosing and monitoring respective diseases and CAD systems can significantly assist in increasing the chance of survival. They are also capable of extracting important features describing patterns from the data and subsequently play a key role in medical image analysis (2-4). Recent advances in artificial intelligence (AI) can be a major help in achieving the aforementioned goals. Artificial intelligence can automate image analysis and plays a major role in diagnosing and examining these diseases, allowing doctors to make fast and accurate treatment recommendations (5).
The progressive loss of the structure/functionality of neurons or neurodegeneration is the root cause of neurodegenerative diseases. Cell death may result from such neuronal injury. Neurodegeneration in the nervous system can be observed in various scales, ranging from molecular abnormalities to systemic failures. These illnesses are incurable because there is no known way of stopping progressive degeneration; however, early diagnosis and treatment of neurodegenerative diseases can significantly slow their progression (6, 7).
Alzheimer’s disease is the most widely observed neurodegenerative disease, accounting for 60% - 70% of dementia cases. Its symptoms are linked to a steady decline in brain function. It can impair memory, reasoning, and other mental abilities and is currently impossible to cure. The protein fragment β-amyloid (which builds up as plaques outside of neurons in the brain) and twisted tau protein strands (which form tangles inside neurons) are some of its pathological characteristics (8). Several studies have also found an accumulation of alpha-synuclein or Lewy-related pathology in more than 50% of post-mortem examinations of AD brains (9).
The second most common neurodegenerative disease is PD. it is a chronic condition that affects both the nervous system and the body parts that are under the control of the nervous system. The symptoms appear gradually, and the most common of them is tremors. The disorder can also cause the slowing or general difficulty of movement. The buildup of misfolded alpha-synuclein and the degeneration of dopaminergic neurons in the substantia nigra are 2 significant characteristics of PD. This disrupts signal transduction pathways in the brain, resulting in PD symptoms. As the condition worsens, alpha-synuclein misfolding and accumulation, abnormal dopamine metabolism, oxidative stress, and neuronal death emphasize one another (10).
The central nervous system disease known as MS is a long-term, inflammatory, demyelinating condition. It is a common root of neurological disability in young adults. Multiple sclerosis is a diverse, multifactorial, immune-mediated illness brought on by intricate gene-environment interactions. Demyelinating lesions that develop over time in the white matter and grey matter of the brain and spinal cord are the pathological hallmarks of MS (11).
Today, diagnostic imaging is a helpful resource in medicine. Magnetic resonance imaging, positron emission tomography (PET), and other imaging modalities are useful for noninvasively mapping a subject’s anatomical brain structure. These technologies have significantly increased medical and scientific knowledge of normal and malignant anatomy and are essential in diagnosis and treatment planning. Advancements in medical imaging provided various imaging modalities to detect and diagnose neurodegenerative diseases (12).
Magnetic resonance imaging is an imaging technique that generates images by observing the behavior of atomic nuclei with non-zero spins in a strong magnetic field (10). Currently, T1- and T2-weighted images are the most used MRI sequences available. T1-weighted scans are obtained using the short echo time (TE) and repetition time (TR) recorded. The main determining factors of the image’s brightness and contrast are the T1 properties of the imaged tissue. T2-weighted images, on the other hand, are generated from longer TE and TR (13).
Positron emission tomography is another imaging technique. It is a nuclear imaging technique that relies on the decay characteristics of positron-emitting radionuclides, such as fluorine-18 (18F, t1/2 = 109 min), carbon-11 (11C, t1/2 = 20 min), or oxygen-15 (15O, t1/2 = 2 min). The PET imaging of beta-amyloid plaques will significantly improve the diagnosis of AD (10, 14). Positron emission tomography is a noninvasive in vivo imaging technique that can measure target expression and drug occupancies in the presence of a suitable tracer. As a result, scientists from all over the world have been working to create innovative α-syn PET tracers that will revolutionize imaging techniques for neurodegenerative disorders (15).
The exponentially increasing flow of data opened the door to a new era of AI algorithms in every technological endeavor, including medicine and radiology. However, the current success of AI in a few elevated applications has obscured decades of advances in the development of computational technology for medical image processing (16).
2. Objectives
AI and, in particular, techniques like deep learning have recently produced outstanding results with “big data” in many diverse domains by reaping the benefits of the ever-increasing quantity of labeled digital data available in every area of technological activity (17). Deep learning uncovers informative representations automatically without the technical understanding of domain experts, allowing non-experts to utilize the deep learning-based techniques effectively. As a result, deep learning has rapidly become a preferred methodology for medical image analysis in recent decades (17, 18). Thus, in this review, we went over the 3 important and frequently used techniques: Classification, image segmentation, and image generation.
3. Methods
3.1. Classification
The most common learning method in AI-based applications is supervised learning, in which the classification model is trained by presenting labeled training data to the model. The learning system’s task is then to find a relationship that maps each input of the training sample into an output (the label). In medical science, input often includes medical images, while the output can be anything from the diagnosis of a disease to a patient’s condition (19). A feature extraction step is often done before the training phase to speed up the training and improve accuracy. Ahmed et al. suggested using biomarkers derived from images to identify AD and mild cognitive impairment (20). They extracted visual features from structural MRI to differentiate and classify Alzheimer’s and mild cognitive impairment patients (20).
Automated gait deficit diagnosis and severity were made possible by AI across several symptomatic stages of PD. Varrecchia et al. discovered a small number of features that differentiates PD from healthy control and distinguishes gait patterns between different Hoehn and Yahr stages (21, 22).
3.2. Image Segmentation
Image segmentation is to partition an image into mutually exclusive regions that are homogeneous in some way, such as intensity or texture (23). Although atrophy is the most common biomarker used to diagnose epilepsy, a recent study has shown that cerebral gray matter atrophy can also be seen on structural MRI in neurodegenerative diseases (24). It has been discovered to correlate with the neurodegenerative mechanisms that underlie the cognitive impairment caused by PD (25).
A deep learning algorithm, called “DeepnCCA,” was created by Platten et al. and is tailored to normalize the segmentation of the corpus callosum in MS patients (26). Its output was highly comparable to traditional manual segmentations. Further shape analysis revealed a correlation between a thinner and more angular corpus callosum and a higher level of clinical disability (26). Similar to previous research, Brusini et al. presented a completely automated deep learning-based corpus callosum segmentation tool designed and developed for modern MS imaging with clinical correlations similar to computationally intensive alternatives (27). They utilized U-Net architectures to automatically segment the corpus callosum from a single midsagittal slice input (28).
To diagnose and follow several clinical conditions, including AD, the segmentation of the hippocampus (HC) in MRI is a crucial step. Liu and Yan proposed a semi-automatic model by combining a deep belief network and the lattice Boltzmann method (29). Coronado et al. trained and assessed a 3D convolutional neural network to segment gadolinium-enhancing lesions using a sizable cohort of MRI data from patients with MS (30). An extensive dataset evaluation revealed excellent performance, with a high segmentation accuracy measured by the Dice similarity score of 0.77 (30).
3.3. Image Generation
Following the bloom of deep learning in the early 2010s, meaningful advances in generative models were made. Such models are mainly developed to synthesize parts of or the whole of images that had not existed prior to the synthetization or were not available in high resolution. One well-known generative model that has been the focus of much attention since its introduction in 2016 is a generative adversarial network. The medical applications of such generative models can be classified into 3 main categories: Modality transformation, image reconstruction, and super-resolution (18).
Due to the advantages and challenges of each imaging method available today, no particular method perfectly fits all the experiment requirements. One example of this trade-off of advantages and disadvantages is the high spatial resolution attainable by functional MRI (fMRI) while lacking temporal resolution (31). To address this trade-off, there have been attempts at the modality transformation of medical images: Transforming the images obtained by one imaging modality to another. The feasibility of reaching useful modality transformation (or image translation, as in some resources) depends upon the chosen initial and target modalities, as well as the availability of sufficient data of adequate quality. One example of a possibly useful transformation is using MRI to generate synthesized computed tomography (CT) images (32). A noteworthy recent work conducted in this line of research is a study where the end goal was to synthesize PET images from MR images to diagnose different AD stages (33). This task was done using a novel 3D self-attention conditional GAN (SCGAN) trained on the ADNI3 data. The synthetic PET images were reported to be the most similar to the corresponding real images compared with many other alternative generative architectures, both qualitatively and based on 3 chosen metrics (i.e., normalized root-mean-squared error, peak signal-to-noise ratio, and structural similarity). Despite being similar to real images, the synthesized PET images reportedly generally lacked the necessary information to accurately determine the AD stage (34).
As a result of the various sources of noise present in most brain imaging methods, parts (or all) of recorded medical images are prone to be of inadequate quality and, therefore, not useful in diagnosis tasks. In the cases of images with noisy or missing sections, image reconstruction can be used to obtain usable images containing all essential sections. A recent example of published work in the field of image reconstruction is done by Korkmaz et al., which used generative vision transformers to reconstruct MR images (35).
To make low-resolution images useful, attempts at improving the resolution have been made under the term “Super Resolution,” where the model typically receives a low-resolution input image and outputs the same image in a higher resolution. The previously introduced SCGAN model was also used for super-resolution tasks, which was reported successful (33). A useful application of such models is speeding up and lowering imaging costs, as the quality can be improved later using these models (36).
4. Conclusions
In this review, we explored and investigated some of the novel AI algorithms and state-of-the-art deep neural networks for the monitoring and disorder diagnosis of medical images of patients, with a strong emphasis on the 3 most common neurodegenerative disorders: AD, PD, and MS. Numerous brain microstructural changes in neurodegenerative patients have already been detected during the past decade. We demonstrated the advantages of deep learning methods and their feasibility in improving clinical practice in the literature. Deep learning is the case for some of the papers cited in this manuscript, including evidence for applying the U-Net model for corpus callosum segmentation or Generative adversarial networks for image synthesis and reconstruction.
References
-
1.
Stovner LJ, Hoff JM, Svalheim S, Gilhus NE. Neurological disorders in the Global Burden of Disease 2010 study. Acta Neurol Scand Suppl. 2014;(198):1-6. [PubMed ID: 24588499]. https://doi.org/10.1111/ane.12229.
-
2.
Zhang L, Wang M, Liu M, Zhang D. A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis. Front Neurosci. 2020;14:779. [PubMed ID: 33117114]. [PubMed Central ID: PMC7578242]. https://doi.org/10.3389/fnins.2020.00779.
-
3.
Wernick MN, Yang Y, Brankov JG, Yourganov G, Strother SC. Machine Learning in Medical Imaging. IEEE Signal Process Mag. 2010;27(4):25-38. [PubMed ID: 25382956]. [PubMed Central ID: PMC4220564]. https://doi.org/10.1109/MSP.2010.936730.
-
4.
Li Y, Meng F, Shi J; Alzheimer's Disease Neuroimaging Initiative. Learning using privileged information improves neuroimaging-based CAD of Alzheimer's disease: a comparative study. Med Biol Eng Comput. 2019;57(7):1605-16. [PubMed ID: 31028606]. https://doi.org/10.1007/s11517-019-01974-3.
-
5.
Razzak MI, Naz S, Zaib A. Deep Learning for Medical Image Processing: Overview, Challenges and the Future. In: Dey N, Ashour AS, Borra S, editors. Classification in BioApps. 2018. p. 323-50. https://doi.org/10.1007/978-3-319-65981-7_12.
-
6.
Stephenson J, Nutma E, van der Valk P, Amor S. Inflammation in CNS neurodegenerative diseases. Immunology. 2018;154(2):204-19. [PubMed ID: 29513402]. [PubMed Central ID: PMC5980185]. https://doi.org/10.1111/imm.12922.
-
7.
Singh A, Kukreti R, Saso L, Kukreti S. Oxidative Stress: A Key Modulator in Neurodegenerative Diseases. Molecules. 2019;24(8). [PubMed ID: 31013638]. [PubMed Central ID: PMC6514564]. https://doi.org/10.3390/molecules24081583.
-
8.
Yao Y. For Early Diagnosis of Neurodegenerative Diseases: Acting of Biomarkers. Am J Biomed Sci & Res. 2020;11(2):216-8. https://doi.org/10.34297/ajbsr.2020.11.001628.
-
9.
Twohig D, Nielsen HM. alpha-synuclein in the pathophysiology of Alzheimer's disease. Mol Neurodegener. 2019;14(1):23. [PubMed ID: 31186026]. [PubMed Central ID: PMC6558879]. https://doi.org/10.1186/s13024-019-0320-x.
-
10.
Bidesi NSR, Vang Andersen I, Windhorst AD, Shalgunov V, Herth MM. The role of neuroimaging in Parkinson's disease. J Neurochem. 2021;159(4):660-89. [PubMed ID: 34532856]. [PubMed Central ID: PMC9291628]. https://doi.org/10.1111/jnc.15516.
-
11.
Filippi M, Bar-Or A, Piehl F, Preziosa P, Solari A, Vukusic S, et al. Multiple sclerosis. Nat Rev Dis Primers. 2018;4(1):43. [PubMed ID: 30410033]. https://doi.org/10.1038/s41572-018-0041-4.
-
12.
Pham DL, Xu C, Prince JL. Current methods in medical image segmentation. Annu Rev Biomed Eng. 2000;2:315-37. [PubMed ID: 11701515]. https://doi.org/10.1146/annurev.bioeng.2.1.315.
-
13.
Hamlin SA, Henry TS, Little BP, Lerakis S, Stillman AE. Mapping the future of cardiac MR imaging: case-based review of T1 and T2 mapping techniques. Radiographics. 2014;34(6):1594-611. [PubMed ID: 25310419]. https://doi.org/10.1148/rg.346140030.
-
14.
Boutet A, Madhavan R, Elias GJB, Joel SE, Gramer R, Ranjan M, et al. Predicting optimal deep brain stimulation parameters for Parkinson's disease using functional MRI and machine learning. Nat Commun. 2021;12(1):3043. [PubMed ID: 34031407]. [PubMed Central ID: PMC8144408]. https://doi.org/10.1038/s41467-021-23311-9.
-
15.
Korat S, Bidesi NSR, Bonanno F, Di Nanni A, Hoang ANN, Herfert K, et al. Alpha-Synuclein PET Tracer Development-An Overview about Current Efforts. Pharmaceuticals (Basel). 2021;14(9). [PubMed ID: 34577548]. [PubMed Central ID: PMC8466155]. https://doi.org/10.3390/ph14090847.
-
16.
Savadjiev P, Chong J, Dohan A, Vakalopoulou M, Reinhold C, Paragios N, et al. Demystification of AI-driven medical image interpretation: past, present and future. Eur Radiol. 2019;29(3):1616-24. [PubMed ID: 30105410]. https://doi.org/10.1007/s00330-018-5674-x.
-
17.
LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436-44. [PubMed ID: 26017442]. https://doi.org/10.1038/nature14539.
-
18.
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial networks. Commun ACM. 2020;63(11):139-44. https://doi.org/10.1145/3422622.
-
19.
Bishop C, Nasrabadi NM. Pattern recognition and machine learning. 4. New York, USA: Springer; 2006.
-
20.
Ahmed OB, Benois-Pineau J, Allard M, Catheline G, Amar C. Recognition of Alzheimer's disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning. Neurocomputing. 2017;220:98-110. https://doi.org/10.1016/j.neucom.2016.08.041.
-
21.
Varrecchia T, Castiglia SF, Ranavolo A, Conte C, Tatarelli A, Coppola G, et al. An artificial neural network approach to detect presence and severity of Parkinson's disease via gait parameters. PLoS One. 2021;16(2). e0244396. [PubMed ID: 33606730]. [PubMed Central ID: PMC7894951]. https://doi.org/10.1371/journal.pone.0244396.
-
22.
Hoehn MM, Yahr MD. Parkinsonism: onset, progression, and mortality. 1967. Neurology. 1998;50(2):318 and 16 pages following. [PubMed ID: 9484345]. https://doi.org/10.1212/wnl.50.2.318.
-
23.
Haralick RM, Shapiro LG. Image segmentation techniques. Computer Vision, Graphics, and Image Processing. 1985;29(1):100-32. https://doi.org/10.1016/s0734-189x(85)90153-7.
-
24.
Moghaddam HS, Aarabi MH, Mehvari-Habibabadi J, Sharifpour R, Mohajer B, Mohammadi-Mobarakeh N, et al. Distinct patterns of hippocampal subfield volume loss in left and right mesial temporal lobe epilepsy. Neurol Sci. 2021;42(4):1411-21. [PubMed ID: 32783160]. https://doi.org/10.1007/s10072-020-04653-6.
-
25.
Pan PL, Shi HC, Zhong JG, Xiao PR, Shen Y, Wu LJ, et al. Gray matter atrophy in Parkinson's disease with dementia: evidence from meta-analysis of voxel-based morphometry studies. Neurol Sci. 2013;34(5):613-9. [PubMed ID: 23184330]. https://doi.org/10.1007/s10072-012-1250-3.
-
26.
Platten M, Brusini I, Andersson O, Ouellette R, Piehl F, Wang C, et al. Deep Learning Corpus Callosum Segmentation as a Neurodegenerative Marker in Multiple Sclerosis. J Neuroimaging. 2021;31(3):493-500. [PubMed ID: 33587820]. https://doi.org/10.1111/jon.12838.
-
27.
Brusini I, Platten M, Ouellette R, Piehl F, Wang C, Granberg T. Automatic deep learning multicontrast corpus callosum segmentation in multiple sclerosis. J Neuroimaging. 2022;32(3):459-70. [PubMed ID: 35083815]. [PubMed Central ID: PMC9304261]. https://doi.org/10.1111/jon.12972.
-
28.
Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Munich, Germany. 2015. p. 234-41.
-
29.
Liu Y, Yan Z. A Combined Deep-Learning and Lattice Boltzmann Model for Segmentation of the Hippocampus in MRI. Sensors (Basel). 2020;20(13). [PubMed ID: 32605230]. [PubMed Central ID: PMC7374374]. https://doi.org/10.3390/s20133628.
-
30.
Coronado I, Gabr RE, Narayana PA. Deep learning segmentation of gadolinium-enhancing lesions in multiple sclerosis. Mult Scler. 2021;27(4):519-27. [PubMed ID: 32442043]. [PubMed Central ID: PMC7680286]. https://doi.org/10.1177/1352458520921364.
-
31.
Glover GH. Overview of functional magnetic resonance imaging. Neurosurg Clin N Am. 2011;22(2):133-9. vii. [PubMed ID: 21435566]. [PubMed Central ID: PMC3073717]. https://doi.org/10.1016/j.nec.2010.11.001.
-
32.
Nie D, Trullo R, Lian J, Wang L, Petitjean C, Ruan S, et al. Medical Image Synthesis with Deep Convolutional Adversarial Networks. IEEE Trans Biomed Eng. 2018;65(12):2720-30. [PubMed ID: 29993445]. [PubMed Central ID: PMC6398343]. https://doi.org/10.1109/TBME.2018.2814538.
-
33.
Lan H, Toga AW, Sepehrband F; Alzheimer Disease Neuroimaging Initiative. Three-dimensional self-attention conditional GAN with spectral normalization for multimodal neuroimaging synthesis. Magn Reson Med. 2021;86(3):1718-33. [PubMed ID: 33961321]. [PubMed Central ID: PMC9070032]. https://doi.org/10.1002/mrm.28819.
-
34.
Arbizu J, Festari C, Altomare D, Walker Z, Bouwman F, Rivolta J, et al. Clinical utility of FDG-PET for the clinical diagnosis in MCI. Eur J Nucl Med Mol Imaging. 2018;45(9):1497-508. [PubMed ID: 29704037]. https://doi.org/10.1007/s00259-018-4039-7.
-
35.
Korkmaz Y, Yurt M, Dar SUH, Özbey M, Cukur T. Deep MRI Reconstruction with Generative Vision Transformers. Machine Learning for Medical Image Reconstruction. Strasbourg, France. 2021. p. 54-64.
-
36.
Chen Y, Schonlieb C, Lio P, Leiner T, Dragotti PL, Wang G, et al. AI-Based Reconstruction for Fast MRI—A Systematic Review and Meta-Analysis. Proc IEEE. 2022;110(2):224-45. https://doi.org/10.1109/jproc.2022.3141367.