Medical Image Fusion Based on Deep Convolutional Neural Network

Authors

Abolfazl Sedighi1,*, Alireza NikravanshalmaniAlireza Nikravanshalmani ORCID1, Madjid KhalilianMadjid  Khalilian ORCID1
1Karaj Branch, Islamic Azad University, Karaj, Iran
*Corresponding Author: Karaj Branch, Islamic Azad University, Karaj, Iran. Email: [email protected]

IJ Radiology:Vol. 16, issue Special Issue; e99156
Published online:Dec 08, 2019
Article type:Abstract
Received:Oct 26, 2019
Accepted:Dec 08, 2019
How to Cite:Sedighi A, Nikravanshalmani A, Khalilian M. Medical Image Fusion Based on Deep Convolutional Neural Network. I J Radiol. 2019;16(Special Issue):e99156. doi: https://doi.org/10.5812/iranjradiol.99156

Abstract

Background:

Medical image fusion plays an important role in helping doctors for effective diagnosis and treatment.

Objectives:

The purpose of image fusion is to combine information from various different medical modalities into a single image with preserving salient features and details of the source image.

Methods:

In this article, we present an approach for fusion MRI and CT images based on a deep convolutional neural network with four layers that was trained with medical images. In the beginning, images were decomposed to high and low frequencies by applied nonsubsampled shearlet transform (NSST). Then, for high-frequency sub-band, we used deep convolution neural networks for extracting feature maps. Low-frequency sub-band became fusion using the law of local energy fusion and in the end, the fused images were reconstructed by reverse NSST.

Results:

Experimental results indicated that the proposed scheme had better functionality in terms of image preservation, visual quality, and subjective and objective assessment.

Conclusion:

In this work, a medical image fusion method based on deep convolutional neural networks was proposed. The main novelty of this approach was the use of a deep convolutional neural network with four layers that was trained to extract source image features. To achieve good results, we used the nonsubsampled shearlet transform technique for multi-scale decomposition. Based on the experimental results, the proposed method achieved the best fusion performance.

Copyright

Copyright © 2019, Author(s). This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.

Similar Articles

13
Feb
2022
Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas

Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas

Zeinab Khazaee,
Mostafa Langarizadeh,
Mohammad Ebrahim Shiri Ahmadabadi

Khazaee Z, Langarizadeh M, Shiri Ahmadabadi ME. Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas. Int J Cancer Manag. 2022;15(1):e120638. doi: https://doi.org/10.5812/ijcm.120638

23
Jan
2019
Improvement of MRI Brain Image Segmentation Using Fuzzy Unsupervised Learning

Improvement of MRI Brain Image Segmentation Using Fuzzy Unsupervised Learning

Keyvan Saneipour,
Mojtaba Mohammadpoor

Saneipour K, Mohammadpoor M. Improvement of MRI Brain Image Segmentation Using Fuzzy Unsupervised Learning. I J Radiol. 2019;16(2):e69063. doi: https://doi.org/10.5812/iranjradiol.69063

31
Jul
2025
Enhanced Diagnosis of Chest X-Ray Using Hybrid Deep Learning Models and Feature Selection Techniques

Enhanced Diagnosis of Chest X-Ray Using Hybrid Deep Learning Models and Feature Selection Techniques

Ahsan Aziz,
Awais Khan,
Yunyoung Nam,
Yongwon Cho

Aziz A, Khan A, Nam Y, Cho Y. Enhanced Diagnosis of Chest X-Ray Using Hybrid Deep Learning Models and Feature Selection Techniques. I J Radiol. 2025;22(3):e163605. doi: https://doi.org/10.5812/iranjradiol-163605

10
Dec
2019

Automatic Myocardial Segmentation in Four-Chamber View Echocardiography Images

Shakiba Moradi,
Mostafa Ghelich Oghli,
Azin Alizadehasl,
Ali Shabanzadeh

Moradi S, Ghelich Oghli M, Alizadehasl A, Shabanzadeh A. Automatic Myocardial Segmentation in Four-Chamber View Echocardiography Images. I J Radiol. 2019;16(Special Issue):e99139. doi: https://doi.org/10.5812/iranjradiol.99139

25
Apr
2022
Microcalcification Detection in Mammograms Using Deep Learning

Microcalcification Detection in Mammograms Using Deep Learning

Mahmoud Shiri Kahnouei,
Masoumeh Giti,
Mohammad Ali Akhaee,
Ali Ameri

Shiri Kahnouei M, Giti M, Akhaee MA, Ameri A. Microcalcification Detection in Mammograms Using Deep Learning. I J Radiol. 2022;19(1):e120758. doi: https://doi.org/10.5812/iranjradiol-120758

More by these authors

Abolfazl SedighiPubMedScholar
Alireza NikravanshalmaniPubMedScholar
Madjid KhalilianPubMedScholar
Share
Cited by
Metrics