Medical Image Fusion Based on Deep Convolutional Neural Network

Author(s):
Abolfazl  SedighiAbolfazl Sedighi1,*, Alireza NikravanshalmaniAlireza NikravanshalmaniAlireza Nikravanshalmani ORCID1, Madjid  KhalilianMadjid KhalilianMadjid  Khalilian ORCID1
1Karaj Branch, Islamic Azad University, Karaj, Iran

IJ Radiology:Vol. 16, issue Special Issue; e99156
Published online:Dec 08, 2019
Article type:Abstract
Received:Oct 26, 2019
Accepted:Dec 08, 2019
How to Cite:Sedighi A, Nikravanshalmani A, Khalilian M. Medical Image Fusion Based on Deep Convolutional Neural Network. I J Radiol. 2019;16(Special Issue):e99156. doi: https://doi.org/10.5812/iranjradiol.99156

Abstract

Background:

Medical image fusion plays an important role in helping doctors for effective diagnosis and treatment.

Objectives:

The purpose of image fusion is to combine information from various different medical modalities into a single image with preserving salient features and details of the source image.

Methods:

In this article, we present an approach for fusion MRI and CT images based on a deep convolutional neural network with four layers that was trained with medical images. In the beginning, images were decomposed to high and low frequencies by applied nonsubsampled shearlet transform (NSST). Then, for high-frequency sub-band, we used deep convolution neural networks for extracting feature maps. Low-frequency sub-band became fusion using the law of local energy fusion and in the end, the fused images were reconstructed by reverse NSST.

Results:

Experimental results indicated that the proposed scheme had better functionality in terms of image preservation, visual quality, and subjective and objective assessment.

Conclusion:

In this work, a medical image fusion method based on deep convolutional neural networks was proposed. The main novelty of this approach was the use of a deep convolutional neural network with four layers that was trained to extract source image features. To achieve good results, we used the nonsubsampled shearlet transform technique for multi-scale decomposition. Based on the experimental results, the proposed method achieved the best fusion performance.


Crossmark
Crossmark
Checking
Share on
Cited by
Metrics

Ordering Reprints

Articles are published under the Creative Commons license stated on each article. No permission or royalty fee is required for uses permitted by that license. CCC handles optional bulk and customized reprint orders. Any quotation covers production and delivery services only, not copyright permission. > Request Reprints from CCC 

Search Relations

Author(s):

Related Articles