Performance Analysis of Medical Image Fusion Using Wavelet Technique

A denoising method for medical images through hybrid technique is presented in this paper. The hybrid technique is the combination of wavelet and neural network (WaveNet). Proposed algorithm has been validated through benchmark image, and medical images both are degraded by the variety of noise density through Gaussian noise and visual property. The performances of denoised images are also analyzed with wavelet techniques and compare the results with proposed technique. The proposed strategy is developed in MATLAB platform. Simulation results are evidence for the proposed workKeywordsWaveletNeural networkDenoisingEnhancement

Image fusion is the process of gathering all the important information of multiple images into a single fused image. It is used in many fields like medical, military, remote sensing etc... Image fusion in a medical field is extensively used by physicians for analysis and treatment, as the fused image contains complementary features present in different medical images obtained from imaging devices. The wave atom transform based medical image fusion is proposed as the potential capabilities of wave atoms have been exploded in many applications like image denoising, fingerprint identification, compression etc. Medical image techniques became important tool for medical diagnosis and treatment. Medical images of different modalities such as MRI, CT, PET, SPECT provide information in a limited domain. In medical resources, MRI and CT images contain structural information whereas PET and SPECT images contain functional Information. Thus, single modality does not provide complete and accurate information, both structural as well as functional information is required. So far, many medical image fusion methods have been developed. The easiest way to perform image fusion is to perform weighted average of input images pixel by pixel. But this method produces side effects such as artifacts & contrast reduction. The proposed method is experimented on various medical images and compared with recent state of fusion methods. Results prove that images obtained from proposed method have better clarity and enhanced information and are practically more helpful for better treatment and quick analysis.

Wavelet transforms have emerged as a powerful tool in image fusion. However, the study and analysis of medical image fusion is still a challenging area of research. Therefore, in this paper, we propose a multiscale fusion of multimodal medical images in wavelet domain. Fusion of medical images has been performed at multiple scales varying from minimum to maximum level using maximum selection rule which provides more flexibility and choice to select the relevant fused images. The experimental analysis of the proposed method has been performed with several sets of medical images. Fusion results have been evaluated subjectively and objectively with existing state-of-the-art fusion methods which include several pyramid- and wavelet-transform-based fusion methods and principal component analysis (PCA) fusion method. The comparative analysis of the fusion results has been performed with edge strength (Q), mutual information (MI), entropy (E), standard deviation (SD), blind structural similarity index metric (BSSIM), spatial frequency (SF), and average gradient (AG) metrics. The combined subjective and objective evaluations of the proposed fusion method at multiple scales showed the effectiveness and goodness of the proposed approach.

Nowadays, there are a lot of medical images and their numbers are increasing day by day. These medical images are stored in the large database. To minimize the redundancy and optimize the storage capacity of images, medical image fusion is used. The main aim of medical image fusion is to combine complementary information from multiple imaging modalities (e.g. CT, MRI, PET, etc.) of the same scene. After performing medical image fusion, the resultant image is more informative and suitable for patient diagnosis. There are some fusion techniques which are described in this chapter to obtain fused image. This chapter presents two approaches to image fusion, namely spatial domain Fusion technique and transforms domain Fusion technique. This chapter describes Techniques such as Principal Component Analysis which is spatial domain technique and Discrete Wavelet Transform and Stationary Wavelet Transform which are Transform domain techniques. Performance metrics are implemented to evaluate the performance of image fusion algorithm.

Deep learning methods for medical image fusion: A review

The procedure of determining the initial values of the attitude angles (pitch, roll, and heading) is known as the alignment. Also, it is essential to align an inertial system before the start of navigation. Unless the inertial system is not aligned with the vehicle, the information provided by MEMS (microelectromechanical system) sensors is not useful for navigating the vehicle. At the moment MEMS gyroscopes have poor characteristics and it’s necessary to develop specific algorithms in order to obtain the attitude information of the object. Most of the standard algorithms for the attitude estimation are not suitable when using MEMS inertial sensors. The wavelet technique, the Kalman filter, and the quaternion are not new in navigation data processing. But the joint use of those techniques for MEMS sensor data processing can give some new results. In this paper the performance of a developed algorithm for the attitude estimation using MEMS IMU (inertial measurement unit) is tested. The obtained results are compared with the attitude output of another commercial GPS/IMU device by Xsens. The impact of MEMS sensor measurement noises on an alignment process is analysed. Some recommendations for the Kalman filter algorithm tuning to decrease standard deviation of the attitude estimation are given.

Background: During the two past decades, medical image fusion has become an essential part ofmodern medicine due to the availability of numerous imaging modalities (e.g., MRI, CT, SPECT,etc.). This paper presents a new medical image fusion algorithm based on PCA and DTCWT,which uses different fusion rules to obtain a new image containing more information than any ofthe input images.Methods: A new image fusion algorithm improves the visual quality of the fused image, based onfeature selection and Principal Component Analysis (PCA) in the Dual-Tree Complex WaveletTransform (DTCWT) domain. It is called Feature Selection with Principal Component Analysisand Dual-Tree Complex Wavelet Transform (FSPCA-DTCWT). Using different fusion rules in asingle algorithm result in correctly reconstructed image (fused image), this combination willproduce a new technique, which employs the advantages of each method separately. The DTCWTpresents good directionality since it considers the edge information in six directions and providesapproximate shift invariant. The main goal of PCA is to extract the most significant characteristics(represented by the wavelet coefficients) in order to improve the spatial resolution. The proposedalgorithm fuses the detailed wavelet coefficients of input images using features selection rule.Results: Several experiments have been conducted over different sets of multimodal medicalimages such as CT/MRI, MRA/T1-MRI. However, due to pages-limit on a paper, only results ofthree sets have been presented. The FSPCA-DTCWT algorithm is compared to recent fusionmethods presented in the literature (eight methods) in terms of visual quality and quantitativelyusing well-known fusion performance metrics (five metrics). Results showed that the proposedalgorithm outperforms the existing ones regarding visual and quantitative evaluations.Conclusion: This paper focuses on medical image fusion of different modalities. A novel imagefusion algorithm based on DTCWT to merge multimodal medical images has been proposed.Experiments have been performed using two different sets of multimodal medical images. Theresults show that the proposed fusion method significantly outperforms the recent fusiontechniques reported in the literature.

Image compression or fusion is the concept of identifying in-depth parameters of disease variables, and requires output images that preserve all the viable and prominent information that is gathered from source images without any further introduction of artifacts or unnecessary distortions. Measurement of images for prospective evaluation and image fusion depends on various performance measures, such as structure similarity index, standard deviation, edge detection, correlation coefficient and high pass correlation, average gradient, root-mean-square error, peak signal-to-noise ratio, entropy, etc. This review discusses various medical image fusion modalities focused on Principal Component Analysis, Independent Component Analysis, and wavelet transform. An introduction to the usefulness of such modalities is presented, suggesting safe hybrid modality combinations that could greatly enhance the image fusion process. Novel trends in medical image fusion techniques to achieve a perfectly desired, quality image, the future prospects of an ideal technique for medical imaging, and recognition of diseases are covered.

Medical imaging has played an essential role in medicine and disease diagnosis. Medical images from a single modality contain limited data about the organ. On the other hand, images from different modalities contain valuable structural and functio nal data about an organ. Medical image fusion (MIF) strategies integrate complementary information from two medical images captured using distinct modalities. This paper offered a new multimodal MIF approach using the parameter-adaptive pulse-coupled neural networks (PA-PCNN) within the non-subsampled contourlet transform (NSCT). The NSCT decomposes those images into high- and low-frequency bands. PA-PCNN combines those bands. The fused image was created using the inverse of the NSCT approach. To prove the proposed approach’s performance, we appoint a variety of medical images like computed tomography (CT), magnetic resonance imaging (MRI), single-photon emission CT (SPECT), and positron emission tomography (PET). Our experiments use five fusion metrics to validate the proposed approach’s performance, such as entropy (EN), mutual information (MI), weighted edge information (QAB/F\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$^{AB/F}$$\\end{document}), nonlinear correlation information entropy (Qncie\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$_{ncie}$$\\end{document}), and average gradient (AG). Outcomes show that the proposed approach achieves high overall performance in visual and objective characteristics when compared with five well-known MIF methods. The average values for EN, MI, QAB/F\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$^{AB/F}$$\\end{document}, Qncie\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$_{ncie}$$\\end{document}, and AG with the proposed approach are 5.2144,3.1282,.6600,.8071, and 8.9874, respectively.

A novel dictionary learning approach for multi-modality medical image fusion

Multimodality medical image fusion is the process of combining multiple images from single or multiple modalities of imaging. Medical image fusion methods are adopted to increase the quality of medical images by attaining the salient features in the fusion results. Hence, they raise the clinical applicability of medical images for appraisal and diagnosis problems. This purpose is achieved by capturing the complementary information presented in two or more images of different modalities in the fusion result. Medical image fusion is generally concerned with Magnetic Resonance Imaging (MRI), Magnetic Resonance Angiogram (MRA), Positron Emission Tomography (PET), Structural Positron Emission Tomography (SPET), Computerized Tomography (CT), and Single-Photon Emission Computed Tomography (SPECT) modalities. Each modality has its merits and drawbacks. This induces new fusion methods for merging information from multiple imaging modalities. Researchers have presented several methods for medical image fusion, and these methods achieved good results. However, medical image fusion is a resurgent field that needs to be enhanced to conquer the increasing challenges. This paper presents a comprehensive survey of some existing medical image fusion methods. It is expected that this study will be useful for the researchers scrutinizing medical image fusion. Furthermore, it is expected to establish a concrete foundation for developing more powerful fusion methods for medical applications.

Industrial Internet of Things (IIoT) refers to the extension and utilization of the Internet of Things (IoT) in industrial sectors and applications. Medical image fusion and classification has been utilized to get valuable significant multimodality medical image data. Recently, deep learning methods offer an effective way to design an end-to-end model that can determine the final classification labels. This chapter introduces a Multimodality Image Fusion Classification (MMIFC) by the incorporation of image fusion, feature extraction, and classification techniques. Initially, the input medical images were fused by the use of optimal shearlet transform where the coefficients of shearlets are optimized by the use of Enhanced Monarch Butterfly Optimization (EMBO) algorithm. In the next stage, the fused images were classified based on the feature extractor and deep learning model to check the test image is malignant and benign. To further optimize the performance of the deep learning model, hyperparameter tuning process takes place by the use of Bayesian optimization model to optimize the weights of structure. Finally, this ODNN model classifies the MMFI as class 1 or 0. A detailed simulation result takes place to ensure the effective performance of the proposed method. From the experimental results, the proposed strategy accomplishes better fusion rate and classification results compared with other supervised and non-supervised learning techniques.

Medical image fusion based on enhanced three-layer image decomposition and Chameleon swarm algorithm

In this modern era, medical image processing is an indispensable part of many applications and practices in the medical domain. The images that are used should meet certain criteria, including having more accurate details and information than each individual image, which can help medical scientists with analysis and treatment. Medical image fusion is among the techniques that offer high-quality images, which are combined from different modalities. Multimodal medical image fusion provides remarkable improvement in the quality of the fused images. In this paper, we describe an image fusion method for magnetic resonance imaging (MRI) and computed tomography (CT) utilizing local features and fuzzy logic methods. The aim of the proposed technique is to create the maximum combination of useful information present in MRI and CT images. Image local features are distinguished and combined with fuzzy logic to calculate weights for each pixel. Simulation outcomes show that the proposed method produces considerably better results compared to cutting-edge techniques. The method is also used to detect and highlight tumorous areas, followed by morphology filters used to eliminate any noise and disturbance.

Multimodal medical image fusion technique is an important and essential coalescing technique for the medical images with different modalities. The fused medical image carries more useful information than two or more relevant individual medical images of modality. To enhance, preserve edge and feature information and to remove noise of the source images a novel medical image fusion method has been developed with multiscale edge preserving decomposition L0 smoothing with sparse representation (SR) in nonsubsampled contourlet transform (NSCT) domain. The NSCT‐based image fusion method provides richer information in the spatial and spectral domains simultaneously. In this method, initially, L0 gradient smoothing filter is applied in two different modal clinical images separately to decompose the source images into two layers such as low frequency layer (LFL) and high frequency layer (HFL) which preserves the information and improves quality. To maintain the curve edges and the energy of the source medical images, the LFLs of different modal images are combined by using the NSCT ‐ SR fusion rule also to protect the detailed information of input medical images and reduce redundant information, the HFLs are combined by max‐absolute combination rule. By combining the reconstructed LFL and HFL, the resultant fused image is obtained. The experimental results show that the proposed work can provide better results than current methodologies in terms of both visual consistency and quantitative analysis.