A NEW METHOD FOR MEDICAL IMAGE FUSION BASED ON GAUSSIAN BLUR FILTER AND ROBINSON COMPASS OPERATOR

Quoc Viet Kieu, Vinh Nam Huynh, Thi Phuong Nghiem, Oanh Cuong Do, Giang Son Tran
Author affiliations

Authors

  • Quoc Viet Kieu
  • Vinh Nam Huynh
  • Thi Phuong Nghiem
  • Oanh Cuong Do
  • Giang Son Tran University of Science and Technology of Hanoi

DOI:

https://doi.org/10.15625/1813-9663/18655

Keywords:

Medical image fusion, Two-scale image decomposition, Gaussian blur filter, Compass operator.

Abstract

Medical image fusion is a process of extracting features from multi-modal medical images and combining them into a composite image. It brings huge support in medical imaging and clinical diagnosis. However, the extraction of both structural and functional information from input MRI and PET images using multi-scale transform fusion methods poses a challenge of providing high-quality decomposition layers since during the decomposition process, images can still lose information such as blur or noise at the edges of the image. To address this limitation, we present a new method to improve the visual information fidelity of medical image fusion. Firstly, the YCbCr color space is utilized to prevent distortion when merging color and grey images. The second algorithm uses the CLAHE model, which allows the input images to have good contrast. Then, a Gaussian blur filter is employed to decompose the images into base and detail layers. The use of Gaussian blur ensures a smoothing filter of the edges. After that, the Robinson compass operator is applied to create the fusion rule of detail components. Finally, the fused base and detail layers are concatenated together to form the final composite image. The experimental results show that the proposed approach outperforms the latest methods in bringing visual information fidelity of the input images to the fused image, which is helpful in supporting doctors and radiologists in visual analysis of the medical images.

Metrics

Metrics Loading ...

References

M. Wu, J. Shu, et al. Multimodal molecular imaging: current status and future directions.

Contrast media & molecular imaging, 2018, 2018.

A. P. James and B. V. Dasarathy. Medical image fusion: A survey of the state of the art.

Information fusion, 19:4–19, 2014.

M. A. Azam, K. B. Khan, S. Salahuddin, E. Rehman, S. A. Khan, M. A. Khan, S. Kadry, and

A. H. Gandomi. A review on multimodal medical image fusion: Compendious analysis of medical

modalities, multimodal databases, fusion techniques and quality metrics. Computers in biology

and medicine, 144:105253, 2022.

P.-H. Dinh. A novel approach based on grasshopper optimization algorithm for medical image

fusion. Expert Systems with Applications, 171:114576, 2021.

J. Du, W. Li, and H. Tan. Intrinsic image decomposition-based grey and pseudo-color medical

image fusion. IEEE Access, 7:56443–56456, 2019.

R. R. Raylman. Reduction of positron range effects by the application of a magnetic field: For

use with positron emission tomography. PhD thesis, University of Michigan, 1991.

M. Hofmann, F. Steinke, V. Scheel, G. Charpiat, J. Farquhar, P. Aschoff, M. Brady, B. Schölkopf,

and B. J. Pichler. Mri-based attenuation correction for pet/mri: a novel approach combining

pattern recognition and atlas registration. Journal of nuclear medicine, 49(11):1875–1883, 2008.

S. Li, X. Kang, L. Fang, J. Hu, and H. Yin. Pixel-level image fusion: A survey of the state of

the art. information Fusion, 33:100–112, 2017.

R. Shen, I. Cheng, and A. Basu. Cross-scale coefficient selection for volumetric medical image

fusion. IEEE Transactions on Biomedical Engineering, 60(4):1069–1079, 2012.

M. I. Smith and J. P. Heather. A review of image fusion technology in 2005. Thermosense

XXVII, 5782:29–45, 2005.

R. Vijayarajan and S. Muttan. Iterative block level principal component averaging medical

image fusion. Optik, 125(17):4751–4757, 2014.

R. Singh and A. Khare. Fusion of multimodal medical images using daubechies complex wavelet

transform–a multiresolution approach. Information fusion, 19:49–60, 2014.

S. Li, X. Kang, and J. Hu. Image fusion with guided filtering. IEEE Transactions on Image

processing, 22(7):2864–2875, 2013.

K. He, J. Sun, and X. Tang. Guided image filtering. IEEE transactions on pattern analysis and

machine intelligence, 35(6):1397–1409, 2012.

S. Daneshvar and H. Ghassemian. Mri and pet image fusion by combining ihs and retina-inspired

models. Information fusion, 11(2):114–123, 2010.

J. Du and W. Li. Two-scale image decomposition based image fusion using structure tensor.

International Journal of Imaging Systems and Technology, 30(2):271–284, 2020.

P. Porwik and A. Lisowska. The haar-wavelet transform in digital image processing: its status

and achievements. Machine graphics and vision, 13(1/2):79–98, 2004.

H. Buijs, A. Pomerleau, M. Fournier, and W. Tam. Implementation of a fast fourier transform

(fft) for image processing applications. IEEE Transactions on Acoustics, Speech, and Signal

Processing, 22(6):420–424, 1974.

K. A. Johnson et al. The whole brain atlas. 2001.

P. Jagalingam and A. V. Hegde. A review of quality metrics for fused image. Aquatic Procedia,

:133–142, 2015.

P.-H. Dinh. Multi-modal medical image fusion based on equilibrium optimizer algorithm and

local energy functions. Applied Intelligence, 51(11):8416–8431, 2021.

Y. Zhang, Y. Liu, P. Sun, H. Yan, X. Zhao, and L. Zhang. Ifcnn: A general image fusion

framework based on convolutional neural network. Information Fusion, 54:99–118, 2020.

W. Tang, F. He, Y. Liu, and Y. Duan. Matr: Multimodal medical image fusion via multiscale

adaptive transformer. IEEE Transactions on Image Processing, 31:5134–5149, 2022.

H. Xu and J. Ma. Emfusion: An unsupervised enhanced medical image fusion network. Infor-

mation Fusion, 76:177–186, 2021.

Downloads

Published

16-05-2024

How to Cite

[1]
Q. V. Kieu, V. N. Huynh, T. P. Nghiem, O. C. Do, and G. S. Tran, “A NEW METHOD FOR MEDICAL IMAGE FUSION BASED ON GAUSSIAN BLUR FILTER AND ROBINSON COMPASS OPERATOR”, JCC, vol. 40, no. 2, p. 135–146, May 2024.

Issue

Section

Articles