BRAIN TUMOR SEGMENTATION BASED ON U-NET WITH IMAGE DRIVEN LEVEL SET LOSS
Keywords:Brain Tumor Segmentation, U-net, Mumford-Shah loss, Level set method, Activate Contour Model
This paper presents an approach for brain tumor segmentation based on deep neural networks. The paper proposes to utilize U-Net as an architecture of the approach to capture the fine and soars information from input images. Especially, to train the network, instead of using commonly used cross-entropy loss, dice loss or both, in this study, we propose to employ a new loss function including Level set loss and Dice loss function. The level set loss is inspired from Mumford-Shah functional for unsupervised task. Meanwhile, the Dice loss function measures the similarity between the predicted mask and desired mask. The proposed approach is then applied to segment brain tumor from MRI images as well as evaluated and compared with other approaches on a dataset of nearly 4000 brain MRI scans. Experiment results show that the proposed approach achieves high performance in terms of Dice coefficient and Intersection over Union (IoU) scores.
De Angelis L. M., Brain Tumos, New England Journal of Medicine, 344 (2) (2001) 114-123.
Siegel R., Miller K., and Jemal A., Cancer statistics, 2020 (US statistics), CA A Cancer J Clin,70 (1) (2020) 7-30.
Khan A., Perez J., Wells C., and Fuentes O., Computer vision evidence supporting craniometric alignment of rat brain atlases to streamline expert-guided, first-order migration of hypothalamic spatial datasets related to behavioral control, Front Syst Neurosci., 12 (2018) 1-29.
Bauer S., Wiest R., Nolte L. P., and Reyes M., A survey of MRI-based medical image analysis for brain tumor studies, Phys Med Biol, 58 (13) (2013) 58(13):R97-129.
Menze B. H., et al., The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) IEEE Trans Med Imaging, 34 (10) (2015) 1993-2024.
Taheria S., Ongb S. H., and Chong. V.F.H., Level-set segmentation of brain tumors using a threshold-based speed function, Image and Vision Computing, 28 (1) (2010) 26-37.
Sachdeva J., Kumar V., Gupta I., Khandelwal N., and Ahuja C. K., A novel content-based active contour model for brain tumor segmentation, Magnetic Resonance Imaging, 30 (5) (2012) 694-715.
Shyu K. K., Pham V. T., Tran T. T., and Lee P. L., Unsupervised active contours driven by density distance and local fitting energy with applications to medical image segmentation, Mach. Vis. Appl., 23 (6) (2012) 1159-1175.
Bauer S., P. Nolte L., and Reyes M. Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization, Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2010. 354-361.
Havaei M., Guizard N., Larochelle H., and Jodoin P., Deep Learning Trends for Focal Brain Pathology Segmentation in MRI, Machine Learning for Health Informatics (2016) 125-148.
Buda M., Saha A., and A. Mazurowski M., Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm, Comp. in Bio. and Med., 109 (2019) 218-225.
J. Long, E. Shelhamer, and T. Darrell, Fully convolutional networks for semantic segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2015) 3431–3440.
Pham V. T., Tran T. T., Wang P. C., and Lo M. T., Tympanic Membrane Segmentation in Otoscopic Images based on Fully Convolutional Network with Active Contour Loss, Signal, Image and Video Processing, DOI: 10.1007/s11760-020-01772-7 (2020)
Ninh Q. C., Tran T. T., Tran T. T., Tran T. A. X., and Pham V. T. Skin Lesion Segmentation Based on Modification of SegNet Neural Networks, Proceedings of the 6th NAFOSTED Conference on Information and Computer Science (NICS), 2020 Hanoi. 575-578.
Ronneberger O., Fischer P., and Brox T. U-net: Convolutional networks for biomedical image segmentation, Proceedings of the Int. Conf. Med. Image Comput. Comput.-Assist. Intervent., 2015. 234-241.
Chen W., Liu B., Peng. S., Sun J., and Qiao X. S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation, Proceedings of the International MICCAI Brainlesion Workshop, 2018. 358-368.
Salehi S. S. M., Erdogmus D., and Gholipour A. Tversky loss function for image segmentation using 3D fully convolutional deep networks, Proceedings of the International Workshop on Machine Learning in Medical Imaging, 2017. Springer, 379-387.
Chen X., Williams B. M., Vallabhaneni S. R., Czanner G., Williams R., and Zheng Y. Learning active contour models for medical image segmentation, Proceedings of the IEEE conference on computer vision and pattern recognition, 2019. 11632-11640.
Oktay O., Schlemper J., Folgoc L. L., Lee M., Heinrich M., Misawa K., et al. Attention U-Net: Learning Where to Look for the Pancreas, Proceedings of the 1st Conf. Med. Imaging with Deep Learn., 2018. Available: https://arxiv.org/abs/1804.03999.
Chen X., M. Williams B., R. Vallabhaneni S., Czanner G., Williams R., and Zheng Y. Learning Active Contour Models for Medical Image Segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. 11623-11640.
Mumford D. and Shah J., Optimal approximations by piecewise smoothfunctions and associated variational problems, Communications on Pure and Applied Mathematics, 42 (5) (1989) 577–685.
Kim B. and Ye J. C., Mumford–Shah loss functional for image segmentation with deep learning, IEEE Transactions on Image Processing, 29 (2019) 1856-1866.
Chan T. F. and Vese L. A. Image segmentation using level sets and the piecewise-constant Mumford-Shah model, Tech. Rep. 0014, Computational Applied Math Group, 2000. Citeseer.
Krizhevsky A., Sutskever I., and Hinton G. ImageNet classification with deep convolutional neural networks, Neural Information Processing Systems (NIPS), 2012.
Kingma D. and Ba J. ADAM: A Method for Stochastic Optimization, Proceedings of the International Conference on Learning Representations (ICLR), 2015.
TCGA-LGG - the cancer imaging archive (TCIA) public access -cancer imaging, [Online]. Available: https://wiki.cancerimagingarchive.net/display/Public/TCGA-LGG ( acess date: August, 29, 2020),
"Brain-segmentation-pytorch Kaggle," [Online], Available: www.kaggle.com/mateuszbuda/brain-segmentation-pytorch/data (access date: August, 29, 2020).
Lynch M., Ghita O., and Whelan P. F., Segmentation of the left ventricle of the heart in 3-D+t MRI data using an optimized nonrigid temporal model, IEEE Trans. Med. Imaging, 27 (2) (2008) 195-203.
How to Cite
Copyright (c) 2021 Vietnam Journal of Science and Technology
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Vietnam Journal of Sciences and Technology (VJST) is an open access and peer-reviewed journal. All academic publications could be made free to read and downloaded for everyone. In addition, Articles are published under term of the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA) Licence which permits use, distribution and reproduction in any medium, provided the original work is properly cited & ShareAlike terms followed.
Copyright on any research article published in VJST is retained by the respective author(s), without restrictions. Authors grant VAST Journals System (VJS) a license to publish the article and identify itself as the original publisher. Upon author(s) by giving permission to VJS either via VJS journal portal or other channel to publish their research work in VJS agrees to all the terms and conditions of https://creativecommons.org/licenses/by-sa/4.0/ License and terms & condition set by VJS.
Authors have the responsibility of to secure all necessary copyright permissions for the use of 3rd-party materials in their manuscript.