Brain tumor segmentation and classification: A one-decade review

Document Type : Review articles

Authors

1 Department of Computer Engineering, University of Technology, Baghdad, Iraq

2 Department of Control and System Engineering, University of Technology, Baghdad, Iraq

Abstract

Image segmentation is a common technique in digital image processing and analysis that partitions an image into several regions or zones, frequently based on the pixels' attributes. Brain tumor segmentation is a crucial task in medical image processing. Early identification of brain tumors enhances treatment options and increases the patient's chance of survival. Brain segmentation from a significant number of MR images obtained in medical treatment is a challenging and time-consuming assignment for cancer diagnosis and other brain diseases. That is why it is crucial to establish an efficient automatic image segmentation system for the diagnosis of brain tumors and other prevalent nervous diseases. The goal of this research is to undertake a systematic review of MRI-based brain tumor segmentation approaches. Deep learning techniques have proven useful for automatic segmentation in recent years and gained prominence, as these methods produce superior results and are thus better suited to this task than other methods. Deep learning algorithms may also be used to process enormous volumes of MRI-based image data quickly and objectively. Many review papers on traditional MRI-based brain tumor image segmentation algorithms are available.

Keywords

[1] M.K. Abd-Ellah, A.I. Awad, H.F.A. Hamed, and A.A.M. Khalaf, Parallel deep CNN structure for Glioma detection
and classification via brain MRI images, 31st Int. Conf. Microelectron. (ICM), 2019, pp. 304–307.
[2] Z. Akkus, A. Galimzianova, A. Hoogi, D.L. Rubin and B.J. Erickson, Deep learning for brain MRI segmentation:
state of the art and future directions, J. Digital Imag. 30 (2017), no. 4, 449–459.
[3] I.A.A. Alwan and F.A. Almarsoomi, MRI images series segmentation using the geodesic deformable model, Period.
Engin. Natural Sci. 9 (2021), no. 1, 216–226.
[4] N. Amiri Golilarz, H. Gao, R. Kumar, L. Ali, Y. Fu and C. Li, Adaptive wavelet based MRI brain image de-noising,
Front. Neurosci. 14 (2020), 728.
[5] A.K. Anaraki, M. Ayati and F. Kazemi, Magnetic resonance imaging-based brain tumor grades classification and
grading via convolutional neural networks and genetic algorithms, Biocybernet. Biomed. Engin. 39 (2019), no. 1,
63–74.
[6] S.M. Anwar, M. Majid, A. Qayyum and M. Awais, Medical image analysis using convolutional neural networks:
a review, J. Med. Syst. 42 (2018), no. 11, 1–13.
[7] P. Arasi and M. Suganthi, A clinical support system for brain tumor classification using soft computing techniques,
J. Med. Syst. 43 (2019), no. 5, 1–11.
[8] A. Ari and D. Hanbay, Deep learning-based brain tumor classification and detection system, Turk. J. Electr. Eng.
Comput. Sci. 26 (2018), no. 5, 2275–2286.
[9] S. Asgari Taghanaki, K. Abhishek, J.P. Cohen, J. Cohen-Adad and G. Hamarneh, Deep semantic segmentation
of natural and medical images: A review, Artific. Intell. Rev. 54 (2021), no. 1, 137–178.[10] M. Assam, H. Kanwal, U. Farooq, S.K. Shah, A. Mehmood and G.S. Choi, An efficient classification of MRI
brain images, IEEE Access 9 (2021), 33313–33322.
[11] M.M. Badˇza and M.C. Barjaktarovi´c, ˇ Classification of brain tumors from MRI images using a convolutional neural
network, Appl. Sci. 10 (2020), no. 6, 1999.
[12] J. Bernal, K. Kushibar, D.S. Asfaw, S. Valverde, A. Oliver, R. Mart´ı and X. Llad´o, Deep convolutional neural
networks for brain image analysis on magnetic resonance imaging: a review, Artific. Intell. Med. 95 (2018), 64–81.
[13] E.S. Biratu, F. Schwenker, Y.M. Ayano and T.G. Debelee, A survey of brain tumor segmentation and classification
algorithms, J. Imag. 7 (2021), no. 9, p. 179.
[14] E. Brumancia, S.J. Samuel and B. Yamini, Brain tumor detection and classification in medical images using
feature extraction based machine learning algorithm, JCR 7 (2020), no. 10, 2237–2243.
[15] Y. Chang, L. Yan, M. Chen, H. Fang and S. Zhong, Two-stage convolutional neural network for medical noise
removal via image decomposition, IEEE Trans. Instrument. Measur. 69 (2019), no. 6, 2707–2721.
[16] Z. Cui, J. Yang and Y. Qiao, Brain MRI segmentation with patch-based CNN approach, 35th Chinese Control
Conf. (CCC), 2016, pp. 7026–7031.
[17] R.D. Da Silva, R. Minetto, W.R. Schwartz and H. Pedrini, Adaptive edge-preserving image denoising using wavelet
transforms, Pattern Anal. Appl. 16 (2012), no. 4, 567–580.
[18] A. Demirhan, M. Toru and I. Guler, Segmentation of tumor and edema along with healthy tissues of brain using
wavelets and neural networks, IEEE J. Biomed. Health Inf. 19 (2015), no. 4, 1451–1458.
[19] B. De Vos, J. Wolterink, P. De Jong, M. Viergever and I. Iˇsgum, 2D image classification for 3D anatomy
localization: employing deep convolutional neural networks, SPIE Medical Imag. 9784 (2016), 517–523.
[20] A. Dixit and A. Nanda, Brain MR image classification via PSO based segmentation, Twelfth Int. Conf. Contemp.
Comput. (IC3), 2019, pp. 1–5.
[21] C.-M. Feng, Y. Xu, J.-X. Liu, Y.-L. Gao and C.-H. Zheng, Supervised discriminative sparse PCA for comcharacteristic gene selection and tumor classification on Multiview biological data, IEEE Trans. Neural Network.
Learn. Syst. 30 (2019), no. 10, 2926–2937.
[22] M. Ghaffari, A. Sowmya and R. Oliver, Automated brain tumour segmentation using multimodal brain scans,
a survey based on models submitted to the BraTS 2012-18 challenges, IEEE Rev. Biomed. Engin. 13 (2019),
156–168.
[23] R. Girshick, J. Donahue, T. Darrell and J. Malik, Region-based convolutional networks for accurate object detection
and segmentation, IEEE Trans. Pattern Anal. Machine Intell. 38 (2016), no. 1, 142–158.
[24] D.V. Gore and V. Deshpande, Comparative study of various techniques using deep learning for brain tumor
detection, Int. Conf. Emerg. Technol. (INCET), 2020, pp. 1–4.
[25] J. Gu, Z. Wang, J. Kuen, L. Ma, A. Shahroudy and B. Shuai, Recent advances in convolutional neural networks,
Pattern Recog. 77 (2018), 354–377.
[26] Y. Guan, M. Aamir, Z. Rahman, A. Ali, W.A. Abro, Z.A. Dayo, M.S. Bhutta and Z. Hu, A framework for efficient
brain tumor classification using MRI images, Math. Biosci. Eng. 18 (2021), no. 5, 5790–5815.
[27] A. Gumaei, M.M. Hassan, M.R. Hassan, A. Alelaiwi and G. Fortino, A hybrid feature extraction method with
regularized extreme learning machine for brain tumor classification, IEEE Access 7 (2019), 36266–36273.
[28] P.P. Gumaste and V.K. Bairagi, A hybrid method for brain tumor detection using advanced textural feature
extraction, Biomed. Pharmacol. J. 13 (2020), no. 1, 145–157.
[29] S.R. Gunasekara, H. Kaldera and M.B. Dissanayake, A systematic approach for MRI brain tumor localization and
segmentation using deep learning and active contouring, J. Healthcare Engin. 2021 (2021).
[30] M. Havaei, A. Davy, D. Warde-Farley, A. Biard, A. Courville, Y. Bengio, C. Pal, P.M. Jodoin and H. Larochelle,
Brain tumor segmentation with deep neural networks, Medical Image Anal. 35 (2017), 18–31.
[31] M.H. Hesamian, W. Jia, X. He and P. Kennedy, Deep learning techniques for medical image segmentation:achievements and challenges, Journal of Digital Imaging, 32 (2020), no. 4, 582–596.
[32] N. Ibtehaz and M.S. Rahman, MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image
segmentation, Neural Networks 121 (2019), 74–87.
[33] R. Iranpoor, A.S. Mahboob, S. Shahbandegan and N. Baniasadi, Skin lesion segmentation using convolutional
neural networks with improved U-Net architecture, 6th Iran. Conf. Signal Process. Intell. Syst. (ICSPIS), 2020,
pp. 1–5.
[34] A. I¸sın, C. Direko˘glu and M. S¸ah, Review of MRI-based brain tumor image segmentation using deep learning
methods, Proc. Comput. Sci. 102 (2016), 317–324.
[35] T. Kalaiselvi, P. Kumarashankar and P. Sriramakrishnan, Three-phase automatic brain tumor diagnosis system
using patches based updated run length region growing technique, J. Digital Imag. Soc. Imag. Inf. Medicine 33
(2020), no. 2, 465–479.
[36] J. Kang, Z. Ullah and J. Gwak, MRI-based brain tumor classification using ensemble of deep features and machine
learning classifiers, Sensors 21 (2021), no. 6, p. 2222.
[37] M.A. Khan, I. Ashraf, M. Alhaisoni and R. Damaˇseviˇcius, Multimodal brain tumor classification using deep
learning and robust feature selection: a machine learning application for radiologists, Diagnostics 10 (2020), no.
8, 565.
[38] A. Krizhevsky, I. Sutskever and G.E. Hinton, ImageNet classification with deep convolutional neural networks,
Commun. ACM 60 (2012), no. 6, 84–90.
[39] S. Kumar, D. Jayadevappa and M.V. Shetty, A novel approach for segmentation and classification of brain MR
images using cluster deformable based fusion approach, Period. Engin. Natural Sci. 6 (2018), no. 2, 237–242.
[40] K. Kumar Sharma, D. Gurjar, M. Jyotyana and V. Kumari, Denoising of brain MRI images using a hybrid filter
method of Sylvester-Lyapunov equation and non-local means, Smart Innov. Commun. Comput. Sci. Adv. Intell.
Syst. Comput. 851 (2019), 495—505.
[41] J. Liu, M. Li, J. Wang, F. Wu, T. Liu and Y. Pan, A survey of MRI-based brain tumor segmentation methods,
Tsinghua Sci. Technol. 19 (2014), no. 6, 578–595.
[42] D.N. Louis, A. Perry, G. Reifenberger, A. Von Deimling, D. Figarella-Branger, W.K. Cavenee, H. Ohgaki, O.D.
Wiestler, P. Kleihues and D.W. Ellison, The 2016 world health organization classification of tumors of the central
nervous system: a summary, Acta Neuropath. 131 (2016), no. 6, 803–820.
[43] S.-Y. Lu, S.C. Satapathy, S.-H. Wang and Y.-D. Zhang, PBTNet: a new computer-aided diagnosis system for
detecting primary brain tumors, Front. Cell Dev. Bio. 9 (2021), 2926.
[44] A.S. Lundervold and A. Lundervold, An overview of deep learning in medical imaging focusing on MRI, Z.
Medizin. Phys. 29 (2019), no. 2, 102–127.
[45] C. Ma, G. Luo and K. Wang, Concatenated and connected random forests with multiscale patch driven active
contour model for automated brain tumor segmentation of MR images, IEEE Trans. Medical Images 37 (2018),
no. 8, 1943–1954.
[46] T. Magadza and S. Viriri, Deep learning for brain tumor segmentation: a survey of state-of-the-art, J. Imag. 7
(2021), no. 2, 19.
[47] M. Mahmud, M.S. Kaiser, A. Hussain and S. Vassanelli, Applications of deep learning and reinforcement learning
to biological data, IEEE Trans. Neural Networks Learn. Syst. 29 (2018), no. 6, 2063—2079.
[48] A. Makropoulos, I.S. Gousias, C. Ledig, P. Aljabar, A. Serag, J.V. Hajnal, A.D. Edwards, S.J. Counsell and D.
Rueckert, Automatic whole brain MRI segmentation of the developing neonatal brain, IEEE Trans. Medical Imag.
33 (2014), no. 9, 1818–1831.
[49] S. Minaee, Y.Y. Boykov, F. Porikli and A.J. Plaza, Image segmentation using deep learning: a survey, IEEE
Trans. Pattern Anal. Machine Intell., 2021.
[50] P. Moeskops, J.M. Wolterink, B.H.M. Van Der Velden, K.G.A. Gilhuijs, T. Leiner, M.A. Viergever and I. Iˇsgum,
Deep learning for multi-task medical image segmentation in multiple modalities, Lecture Notes in ComputerScience, 2016.
[51] G. Mohan and M.M. Subashini, MRI based medical image analysis: survey on brain tumor grade classification,
Biomed. Signal Process. Control 39 (2018), pp. 139–161.
[52] M.R.M. Mohan, C.H. Sulochana and T. Latha, Medical image denoising using multistage directional median filter,
International Conference on Circuits, Power and Computing Technologies (ICCPCT-2015), 2015, pp. 1–6.
[53] H. Mohsen, E.S.A. El-Dahshan, E.S.M. El-Horbaty and A.B.M. Salem, Classification using deep learning neural
networks for brain tumors, Future Comput. Inf. J. 3 (2018), no. 1, 68–71.
[54] M.B. Naceur, R. Saouli, M. Akil and R. Kachouri, Fully automatic brain tumor segmentation using end-to-end
incremental deep neural networks in MRI images, Comput. Meth. Prog. Biomed. 166 (2018), 39–49.
[55] M.W. Nadeem, M.A.A. Ghamdi, M. Hussain, M.A. Khan, K.M. Khan, S.H. Almotiri and S.A. Butt, Brain tumor
analysis empowered with deep learning: a review, taxonomy, and future challenges, Brain Sci. 10 (2020), no. 2,
118.
[56] A. Natarajan and S. Kumarasamy, Efficient segmentation of brain tumor using FL-SNM with a metaheuristic
approach to optimization, J. Med. Syst. 43 (2019), no. 2.
[57] N. Noreen, S. Palaniappan, A. Qayyum, I. Ahmad and M.O. Alassafi, Brain tumor classification based on finetuned models and the ensemble method, Comput. Mater. Continua Tech. Sci. Press, CMC 67 (2021), no. 3,
3967–3982.
[58] F.S. Omar, S.T. Abdulrazzaq and M.A. Jasim, Design and implementation of image based object recognition,
Period. Engin. Natural Sci. 8 (2020), no. 1, 79–88.
[59] S. Pereira, A. Pinto, V. Alves and C.A. Silva, Brain tumor segmentation using convolutional neural networks in
MRI images, IEEE Trans. Medical Imag. 35 (2016), no. 5, 1240–1251.
[60] D. Ray, D. Dutta Majumder and A. Das, Noise reduction and image enhancement of MRI using adaptive multiscale
data condensation, 1st Int. Conf. Recent Adv. Inf. Technol.(RAIT), 2012, pp. 107–113.
[61] O. Ronneberger, P. Fischer and T. Brox, U-Net: convolutional networks for biomedical image segmentation,
Medical Image Computing and Computer-Assisted Intervention – MICCAI, 2015, pp. 234–241.
[62] M.B. Sahaai, G.R. Jothilakshmi, R. Prasath and S. Singh, Brain tumor detection using DNN algorithm, Turk. J.
Comput. Math. Educat. 12 (2021), no. 11, 3338–3345.
[63] M. Sajjad, S. Khan, K. Muhammad, W. Wu, A. Ullah and S.W. Baik, Multi-grade brain tumor classification
using deep CNN with extensive data augmentation, J. Comput. Sci. 30 (2019), 174–182.
[64] E. Shelhamer, J. Long and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Trans.
Pattern Anal. Machine Intell. 39 (2017), no. 4, 640–651.
[65] J. Sun, C. Li, X. Wu, V. Palade and W. Fang, An effective method of weld defect detection and classification
based on machine vision, IEEE Trans. Ind. Inf. 15 (2019), no. 12, 6322–6333.
[66] M.M. Thaha, K.P.M. Kumar, B.S. Murugan, S. Dhanasekeran, P. Vijayakarthick and A.S. Selvi, Brain tumor
segmentation using convolutional neural networks in MRI images, J. Med. Syst. 43 (2019), no. 9.
[67] A. Tiwari, S. Srivastava and M. Pant, Brain tumor segmentation and classification from magnetic resonance
images: review of selected methods from 2014 to 2019, Pattern Recog. Lett. 131 (2020), 244–260.
[68] H. Ucuzal, S. YAS¸AR and C. C¸ olak, Classification of brain tumor types by deep learning with convolutional neural
multidisciplinary, Stud. Innov. Technol. (ISMSIT), 2019, pp. 1–5.
[69] J.E. Villanueva-Meyer, M.C. Mabray and S. Cha, Current clinical brain tumor imaging, Neurosurgery 81 (2017),
no. 3, 397–415.
[70] R. Vinoth and C. Venkatesh, Segmentation and detection of tumor in MRI images using CNN and SVM classification, Proc. IEEE Conf. Emerg. Devices Smart Syst. (ICEDSS 2018), 2018, pp. 21–25.
[71] A. Wadhwa, A. Bhardwaj and V. Singh Verma, A review on brain tumor segmentation of MRI images, Magnetic
Resonance Imag. 61 (2019), 247–259.[72] Z. Wang and L. Zhang, Semantic segmentation of brain MRI based on U-net network and edge loss, 19th Int.
Symp. Distributed Comput. Appl. Business Engin. Sci. (DCABES), 2020, pp. 154–157.
[73] I. Zabir, S. Paul, M.A. Rayhan, T. Sarker, S.A. Fattah and C. Shahnaz, Automatic brain tumor detection and
segmentation from multi-modal MRI images based on region growing and level set evolution, IEEE Int. WIE Conf.
Electric. Comput. Eng. (WIECON-ECE), 2015, pp. 503–506.
[74] W. Zhang, R. Li, H. Deng, L. Wang, W. Lin, S. Ji and D. Shen, Deep convolutional neural networks for multimodality isointense infant brain image segmentation, NeuroImage 108 (2015), 214–224.
[75] K. Zhang, W. Zuo, Y. Chen, D. Meng and L. Zhang, Beyond a Gaussian denoiser: residual learning of deep CNN
for image denoising, IEEE Trans. Image Process. 26 (2017), no. 7, 3142–3155.
[76] K. Zhang, W. Zuo and L. Zhang, FFDNet: toward a fast and flexible solution for CNN-based image denoising,
IEEE Transactions on Image Process. 27 (2018), no. 9, 4608–4622.
[77] X. Zhao, Y. Wu, G. Song and Z. Li, A deep learning model integrating FCNNs and CRFs for brain tumor
segmentation, Medical Image Anal. 43 (2018), 98–111.[78] https://www.mendeley.com/.
Volume 13, Issue 2
July 2022
Pages 1879-1891
  • Receive Date: 03 April 2022
  • Revise Date: 15 May 2022
  • Accept Date: 01 June 2022