International Journal of Nonlinear Analysis and Applications

A real-time forest fire and smoke detection system using deep learning

Document Type : Research Paper

Author

Department of Basic Sciences, College of Dentistry, University of Baghdad, Baghdad, Iraq

Abstract

Large parts of the world's forests are threatened by fires. These fires happen continuously every month around the globe. They are very costly to society and cause serious damage to the ecosystem. This raises the necessity to build a detection system to intervene early and take action. Fire and smoke have various colours, textures, and shapes, which are challenging to detect. In the modern world, neural networks are used extensively in most fields of human activities. For the detection of fire and smoke, we suggest a deep learning technology using transfer learning to extract features of forest fire and smoke. We used a pre-trained Inception-ResNet-v2 network on the ImageNet dataset to be trained on our dataset which consists of 1,102 images for each fire and smoke class. The classification accuracy, precision, recall, F1-Score, and specificity were 99.09\%, 100\%, 98.08\%, 99.09\%, and 98.30\%, respectively. This model has been deployed on a Raspberry Pi device with a camera. For real-time detection, we used the Open CV library to read the camera stream frame by frame and predict the probability of fire or smoke.

Keywords

[1] M. Byra, Discriminant analysis of neural style representations for breast lesion classification in ultrasound, Biocyber. Biomed. Engin. 38(3) (2018) 684–690.
[2] J. Z. Cheng, D. Ni, Y.H. Chou, J. Qin, C.M. Tiu, Y.C. Chang, C.S. Huang, D. Shen and C.M. Chen, Computeraided diagnosis with deep learning architecture: Applications to breast lesions in US images and pulmonary ndules in CT scans, Scientific Rep. 6(1) (2016) 1–13.
[3] F. Cui, Deployment and integration of smart sensors with IoT devices detecting fire disasters in huge forest environment, Computer Commun. 150 (2020) 818–827.
[4] K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recogn. (2016) 770–778.
[5] P. Jain, S.C.P. Coogan, S.G. Subramanian, M. Crowley, S. Taylor and M.D. Flannigan, A review of machine learning applications in wildfire science and management, In Environmental Reviews, 28(4) (2020) 478–505.
[6] Z. Jiao, Y. Zhang, L. Mu, J. Xin, S. Jiao, H. Liu and D. Liu, A YOLOv3-based Learning Strategy for Real-time UAV-based Forest Fire Detection, Proc. 32nd Chinese Control Decision Conf., IEEE, (2020) 4963–4967.
[7] Z. Jiao, Y. Zhang, J. Xin, L. Mu, Y. Yi, H. Liu and D. Liu, A Deep learning based forest fire detection approach using uav and yolov3, 1st Int. Conf. Indust. Artif. Intell. (2019) 1–5.
[8] A. Krizhevsky, I. Sutskever and G.E. Hinton, ImageNet classification with deep convolutional neural networks, Commun. ACM, 60(6) (2017) 84–90.
[9] S.B. Kukuk and Z.H. Kilimci, Comprehensive analysis of forest fire detection using deep learning models and conventional machine learning algorithms, Int. J. Comput. Experimental Sci. Engin. 7(2) (2021) 84–94.
[10] Y. LeCun, K. Kavukcuoglu and C. Farabet, Convolutional networks and applications in vision, ISCAS 2010-2010 IEEE Int. Symp. Circ. Syst.: Nano-Bio Circuit Fabrics Syst. (2010) 253–256.
[11] T. Y. Lin, P. Doll´ar, R. Girshick, K. He, B. Hariharan and S. Belongie, Feature pyramid networks for object detection, Proc. 30th IEEE Conf. Computer Vision and Pattern Recogn. Janua 2017 936–944.
[12] G. Litjens, T. Kooi, B.E. Bejnordi, A.A.A. Setio, F. Ciompi, M. Ghafoorian, J.A.W.M. van der Laak, B. van Ginneken and C.I. S´anchez, A survey on deep learning in medical image analysis, Medical Image Anal. 42 (2017) 60–88.
[13] T. Liu, J. Cheng, X. Du, X. Luo,L. Zhang, B. Cheng and Y. Wang, Video smoke detection method based on change-cumulative image and fusion deep network, Sensors 19(23) (2019) 50–60.
[14] B.S. Negara, R. Kurniawan, M.Z.A. Nazri, S.N.H.S. Abdullah, R.W. Saputraand and A. Ismanto, Riau forest fire prediction using supervised machine learning, J. Phys.: Conf. Ser. 1566(1) (2020) 12–20.
[15] Y. Peng and Y. Wang,Real-time forest smoke detection using hand-designed features and deep learning, Comput. Electr. Agricul. 167 (2019) 105029.
[16] H. Pranamurti, A. Murti and C. Setianingsih, Fire Detection Use CCTV with Image Processing Based Raspberry Pi, J. Phys.: Conf. Ser. 1201(1) (2019) 012015.
[17] M. Rahul, K. Shiva Saketh, A. Sanjeet and N. Srinivas Naik, Early detection of forest fire using deep learning, IEEE Region 10 Annual Int. Conf. (2020) 1136–1140.
[18] T. Schoennagel, J.K. Balch, H. Brenkert-Smith, P.E. Dennison, B.J. Harvey, M.A. Krawchuk, N. Mietkiewicz, P. Morgan, M.A. Moritz, R. Rasker, M.G. Turner and C. Whitlock, Adapt tomore wildfire in western North American forests as climate changes, Proc. Nat. Acad. Sci. United States Amer. 114(18) (2017) 4582–4590.
[19] A. Shamsoshoara, F. Afghah, A. Razi, L. Zheng,P. Z. Ful´e and E. Blasch, Aerial imagery pile burn detection using deep learning: The FLAME dataset, Computer Networks 193 (2021) 108001.
[20] D. Shen, G. Wu and H. Suk, Deep Learning in Medical Image Analysis, Annual Rev. Biomed. Engin. 19 (2017) 221–248.
[21] G. Shi, H. Yan, W. Zhang, J. Dodson, H. Heijnis and M. Burrows, Rapid warming has resulted in more wildfires in northeastern Australia, Sci. Total Envir. 771 (2020) 144888.
[22] H.C. Shin, H.R. Roth, M. Gao, L. Lu, Z. Xu, I. Nogues, J. Yao, D. Mollura and R.M. Summers, Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning, IEEE Trans. Medical Imag. 35(5) (2016) 1285-1298.
[23] C. Szegedy, S. Ioffe, V. Vanhoucke and A.A. Alemi, Inception-v4, inception-ResNet and the impact of residual connections on learning, 31st AAAI Conf. Artificial Intell. (2017) 4278–4284.
[24] L. Vil`a-Vilardell, W. S. Keeton, D. Thom, C. Gyeltshen, K. Tshering and G. Gratzer, Climate change effects on wildfire hazards in the wildland-urban-interface – Blue pine forests of Bhutan, Forest Eco. Manag. 461 (2020) 117927.
[25] K. Weiss, T.M. Khoshgoftaar and D.D. Wang, A survey of transfer learning, J. Big Data 3(1) (2016) 1–40.
[26] R. Xu, H. Lin, K. Lu, L. Cao and Y. Liu, A forest fire detection system based on ensemble learning, Forests 12(2) (2021) 1–17.
[27] V. Yaloveha, D. Hlavcheva and A. Podorozhniak, Usage of convolutional neural network for multispectral image processing applied to the problem of detecting fire hazardous forest areas, Adv. Inf. Syst. 3(1) (2019) 116–120.
International Journal of Nonlinear Analysis and Applications
Volume 13, Issue 1
March 2022
Pages 2053-2063
  • Receive Date: 04 September 2021
  • Revise Date: 11 November 2021
  • Accept Date: 19 November 2021