复杂环境下小尺度烟火目标检测研究
作者:
基金项目:

国家自然科学基金(51675259);江苏省智能感知技术与装备工程研究中心开放基金(ITS202103);南京工程学院研究生科技创新基金(TB202217004)


Small scale smoke & fire target detection in complex environment
Author:
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • | | |
  • 文章评论
    摘要:

    针对复杂环境下起火点目标尺寸较小、起火点特征易与实际场景混淆导致烟火检测效率及准确率低等问题,提出了一种基于改进YOLOv5的小尺度烟火目标检测方法.首先,在原始YOLOv5模型输出的第3个检测层上增加第4个检测层,以此获取更大的特征图对小目标进行检测,加强网络模型的特征提取能力.其次,为解决目标在被遮挡的场景中容易出现漏检的问题,将原网络中用于计算目标框损失函数的GIoU_Loss替换成DIoU_Loss.最后,利用TensorRT对模型进行压缩和加速优化,并将其部署到Jetson TX2开发板上进行加速推理实验,通过复制增强方法扩充实际烟火场景数据.大量实验结果表明,本文所提方法用于复杂环境下的小尺度烟火目标检测不仅检测速度快而且精度高,适于推广应用.

    Abstract:

    To address the low efficiency and accuracy of smoke & fire detection due to the small size of target and the confusion of fire feature with actual scene in complex environment, a small scale smoke & fire target detection method based on improved YOLOv5 is proposed.First, a fourth detection layer is added to the third detection layer output in the original YOLOv5 model, so as to obtain a larger feature map for small target detection and strengthen the feature extraction capability of the network model.Second, to solve the easy missing detection of target in shielded scene, DIoU_Loss is used to replace the GIoU_Loss in calculating the regression loss function of the target frame.Finally, TensorRT is used to compress and accelerate the optimization of the model, and then deployed to the Jetson TX2 development board for accelerated inference experiments.In addition, more smoke & fire scene data are constructed by replication enhancement.Experimental results show that the proposed method has fast convergence speed and high accuracy for small scale smoke & fire detection, possessing the prospect for popularization and application.

    参考文献
    [1] 李继超, 郭聖煜, 孔刘林, 等.施工现场火焰检测和预警机器人设计及应用[J].中国安全科学学报, 2021, 31(4):141-146 LI Jichao, GUO Shengyu, KONG Liulin, et al.Design and application of a fire detection and early warning robot in construction site[J].China Safety Science Journal, 2021, 31(4):141-146
    [2] 胡凯, 郑翡, 卢飞宇, 等.基于深度学习的行为识别算法综述[J].南京信息工程大学学报(自然科学版), 2021, 13(6):730-743 HU Kai, ZHENG Fei, LU Feiyu, et al.A survey of action recognition algorithms based on deep learning[J].Journal of Nanjing University of Information Science & Technology (Natural Science Edition), 2021, 13(6):730-743
    [3] 张学颖, 杨遂军, 傅琳, 等.基于组合传感器阵列的广谱火焰高度检测[J].仪表技术与传感器, 2013(6):93-95 ZHANG Xueying, YANG Suijun, FU Lin, et al.Height detection of broad-spectrum flame based on combination sensor array[J].Instrument Technique and Sensor, 2013(6):93-95
    [4] 张驰, 孟庆浩, 井涛.基于改进GMM和多特征融合的视频火焰检测算法[J].激光与光电子学进展, 2021, 58(4):136-145 ZHANG Chi, MENG Qinghao, JING Tao.Video flame detection algorithm based on improved GMM and multi-feature fusion[J].Laser & Optoelectronics Progress, 2021, 58(4):136-145
    [5] 陈西江, 安庆, 班亚.优化EfficientDet深度学习的车辆检测[J].南京信息工程大学学报(自然科学版), 2021, 13(6):653-660 CHEN Xijiang, AN Qing, BAN Ya.Optimized EfficientDet deep learning model for vehicle detection[J].Journal of Nanjing University of Information Science & Technology (Natural Science Edition), 2021, 13(6):653-660
    [6] 陈浩霖, 高尚兵, 相林, 等.FIRE-DET:一种高效的火焰检测模型[J].南京信息工程大学学报(自然科学版), 2023, 15(1):76-84 CHEN Haolin, GAO Shangbing, XIANG Lin, at al.FIRE DET:an efficient flame detection model [J].Journal of Nanjing University of Information Science & Technology (Natural Science Edition), 2023, 15(1):76-84
    [7] 石磊, 张海刚, 杨金锋.基于改进型SSD的视频烟火检测算法[J].计算机应用与软件, 2021, 38(12):161-167, 173 SHI Lei, ZHANG Haigang, YANG Jinfeng.Video-based fire and smoke detection based on improved SSD[J].Computer Applications and Software, 2021, 38(12):161-167, 173
    [8] 李欣健, 张大胜, 孙利雷, 等.复杂场景下基于CNN的轻量火焰检测方法[J].模式识别与人工智能, 2021, 34(5):415-422 LI Xinjian, ZHANG Dasheng, SUN Lilei, et al.CNN-based lightweight flame detection method in complex scenes[J].Pattern Recognition and Artificial Intelligence, 2021, 34(5):415-422
    [9] 赵媛媛, 朱军, 谢亚坤, 等.改进Yolo-v3的视频图像火焰实时检测算法[J].武汉大学学报·信息科学版, 2021, 46(3):326-334 ZHAO Yuanyuan, ZHU Jun, XIE Yakun, et al.A real-time video flame detection algorithm based on improved Yolo-v3[J].Geomatics and Information Science of Wuhan University, 2021, 46(3):326-334
    [10] Shorten C, Khoshgoftaar T M.A survey on image data augmentation for deep learning[J].Journal of Big Data, 2019, 6(1):1-48
    [11] 李红光, 于若男, 丁文锐.基于深度学习的小目标检测研究进展[J].航空学报, 2021, 42(7):024691 LI Hongguang, YU Ruonan, DING Wenrui.Research development of small object traching based on deep learning[J].Acta Aeronautica et Astronautica Sinica, 2021, 42(7):024691
    [12] Hu C, Tang P, Jin W D, et al.Real-time fire detection based on deep convolutional long-recurrent networks and optical flow method[C]//201837th Chinese Control Conference (CCC).Wuhan, China.IEEE, 2018:9061-9066
    [13] Leng J X, Ren Y H, Jiang W, et al.Realize your surroundings:exploiting context information for small object detection[J].Neurocomputing, 2021, 433:287-299
    [14] Lin T Y, Dollár P, Girshick R, et al.Feature pyramid networks for object detection[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition.Honolulu, HI, USA.IEEE, 2017:936-944
    [15] Du S J, Zhang P, Zhang B F, et al.Weak and occluded vehicle detection in complex infrared environment based on improved YOLOv4[J].IEEE Access, 2021, 9:25671-25680
    [16] Zhao Z Q, Zheng P, Xu S T, et al.Object detection with deep learning:a review[J].IEEE Transactions on Neural Networks and Learning Systems, 2019, 30(11):3212-3232
    [17] Pan S J, Yang Q.A survey on transfer learning[J].IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10):1345-1359
    [18] Tao L, Hong T, Guo Y C, et al.Drone identification based on CenterNet-TensorRT[C]//2020 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.Paris, France.IEEE, 2020:1-5
    [19] Min J, Lee Y.An experimental view on fairness between HTTP/1.1 and HTTP/2[C]//2019 International Conference on Information Networking (ICOIN).Kuala Lumpur, Malaysia.IEEE, 2019:399-401
    [20] Wang X H, Yue X B, Li H Y, et al.A high-efficiency dirty-egg detection system based on YOLOv4 and TensorRT[C]//2021 International Conference on Advanced Mechatronic Systems (ICAMechS).Tokyo, Japan.IEEE, 2021:75-80
    [21] Zhang Q, Wang Y Y, Zhu L, et al.Research on real-time reasoning based on JetSon TX2 heterogeneous acceleration YOLOv4[C]//2021 IEEE 6th International Conference on Cloud Computing and Big Data Analytics.Chengdu, China.IEEE, 2021:455-459
    引证文献
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

温秀兰,焦良葆,李子康,姚波,唐国寅.复杂环境下小尺度烟火目标检测研究[J].南京信息工程大学学报(自然科学版),2023,15(6):676-683
WEN Xiulan, JIAO Liangbao, LI Zikang, YAO Bo, TANG Guoyin. Small scale smoke & fire target detection in complex environment[J]. Journal of Nanjing University of Information Science & Technology, 2023,15(6):676-683

复制
分享
文章指标
  • 点击次数:305
  • 下载次数: 1189
  • HTML阅读次数: 128
  • 引用次数: 0
历史
  • 收稿日期:2022-07-10
  • 在线发布日期: 2023-12-15
  • 出版日期: 2023-11-28

地址:江苏省南京市宁六路219号    邮编:210044

联系电话:025-58731025    E-mail:nxdxb@nuist.edu.cn

南京信息工程大学学报 ® 2025 版权所有  技术支持:北京勤云科技发展有限公司