<p>In this study, in order to detect vehicles and pedestrians more effectively in thermal infrared images, we propose a multi-level feature fusion method based on YOLOv5 named YOLO-TIR. In the backbone network, we design an inverted bottleneck parallel convolution (IBPC) module, which uses wide-channel convolution in place of the deep convolutional extraction module and makes use of the Simplified SPP-Fast(SimSPPF) feature aggregation module to improve the network’s capability to localize objects. Moreover, in order to reduce the loss of information about small objects in multiple downsampling, a feature pyramid structure with jump connections called Shortcut-FPN(SFPN) is proposed, which effectively retains the shallow small object information. In addition, Shuffle-Upsample(SUP) is proposed to decrease the noise interference caused by interpolation, which splices multiple channels of the feature map to achieve the upsampling operation. Further, due to the problem of category imbalance in the public dataset, we create a new dataset called HTU_TIR to compensate for the categories with less data. The experimental results show that our proposed method has effective improvement in detection accuracy. Compared with YOLOv5m, we achieve 1.9% improvement on mAP scores, and the number of parameters and computation are decreased by 45.7% and 52.2%, respectively.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Yolo-tir: an improved YOLOv5 model for vehicle and pedestrian in thermal infrared images

  • Shangshu Yao,
  • Kun Yu,
  • Longfei Li,
  • Kaihua Zhang,
  • Yufang Liu

摘要

In this study, in order to detect vehicles and pedestrians more effectively in thermal infrared images, we propose a multi-level feature fusion method based on YOLOv5 named YOLO-TIR. In the backbone network, we design an inverted bottleneck parallel convolution (IBPC) module, which uses wide-channel convolution in place of the deep convolutional extraction module and makes use of the Simplified SPP-Fast(SimSPPF) feature aggregation module to improve the network’s capability to localize objects. Moreover, in order to reduce the loss of information about small objects in multiple downsampling, a feature pyramid structure with jump connections called Shortcut-FPN(SFPN) is proposed, which effectively retains the shallow small object information. In addition, Shuffle-Upsample(SUP) is proposed to decrease the noise interference caused by interpolation, which splices multiple channels of the feature map to achieve the upsampling operation. Further, due to the problem of category imbalance in the public dataset, we create a new dataset called HTU_TIR to compensate for the categories with less data. The experimental results show that our proposed method has effective improvement in detection accuracy. Compared with YOLOv5m, we achieve 1.9% improvement on mAP scores, and the number of parameters and computation are decreased by 45.7% and 52.2%, respectively.