Scholarlink

<p>For many intelligent systems, designing accurate pedestrian detection approaches is a fundamental task. This paper describes a novel hybrid system to detect pedestrians using both visible and thermal infrared sensors. The proposed method is achieved in two primary stages. The first stage, hypotheses generation (HG), aims to extract the regions that represent suspected pedestrians from the image. It is performed using both thermal and visible images of the same scene. Here, an improved deep learning-based solution with a convolutional neural network named PedTherm-U-net is proposed. It segments the thermal images and maps the segmentation results into the corresponding visible image to extract the ROIs (candidate pedestrians). The second stage, hypotheses verification (HV), classifies the ROIs extracted from the first stage into pedestrians and non-pedestrians. In the HV step, a novel PedVis-ResNet framework to classify the extracted ROIs is introduced. It is a modified version of ResNet model dedicated to classify the visible pedestrian samples. The proposed method has been tested on the publicly accessible OSU Color-Thermal dataset, and the obtained results demonstrate the effectiveness of the proposed method when compared to the recent state of the art pedestrian detection approaches.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A novel hybrid deep learning framework for pedestrian detection based on thermal infrared and visible spectrum images

  • 期刊论文

  • 发表日期：

    2025年4月4日

查看全文
  • Mahassine Defaoui,
  • Lahcen Koutti,
  • Mohamed El Ansari,
  • Redouan Lahmyed,
  • Lhoussaine Masmoudi

摘要

For many intelligent systems, designing accurate pedestrian detection approaches is a fundamental task. This paper describes a novel hybrid system to detect pedestrians using both visible and thermal infrared sensors. The proposed method is achieved in two primary stages. The first stage, hypotheses generation (HG), aims to extract the regions that represent suspected pedestrians from the image. It is performed using both thermal and visible images of the same scene. Here, an improved deep learning-based solution with a convolutional neural network named PedTherm-U-net is proposed. It segments the thermal images and maps the segmentation results into the corresponding visible image to extract the ROIs (candidate pedestrians). The second stage, hypotheses verification (HV), classifies the ROIs extracted from the first stage into pedestrians and non-pedestrians. In the HV step, a novel PedVis-ResNet framework to classify the extracted ROIs is introduced. It is a modified version of ResNet model dedicated to classify the visible pedestrian samples. The proposed method has been tested on the publicly accessible OSU Color-Thermal dataset, and the obtained results demonstrate the effectiveness of the proposed method when compared to the recent state of the art pedestrian detection approaches.