Scholarlink

<p>Pedestrian detection in autonomous driving systems is a critical task that demands high accuracy and low latency, especially in dynamic environments where rapid decision-making is essential. Traditional RGB-based detectors suffer from limitations such as motion blur, occlusions, and degraded performance in low-light conditions. To address these challenges, we propose a novel low-latency pedestrian detection approach that fuses Dynamic Vision Sensors (DVS) with traditional RGB cameras. We apply a geometry-based algorithm leveraging epipolar constraints to remove background events caused by ego-motion, thereby isolating dynamic events generated by pedestrians. We introduce a Likelihood Ratio Test (LRT)–based fusion framework that combines appearance-based confidence scores with the motion-sensitive Active Pixel Percentage (APP) derived from event data. This fusion approach effectively differentiates static and moving pedestrians, enhancing detection robustness. We evaluate the method on both synthetic data from the CARLA simulator and a real-recorded dataset. Across both domains, our fusion model significantly improves classification accuracy and achieves substantially earlier detection of pedestrians compared to RGB-only detection. These results highlight the potential of event-based sensor fusion for real-time pedestrian perception in autonomous driving and safety-critical robotics applications.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Low Latency Crossing Pedestrian Detection by Dynamic Vision Sensor and RGB camera

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年2月4日

查看全文
  • Bingyu Huang,
  • Gianni Allebosch,
  • Tim Willems,
  • Peter Veelaert,
  • Wilfried Philips,
  • Jan Aelterman

摘要

Pedestrian detection in autonomous driving systems is a critical task that demands high accuracy and low latency, especially in dynamic environments where rapid decision-making is essential. Traditional RGB-based detectors suffer from limitations such as motion blur, occlusions, and degraded performance in low-light conditions. To address these challenges, we propose a novel low-latency pedestrian detection approach that fuses Dynamic Vision Sensors (DVS) with traditional RGB cameras. We apply a geometry-based algorithm leveraging epipolar constraints to remove background events caused by ego-motion, thereby isolating dynamic events generated by pedestrians. We introduce a Likelihood Ratio Test (LRT)–based fusion framework that combines appearance-based confidence scores with the motion-sensitive Active Pixel Percentage (APP) derived from event data. This fusion approach effectively differentiates static and moving pedestrians, enhancing detection robustness. We evaluate the method on both synthetic data from the CARLA simulator and a real-recorded dataset. Across both domains, our fusion model significantly improves classification accuracy and achieves substantially earlier detection of pedestrians compared to RGB-only detection. These results highlight the potential of event-based sensor fusion for real-time pedestrian perception in autonomous driving and safety-critical robotics applications.