Scholarlink

<p>In the realm of robot autonomous navigation and human-robot interaction, human gaze information offers subtle yet rich clues. Enabling robots to access human gaze information allows them to predict human intentions or goals, thereby enhancing the human-robot interaction experience and even enabling robots to move smoothly in complex human environments. This study proposes a method for real-time estimation of human gaze targets in the surrounding environment using a 360-degree panoramic camera. We employ deep learning techniques to track human gaze in real-time from the robot’s perspective. Building upon previous work, our method utilizes a dual-path prediction network to address the two gaze modes of human subjects in panoramic images. We have improved the network structure by leveraging the gaze heatmap as an interpretable network component, combined with the scene saliency heatmap, to estimate people’s gaze targets. We emphasize the challenges of real-time gaze tracking on robots and demonstrate our model’s performance improvements in gaze estimation.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Real-time human gaze target estimation in 360-degree vision via integration of human gaze direction and scene saliency analysis

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年3月8日

查看全文
  • Jialin Tu,
  • Yusuke Tamura,
  • Yasuhisa Hirata

摘要

In the realm of robot autonomous navigation and human-robot interaction, human gaze information offers subtle yet rich clues. Enabling robots to access human gaze information allows them to predict human intentions or goals, thereby enhancing the human-robot interaction experience and even enabling robots to move smoothly in complex human environments. This study proposes a method for real-time estimation of human gaze targets in the surrounding environment using a 360-degree panoramic camera. We employ deep learning techniques to track human gaze in real-time from the robot’s perspective. Building upon previous work, our method utilizes a dual-path prediction network to address the two gaze modes of human subjects in panoramic images. We have improved the network structure by leveraging the gaze heatmap as an interpretable network component, combined with the scene saliency heatmap, to estimate people’s gaze targets. We emphasize the challenges of real-time gaze tracking on robots and demonstrate our model’s performance improvements in gaze estimation.