Eye movement information has been proven to be a new type of data that can integrate human expert knowledge into intelligent models. However, currently, there is a lack of the eye movement datasets for cross-view matching tasks, especially for the task of street-to-aerial images cross-view matching. In this paper, we introduce an eye movement dataset based on this cross-view matching task, named Eye-CVACT. Five college students with relevant expertise participate in the experiment. We analyze the behavioral data of the subjects and apply this dataset to the visual saliency prediction driven by this task. The results verify the effectiveness and scientific value of this dataset. The Eye-CVACT dataset not only facilitates research on hybrid intelligent models for cross-view matching, but also contribute to the research on the interpretability of intelligent models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Street-To-Aerial Image Dataset with Eye-Tracking for Cross-View Matching

  • Yidong Hu,
  • Li Tong,
  • Ying Zeng,
  • Yuanlong Gao,
  • Bin Yan,
  • Zhongrui Li

摘要

Eye movement information has been proven to be a new type of data that can integrate human expert knowledge into intelligent models. However, currently, there is a lack of the eye movement datasets for cross-view matching tasks, especially for the task of street-to-aerial images cross-view matching. In this paper, we introduce an eye movement dataset based on this cross-view matching task, named Eye-CVACT. Five college students with relevant expertise participate in the experiment. We analyze the behavioral data of the subjects and apply this dataset to the visual saliency prediction driven by this task. The results verify the effectiveness and scientific value of this dataset. The Eye-CVACT dataset not only facilitates research on hybrid intelligent models for cross-view matching, but also contribute to the research on the interpretability of intelligent models.