<p>Visual Language Navigation (VLN) is a rapidly evolving, cross-disciplinary field that has witnessed a phenomenal rise since its inception in recent past. Leveraging the power of deep learning, it aims to endow auditory and visual perceptions to embodied agents, thereby enabling them to interpret the multi-modal cues. Although the end objective remains solitary, the various ways this problem is approached in the larger context of artificial intelligence differs substantially in scope. Consequently, various contributions, ranging from architectural innovations and novel models, improved training strategies, datasets, methodologies, etc. have been proposed in the literature. Therefore, this work aims to provide a comprehensive review of scientific contributions and advancements by categorizing the literature into four primary abstraction layers: frameworks, models, auxiliaries, and tasks. Within each abstraction layer, the literature is further sub-categorized and then analyzed for notable trends, strengths, weaknesses and limitations as well as cross-compared for respective advantages and limitations. The simulation environments and datasets have been consolidated and unique insights are presented into each along with a summary of their advantages and disadvantages. Through extensive analysis, crucial challenges that remain in VLN are identified, guiding future efforts toward more intelligent and adaptable navigation agents.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A comprehensive review of recent advancements in vision-and-language navigation

  • Jahanzeb Khan,
  • Nayyer Aafaq,
  • Qasim Ali,
  • Mujahid Mohsin

摘要

Visual Language Navigation (VLN) is a rapidly evolving, cross-disciplinary field that has witnessed a phenomenal rise since its inception in recent past. Leveraging the power of deep learning, it aims to endow auditory and visual perceptions to embodied agents, thereby enabling them to interpret the multi-modal cues. Although the end objective remains solitary, the various ways this problem is approached in the larger context of artificial intelligence differs substantially in scope. Consequently, various contributions, ranging from architectural innovations and novel models, improved training strategies, datasets, methodologies, etc. have been proposed in the literature. Therefore, this work aims to provide a comprehensive review of scientific contributions and advancements by categorizing the literature into four primary abstraction layers: frameworks, models, auxiliaries, and tasks. Within each abstraction layer, the literature is further sub-categorized and then analyzed for notable trends, strengths, weaknesses and limitations as well as cross-compared for respective advantages and limitations. The simulation environments and datasets have been consolidated and unique insights are presented into each along with a summary of their advantages and disadvantages. Through extensive analysis, crucial challenges that remain in VLN are identified, guiding future efforts toward more intelligent and adaptable navigation agents.