Scholarlink

<p>Efficient decision-making in context-dependent, sequential tasks remains a fundamental challenge in reinforcement learning (RL). Inspired by the function of the brain’s hippocampal system, we introduce Hippocampal-Augmented Memory Integration (HAMI), a biologically inspired memory-based RL framework that leverages symbolic indexing, hierarchical memory refinement, and structured episodic retrieval to enhance both learning efficiency and adaptability. We also propose Hierarchical Contextual Sequences (HiCoS), a structured RL environment grounded in neuroscience studies on episodic and sequence memory and context-driven decision-making, which serves as a controlled testbed for evaluating biologically inspired memory-based decision-making systems. Our experimental results demonstrate that HAMI achieves high decision accuracy and improved sample efficiency while maintaining low memory utilization. HAMI’s architecture exhibits significantly lower inference latency than baseline memory-based methods, and its structured retrieval is well-suited for further hardware acceleration with non-volatile memory (NVM)-based content-addressable memory (CAM). By integrating biologically inspired memory mechanisms with structured symbolic representations, HAMI provides a scalable and efficient memory-based RL framework for tackling context-dependent sequential tasks.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A scalable reinforcement learning framework inspired by hippocampal memory mechanisms for efficient contextual and sequential decision making

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年7月12日

查看全文
  • Hamed Poursiami,
  • Ayana Moshruba,
  • Keiland W. Cooper,
  • Derek Gobin,
  • Md Abdullah-Al Kaiser,
  • Ankur Singh,
  • Rouhan Noor,
  • Babak Shahbaba,
  • Akhilesh Jaiswal,
  • Norbert J. Fortin,
  • Maryam Parsa

摘要

Efficient decision-making in context-dependent, sequential tasks remains a fundamental challenge in reinforcement learning (RL). Inspired by the function of the brain’s hippocampal system, we introduce Hippocampal-Augmented Memory Integration (HAMI), a biologically inspired memory-based RL framework that leverages symbolic indexing, hierarchical memory refinement, and structured episodic retrieval to enhance both learning efficiency and adaptability. We also propose Hierarchical Contextual Sequences (HiCoS), a structured RL environment grounded in neuroscience studies on episodic and sequence memory and context-driven decision-making, which serves as a controlled testbed for evaluating biologically inspired memory-based decision-making systems. Our experimental results demonstrate that HAMI achieves high decision accuracy and improved sample efficiency while maintaining low memory utilization. HAMI’s architecture exhibits significantly lower inference latency than baseline memory-based methods, and its structured retrieval is well-suited for further hardware acceleration with non-volatile memory (NVM)-based content-addressable memory (CAM). By integrating biologically inspired memory mechanisms with structured symbolic representations, HAMI provides a scalable and efficient memory-based RL framework for tackling context-dependent sequential tasks.