Autobiographical memory is a narrative form grounded in personal experiences. By recalling and organizing past events, individuals can document significant moments, facilitating emotional regulation and stress relief. While extensive research has demonstrated its positive impact on well-being, tools designed to support autobiographical narration remain underdeveloped. Compared to single modality, multimodal forms have been shown to be superior in memory retrieval. However, these methods often struggle to realize self-expression due to the limitations of the user’s creative abilities. To address this gap, we propose an innovative multimodal autobiographical narration system combining large language models (LLMs) and generative AI (GenAI). The system combines audio and visual formats by utilizing an LLM-based agent to guide users in recollection and a GenAI to tackle creative challenges. User studies show the system effectively supports high-quality autobiographical narratives and quickly generates multimodal works aligned with users’ content, providing a powerful tool for self-reflection and creative memory expression.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Multimodal Interactive System for Autobiographical Memory: AI-Assisted Reflection and Expression

  • Chongjun Zhong,
  • Jiaxing Yu,
  • Wenqi Wu,
  • Songruoyao Wu,
  • Hanshu Shen,
  • Kejun Zhang

摘要

Autobiographical memory is a narrative form grounded in personal experiences. By recalling and organizing past events, individuals can document significant moments, facilitating emotional regulation and stress relief. While extensive research has demonstrated its positive impact on well-being, tools designed to support autobiographical narration remain underdeveloped. Compared to single modality, multimodal forms have been shown to be superior in memory retrieval. However, these methods often struggle to realize self-expression due to the limitations of the user’s creative abilities. To address this gap, we propose an innovative multimodal autobiographical narration system combining large language models (LLMs) and generative AI (GenAI). The system combines audio and visual formats by utilizing an LLM-based agent to guide users in recollection and a GenAI to tackle creative challenges. User studies show the system effectively supports high-quality autobiographical narratives and quickly generates multimodal works aligned with users’ content, providing a powerful tool for self-reflection and creative memory expression.