We introduce a framework for transform static comic scans into non-linear, character-focused audiovisual narratives using automated analysis and synthesis. Our hierarchical panel and speech bubble segmentation algorithm incorporating spatial and semantic features. A character relationship graph and an emotion trajectory modeling system are proposed that facilitate dynamic narrative generation. A character-focused panel sequencing system allows nonlinear storytelling by adjusting the narrative flow to the user-chosen character. We present a system that synchronizes text animations in speech bubbles with audio for coherent audiovisual sequences. Experiments on benchmark datasets demonstrate the effectiveness of the framework in panel segmentation accuracy, character identification precision, and the quality of audiovisual narratives generated with synchronized text animations. Quantitative and qualitative analyses show significant improvements over existing approaches in handling complex layouts and maintaining narrative coherence.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Non-linear Audio-Visual Storytelling from Scanned Comics: A Character-Centric Approach

  • Ansh Kushwaha,
  • Sandeep Khanna,
  • Lenin Khangjrakpam,
  • Chiranjoy Chattopadhyay,
  • Gaurav Bhatnagar

摘要

We introduce a framework for transform static comic scans into non-linear, character-focused audiovisual narratives using automated analysis and synthesis. Our hierarchical panel and speech bubble segmentation algorithm incorporating spatial and semantic features. A character relationship graph and an emotion trajectory modeling system are proposed that facilitate dynamic narrative generation. A character-focused panel sequencing system allows nonlinear storytelling by adjusting the narrative flow to the user-chosen character. We present a system that synchronizes text animations in speech bubbles with audio for coherent audiovisual sequences. Experiments on benchmark datasets demonstrate the effectiveness of the framework in panel segmentation accuracy, character identification precision, and the quality of audiovisual narratives generated with synchronized text animations. Quantitative and qualitative analyses show significant improvements over existing approaches in handling complex layouts and maintaining narrative coherence.