In the evolving landscape of deep learning, there is a pressing need for more comprehensive datasets capable of training models across multiple modalities. Concurrently, in digital humanities, there is a growing demand to leverage technology for diverse media adaptation and creation, yet limited by sparse datasets due to copyright and stylistic constraints. Addressing this gap, our paper presents a novel dataset comprising Franco-Belgian comics from the 1950s annotated for tasks including depth estimation, semantic segmentation, saliency detection, and character identification. It consists of two distinct and consistent styles and incorporates object concepts and labels taken from natural images. By including such diverse information across styles, this dataset not only holds promise for computational creativity but also offers avenues for the digitization of art and storytelling innovation. This dataset is a crucial component of the AI4VA Workshop Challenges https://sites.google.com/view/ai4vaeccv2024 , where we specifically explore depth and saliency. Dataset details at https://github.com/IVRL/AI4VA (Work done when PG, DB, BA, and BO were at EPFL and supported in part by the Swiss National Science Foundation via the Sinergia grant CRSII5-180359.).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Unlocking Comics: The AI4VA Dataset for Visual Understanding

  • Peter Grönquist,
  • Deblina Bhattacharjee,
  • Bahar Aydemir,
  • Baran Ozaydin,
  • Tong Zhang,
  • Mathieu Salzmann,
  • Sabine Süsstrunk

摘要

In the evolving landscape of deep learning, there is a pressing need for more comprehensive datasets capable of training models across multiple modalities. Concurrently, in digital humanities, there is a growing demand to leverage technology for diverse media adaptation and creation, yet limited by sparse datasets due to copyright and stylistic constraints. Addressing this gap, our paper presents a novel dataset comprising Franco-Belgian comics from the 1950s annotated for tasks including depth estimation, semantic segmentation, saliency detection, and character identification. It consists of two distinct and consistent styles and incorporates object concepts and labels taken from natural images. By including such diverse information across styles, this dataset not only holds promise for computational creativity but also offers avenues for the digitization of art and storytelling innovation. This dataset is a crucial component of the AI4VA Workshop Challenges https://sites.google.com/view/ai4vaeccv2024 , where we specifically explore depth and saliency. Dataset details at https://github.com/IVRL/AI4VA (Work done when PG, DB, BA, and BO were at EPFL and supported in part by the Swiss National Science Foundation via the Sinergia grant CRSII5-180359.).