Scholarlink

<p>Although general Multimodal Large Language Models (MLLMs) benchmarks are prevalent, systematic evaluation for oracle bone inscriptions remains underdeveloped. Oracle bone glyph, as cultural heritage artifacts, present severe degradation, stylistic variation, and cross-tablet heterogeneity, posing challenges to evaluating multifaceted MLLM capabilities. To address this, we propose the Dual-Alignment Oracle Character Reasoning Benchmark (DAOCR-Bench), which evaluates structural perception, semantic grounding, reconstruction, and consistency judgment across four competency levels. Experiments on 18 MLLMs reveal substantial performance differences under standardized and degraded oracle bone conditions, with GPT-4o achieving the highest comprehensive score in our evaluation. This benchmark provides a standardized framework for oracle bone analysis and advances computational paleography.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Structure–semantic dual-alignment benchmarking of large language model capability on ancient oracle bone inscriptions

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年7月3日

查看全文
  • Kelvin K. L. Wong,
  • Jie Tu,
  • Shitong Jiang,
  • Bin Tang,
  • Yi Xiao,
  • Francesco Vigliarolo,
  • Colin Rhodes

摘要

Although general Multimodal Large Language Models (MLLMs) benchmarks are prevalent, systematic evaluation for oracle bone inscriptions remains underdeveloped. Oracle bone glyph, as cultural heritage artifacts, present severe degradation, stylistic variation, and cross-tablet heterogeneity, posing challenges to evaluating multifaceted MLLM capabilities. To address this, we propose the Dual-Alignment Oracle Character Reasoning Benchmark (DAOCR-Bench), which evaluates structural perception, semantic grounding, reconstruction, and consistency judgment across four competency levels. Experiments on 18 MLLMs reveal substantial performance differences under standardized and degraded oracle bone conditions, with GPT-4o achieving the highest comprehensive score in our evaluation. This benchmark provides a standardized framework for oracle bone analysis and advances computational paleography.