<p>Vision–language models (VLMs) increasingly evaluate visual content, yet their behaviour across cultural traditions remains poorly characterised. We show that two open-weight VLMs, Qwen3-VL-8B and Llama-3.2-11B-Vision, assign systematically lower aesthetic-quality scores (model-generated ratings on a 1–10 scale) to East Asian art than to Western art, with Cohen’s <i>d</i>&#xa0;=&#xa0;<InlineEquation ID="IEq1"><EquationSource Format="TEX">\(-0.46\)</EquationSource></InlineEquation> and <InlineEquation ID="IEq2"><EquationSource Format="TEX">\(-0.36\)</EquationSource></InlineEquation> (<InlineEquation ID="IEq3"><EquationSource Format="TEX">\(p &lt; 10^{-16}\)</EquationSource></InlineEquation>). Internal probing reveals this disparity is accompanied by higher encoding cost under the primary reference sentence, elevated perplexity, reduced token confidence, and increased hidden-state norms. Across the two tested models, fifteen of eighteen signals shift in the same direction, indicating a consistent cross-model pattern; Llama cross-attention entropy shows a large effect (<i>d</i>&#xa0;=&#xa0;<InlineEquation ID="IEq4"><EquationSource Format="TEX">\(+1.30\)</EquationSource></InlineEquation>, <InlineEquation ID="IEq5"><EquationSource Format="TEX">\(p &lt; 10^{-178}\)</EquationSource></InlineEquation>). The gap persists across decoding temperatures (<InlineEquation ID="IEq6"><EquationSource Format="TEX">\(T \in \{0,\, 0.5,\, 1\}\)</EquationSource></InlineEquation>; all <InlineEquation ID="IEq7"><EquationSource Format="TEX">\(p &lt; 10^{-7}\)</EquationSource></InlineEquation>), reproduces at the group level under repeated stochastic sampling, and remains when the rating prompt’s cultural-significance criterion is removed, suggesting that it is not driven solely by stochastic decoding or by an explicit cultural-evaluation instruction. Hidden-state clustering places East Asian art in broadly overlapping representational regions relative to Western art, and keyword-based response analysis shows frequent Chinese lexical attribution for Korean artworks (88% Qwen, 65% Llama). In Qwen, matched-complexity analysis shows 87% of the score gap persists after controlling for image spectral properties. These results show that internal probing can help detect cross-cultural processing differences in the tested VLMs.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Internal probing reveals processing asymmetry accompanying cross-cultural aesthetic score disparities in vision–language models

  • Ji Ho Bae,
  • Hwan-wook Jung

摘要

Vision–language models (VLMs) increasingly evaluate visual content, yet their behaviour across cultural traditions remains poorly characterised. We show that two open-weight VLMs, Qwen3-VL-8B and Llama-3.2-11B-Vision, assign systematically lower aesthetic-quality scores (model-generated ratings on a 1–10 scale) to East Asian art than to Western art, with Cohen’s d = \(-0.46\) and \(-0.36\) (\(p < 10^{-16}\)). Internal probing reveals this disparity is accompanied by higher encoding cost under the primary reference sentence, elevated perplexity, reduced token confidence, and increased hidden-state norms. Across the two tested models, fifteen of eighteen signals shift in the same direction, indicating a consistent cross-model pattern; Llama cross-attention entropy shows a large effect (d = \(+1.30\), \(p < 10^{-178}\)). The gap persists across decoding temperatures (\(T \in \{0,\, 0.5,\, 1\}\); all \(p < 10^{-7}\)), reproduces at the group level under repeated stochastic sampling, and remains when the rating prompt’s cultural-significance criterion is removed, suggesting that it is not driven solely by stochastic decoding or by an explicit cultural-evaluation instruction. Hidden-state clustering places East Asian art in broadly overlapping representational regions relative to Western art, and keyword-based response analysis shows frequent Chinese lexical attribution for Korean artworks (88% Qwen, 65% Llama). In Qwen, matched-complexity analysis shows 87% of the score gap persists after controlling for image spectral properties. These results show that internal probing can help detect cross-cultural processing differences in the tested VLMs.