Scholarlink

<p>Large Language Models (LLMs) offer a framework for understanding language processing in the human brain. Unlike traditional models, LLMs represent words and context through layered numerical embeddings. Here, we demonstrate that LLMs’ layer hierarchy aligns with the temporal dynamics of language comprehension in the brain. Using electrocorticography (ECoG) data from participants listening to a 30-minute narrative, we show that deeper LLM layers correspond to later brain activity, particularly in Broca’s area and other language-related regions. We extract contextual embeddings from GPT-2 XL and Llama-2 and use linear models to predict neural responses across time. Our results reveal a strong correlation between model depth and the brain’s temporal receptive window during comprehension. We also compare LLM-based predictions with symbolic approaches, highlighting the advantages of deep learning models in capturing brain dynamics. We release our aligned neural and linguistic dataset as a public benchmark to test competing theories of language processing.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Temporal structure of natural language processing in the human brain corresponds to layered hierarchy of large language models

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年11月26日

查看全文
  • Ariel Goldstein,
  • Eric Ham,
  • Mariano Schain,
  • Samuel A. Nastase,
  • Bobbi Aubrey,
  • Zaid Zada,
  • Avigail Grinstein-Dabush,
  • Harshvardhan Gazula,
  • Amir Feder,
  • Werner Doyle,
  • Sasha Devore,
  • Patricia Dugan,
  • Daniel Friedman,
  • Michael Brenner,
  • Avinatan Hassidim,
  • Yossi Matias,
  • Orrin Devinsky,
  • Noam Siegelman,
  • Adeen Flinker,
  • Omer Levy,
  • Roi Reichart,
  • Uri Hasson

摘要

Large Language Models (LLMs) offer a framework for understanding language processing in the human brain. Unlike traditional models, LLMs represent words and context through layered numerical embeddings. Here, we demonstrate that LLMs’ layer hierarchy aligns with the temporal dynamics of language comprehension in the brain. Using electrocorticography (ECoG) data from participants listening to a 30-minute narrative, we show that deeper LLM layers correspond to later brain activity, particularly in Broca’s area and other language-related regions. We extract contextual embeddings from GPT-2 XL and Llama-2 and use linear models to predict neural responses across time. Our results reveal a strong correlation between model depth and the brain’s temporal receptive window during comprehension. We also compare LLM-based predictions with symbolic approaches, highlighting the advantages of deep learning models in capturing brain dynamics. We release our aligned neural and linguistic dataset as a public benchmark to test competing theories of language processing.