Scholarlink

Real-life explanations tend to be exchanged multimodally, and their expression needs to take into account the adequate sequencing and synchronization of the various modalities involved including speech, melodic/rhythmic structure and highlighting (aka prosody), manual gestures, head gestures, facial expressions, or posture changes, both within and between conversational partners. Whereas empirical research has not yet unfolded all details behind cross-modal synchronization, we know that a certain amount of it is a prerequisite for cross-modal signals to be integrated meaningfully, to increase the robustness of communication, to indicate the processing of an explanation, and to negotiate the seamless exchange of thoughts.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Timing and Synchronization of Multimodal Signals in Explanations

  • 章节

  • 出版模式：

    开放获取

  • 发表日期：

    2026年

查看全文
  • Petra Wagner,
  • Stefan Kopp

摘要

Real-life explanations tend to be exchanged multimodally, and their expression needs to take into account the adequate sequencing and synchronization of the various modalities involved including speech, melodic/rhythmic structure and highlighting (aka prosody), manual gestures, head gestures, facial expressions, or posture changes, both within and between conversational partners. Whereas empirical research has not yet unfolded all details behind cross-modal synchronization, we know that a certain amount of it is a prerequisite for cross-modal signals to be integrated meaningfully, to increase the robustness of communication, to indicate the processing of an explanation, and to negotiate the seamless exchange of thoughts.