Quantitative Observation to Explore the Turn-Changing Mechanisms of Conversations in Remote Meetings Accompanying Supplemental Materials

This study investigates turn-taking mechanisms in remote meetings involving supplemental materials, such as document browsing and chat tools, by comparing them with collocated meetings. We acquired multimodal datasets, including data on gaze, head movements, pupil size, speech audio, and utterance content, and analyzed gaze behavior during turn-taking and turn-giving instances. Our findings suggest that in collocated meetings, participants tend to gaze at the shared document during turn-changing, while in remote meetings, this tendency is weaker, and participants’ attention is more dispersed. Furthermore, we observed that participants are less likely to engage in document browsing in remote meetings than in collocated meetings where unintentional eye contact is likely to occur. Based on these results, we propose four hypotheses regarding turn-changing mechanisms in remote meetings accompanying supplemental materials. This study contributes to the understanding of turn-changing mechanisms in remote meetings by providing insights into the relationship between gaze, turn-taking, and the role of supplemental materials. We discuss the implications of our findings and outline future work.