For the healthy development and growth of children, it is essential for caregivers to understand what children are thinking in their daily lives. However, understanding young children’s thoughts is often challenging. To understand children’s thoughts, knowing what they are looking at in that moment can serve as a clue. In this study, we propose a method that enables caregivers to experience a child’s field of view for any scene in the recorded video. Since attaching an eye-tracking camera to a child is difficult, our method reconstructs the child’s field of view using only external cameras. To achieve this, we developed a system that visualizes images captured by multiple depth sensors as three-dimensions point cloud data. The skeleton of the child was detected from the recorded video, and their field of view was estimated based on the extracted skeletal data. Additionally, our system allows caregivers to view the same scene from a bird’s-eye view, providing a broader understanding of the surrounding environment. We created a prototype of the proposed system and conducted an evaluation experiment in which we recorded play scenes. Afterward, parents watched the child’s viewpoint video using the prototype and participated in interviews. The result indicated that viewing videos from a child’s perspective enhanced the parents’ understanding of the child’s emotions. These findings suggested that the proposed system may facilitate a deeper understanding of children’s thoughts. However, due to the coarse image quality, capturing detailed facial expressions remains challenging, highlighting the need for further improvements to enhance children’s understanding.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

System for Experiencing the View of the Filmed Subject Using External Cameras: Case Study of Promoting Children’s Understanding

  • Ryota Doi,
  • Momoko Nakatani

摘要

For the healthy development and growth of children, it is essential for caregivers to understand what children are thinking in their daily lives. However, understanding young children’s thoughts is often challenging. To understand children’s thoughts, knowing what they are looking at in that moment can serve as a clue. In this study, we propose a method that enables caregivers to experience a child’s field of view for any scene in the recorded video. Since attaching an eye-tracking camera to a child is difficult, our method reconstructs the child’s field of view using only external cameras. To achieve this, we developed a system that visualizes images captured by multiple depth sensors as three-dimensions point cloud data. The skeleton of the child was detected from the recorded video, and their field of view was estimated based on the extracted skeletal data. Additionally, our system allows caregivers to view the same scene from a bird’s-eye view, providing a broader understanding of the surrounding environment. We created a prototype of the proposed system and conducted an evaluation experiment in which we recorded play scenes. Afterward, parents watched the child’s viewpoint video using the prototype and participated in interviews. The result indicated that viewing videos from a child’s perspective enhanced the parents’ understanding of the child’s emotions. These findings suggested that the proposed system may facilitate a deeper understanding of children’s thoughts. However, due to the coarse image quality, capturing detailed facial expressions remains challenging, highlighting the need for further improvements to enhance children’s understanding.