Human Motion Capture (MoCap) involves tracking and recording human movements. Image-based MoCap systems have gained significant research interest, particularly for their simplified deployment that eliminates the requirement for reflective markers and wearable sensors. However, the deployment of such systems faces two major challenges: temporal misalignments caused by unsynchronized cameras and the sparsity of detectable features on human bodies. To address these limitations, we propose a marker-free MoCap system built on unsynchronized cameras. For the temporal misalignment issue, we introduce two crucial components: multi-view temporal post-processing and temporal augmentation training, which enable automatic temporal alignment across multiple cameras. To overcome feature sparsity, we define virtual markers as 3D surface points on the human mesh model. Experimental results validate the high performance of our system in global marker localization. The proposed approach presents a scalable and flexible solution for MoCap deployment in unconstrained environments, showing promise for applications in mobile health monitoring and sports training.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Marker-Free Motion Capture System Built on Unsynchronized Cameras

  • Haofei Hou,
  • Shunyi Zhao,
  • Zuxin Fan,
  • Wei Jin,
  • Jintao Zhu,
  • Lecheng Ruan,
  • Qining Wang

摘要

Human Motion Capture (MoCap) involves tracking and recording human movements. Image-based MoCap systems have gained significant research interest, particularly for their simplified deployment that eliminates the requirement for reflective markers and wearable sensors. However, the deployment of such systems faces two major challenges: temporal misalignments caused by unsynchronized cameras and the sparsity of detectable features on human bodies. To address these limitations, we propose a marker-free MoCap system built on unsynchronized cameras. For the temporal misalignment issue, we introduce two crucial components: multi-view temporal post-processing and temporal augmentation training, which enable automatic temporal alignment across multiple cameras. To overcome feature sparsity, we define virtual markers as 3D surface points on the human mesh model. Experimental results validate the high performance of our system in global marker localization. The proposed approach presents a scalable and flexible solution for MoCap deployment in unconstrained environments, showing promise for applications in mobile health monitoring and sports training.