3D skeleton based gait representations have been widely applied to various areas with many advantages, while most existing models lack the ability to provide intuitive or human-understandable explanations for the effectiveness of learned representations. In this work, we propose a general 3D skeleton based Gait Visualization and Analysis (3DGVA) platform, which can not only interactively present unified skeleton-based gait patterns but also provide the visualization of feature-based gait ranking for qualitative evaluation. Moreover, 3DGVA synergizes large language models (LLMs) to perform automatic gait analysis to facilitate users’ model assessment with explainable reasoning. Our 3DGVA platform is able to visualize and analyze different state-of-the-art skeleton-based models for person re-identification, gait score prediction, disease prediction tasks, and can be potentially extended to more related interdisciplinary applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LLM-Powered Interpretable 3D Gait Visualization and Analysis Platform for Interdisciplinary AI Applications

  • Haocong Rao,
  • Jiachen Zhao,
  • Chunyan Miao

摘要

3D skeleton based gait representations have been widely applied to various areas with many advantages, while most existing models lack the ability to provide intuitive or human-understandable explanations for the effectiveness of learned representations. In this work, we propose a general 3D skeleton based Gait Visualization and Analysis (3DGVA) platform, which can not only interactively present unified skeleton-based gait patterns but also provide the visualization of feature-based gait ranking for qualitative evaluation. Moreover, 3DGVA synergizes large language models (LLMs) to perform automatic gait analysis to facilitate users’ model assessment with explainable reasoning. Our 3DGVA platform is able to visualize and analyze different state-of-the-art skeleton-based models for person re-identification, gait score prediction, disease prediction tasks, and can be potentially extended to more related interdisciplinary applications.