This companion paper provides a detailed account of the EMPATH framework [8], which integrates Ensemble Learning, MediaPipe Holistic for gesture tracking, and an Attention-based Transformer model, along with practical insights on designing an effective recognition model. It focuses on the architecture, workflow and offers an in-depth explanation of the interpolation method for handling missing hand keypoints. Additionally, the paper highlights ablation studies on augmentation techniques and key limitations encountered during development and implementation, providing valuable insights for enhancing the reproducibility and performance of word-level sign language recognition using EMPATH.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Implementation and Reproducibility Notes on EMPATH: Enhancing Word-Level Sign Language Recognition

  • Kazi Reyazul Hasan,
  • Muhammad Abdullah Adnan

摘要

This companion paper provides a detailed account of the EMPATH framework [8], which integrates Ensemble Learning, MediaPipe Holistic for gesture tracking, and an Attention-based Transformer model, along with practical insights on designing an effective recognition model. It focuses on the architecture, workflow and offers an in-depth explanation of the interpolation method for handling missing hand keypoints. Additionally, the paper highlights ablation studies on augmentation techniques and key limitations encountered during development and implementation, providing valuable insights for enhancing the reproducibility and performance of word-level sign language recognition using EMPATH.