Efficient framework for sport actions identification and analysis in real-time fitness videos using neural network
摘要
Accurate identification and fine analysis of sports actions in real-time videos for athletes, especially fitness exercises, is a difficult task in computer vision and remains a challenge due to the similarity of some actions. Aiming to improve the athletes’ performances and the robustness of actions classifying systems from videos sport in both real-time and pre-recorded scenarios, we propose in this paper a deep learning model for classifying 16 fitness exercises based on normalized key body landmarks. The MediaPipe pose estimation model is used to extract the key body landmarks. These latter are then used as training data for the learning model to accurately predict exercises poses. Finally, two measures are defined using the extracted key landmarks to provide a detailed and comprehensive analysis of the exercises. Various experiments are conducted on real and pre-recorded videos. The obtained results demonstrate the performance of our approach. The proposed framework gives promising results in effectively classifying fitness exercises, offering potential advancements in monitoring and guidance within fitness training programs in order to evaluate and improve the performance of athletic actions.