ChordFusion: Interactive Piano Training in Mixed Reality with Custom Gloves
摘要
Learning to play the piano can be a difficult and lengthy process, and many beginners lose motivation. While digital tools exist, they may not fully capture the experience of playing. This paper introduces ChordFusion, a piano training system using Mixed Reality (MR) and custom-built interactive gloves. ChordFusion aims to make learning more effective and engaging by using visualization, active learning, and game-like features in an immersive MR setting. The system includes different modes (Freestyle, Auto, Practice) to suit various learning styles. We describe the design of ChordFusion, how the custom gloves work, and our plans for future improvements, including testing with users to see how well it helps them learn, improving its responsiveness, and making the finger tracking more advanced for a realistic playing experience.