Traditional methods of medical education often face challenges such as limited visual representation, lack of interactive experiences, and outdated technological integration. Generally, medical education often relies on static images or diagrams to represent complex anatomical structures, which can hinder students’ understanding and retention of information. Additionally, the lack of interactive experiences restricts students’ interaction and manipulation of anatomical models, creating a less engaging learning environment. This research offers a real-time, seamless method that tackles the noted difficulties by utilising AR technology. To give students a dynamic and engaging learning experience, the suggested AR-based solution seeks to project 3D human organs onto a tracked human body. Apart from that the user can interact with the superimposed organs in real-time using natural gestures and image markers. The proposed AR system leverages advanced technologies including a vision transformer for precise image recognition, deep learning techniques for human hand gesture recognition, and human pose tracking. By integrating these components, the system enables the accurate projection of organs onto a real-world environment, synchronized with the user’s movements. Interactions with the virtual organs are facilitated through intuitive gestures, allowing users to manipulate, scale, and rotate the projected organs effortlessly. To sum up, incorporating augmented reality into medical education presents a viable way to get around current obstacles and give students a more dynamic, immersive, and interesting educational experience. By promoting a greater comprehension and recall of intricate anatomical concepts, this method has the potential to transform medical education.