Intuitive Control of Virtual Drone for Teaching Drone Pilots Using Leap Motion in Unity Environment
摘要
The interaction of the user of a physical or virtual system is referred to as human-machine interaction (HMI), which can be broadly classified into contact and non-contact type. Recent developments have brought about the development of non-contact-based interaction methods which can send commands to machines without requiring physical contact. But these generally depend on image processing, motion and gesture recognition, etc. In this paper, the development of a 3D environment for the control of a virtual drone using Leap Motion device is reported, where the hands of a user are tracked by Leap Motion and based on the intent of the user, the drone moves in the virtual environment developed using Unity. This was tested among different users, and it was found that the accuracy and ease of usage improved with practice, which can be further used as the first step of drone pilot training.