Approaches of Safe and Efficient 3D UAM Traffic Management Using VR, AR, and MR with AI; HCI Requirements for Digital Twin Application

This paper highlights the digital twin (DT) application that utilizes VR/AR/MR to develop high-level urban air mobility (UAM) operation monitoring systems. UAM operations may require precision 3D maps for planning, monitoring, and debriefing purposes. Recent VR and MR technologies have implemented vivid 3D graphics, and these are subject to the digital twin (DT) for the UAM monitoring system. Digital twin (DT) is a virtual content that visualizes synchronized features of an existing system of interest. DT has two paradigms—functional DT and physio-functional DT for its usage. This paper proceeds with a discussion of six human-DT interaction issues—the reality of 3D graphics, AI functions, DT users’ allocentric versus egocentric viewpoints, accuracy of spatial synchronization, and systems engineering process—for safe and efficient UAM operations.