Cross-Modal Communication Prototype System
摘要
Based on theoretical and technical investigations, in this chapter, several developed cross-modal communication prototype systems in the areas of industrial manipulation, smart education, and intelligent healthcare have been described. Firstly, a large-scale multimodal database named VisTouch has been established, which supports the research of cross-modal communications. Secondly, the details about the design and implementation of a visual-haptic human-machine interactive system are provided, which effectively meets the demands of the remote industrial robotic grasping applications. Thirdly, a virtual acupuncture skill training application is constructed to support the emerging remote practical teaching demands. Finally, a remote throat swab sampling platform is constructed, which is of great significance in protecting the lives of medical staff and breaking the chains of virus transmission during the COVID-19 pandemic.