The advances in virtual and mixed-reality technologies have provided new opportunities to promote interactive experiences and real-time monitoring in advanced manufacturing. The objective of this study is to develop a data visualization and information fusion platform using VR/XR to assist operators and field engineers in monitoring the equipment in real time. This study employs XR to develop a mixed twin in an advanced manufacturing setting while using computer vision techniques to provide an immersive experience for operators. This immersive experience will allow users to visualize the processes in an information-rich environment and help dynamic and intelligent decision-making. This platform provides a dynamic and interactive 3D model of the physical environment, complete with functional digital replicas of key industrial equipment. A case study of virtual assembly is presented to demonstrate the potential of the proposed framework. The findings of this research highlight the potential of mixed reality to transform user experiences in various applications in the manufacturing industry and workforce development, as well as offer advances in remote equipment monitoring.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Immersive Experiences: Computer Vision Enhanced Mixed Reality in Smart Manufacturing

  • Oscar Martinez,
  • Carolina Leal,
  • Jorge Mellado,
  • Arturo Meza,
  • Ariel Trejo,
  • Jianzhi Li,
  • Zhaohui Geng

摘要

The advances in virtual and mixed-reality technologies have provided new opportunities to promote interactive experiences and real-time monitoring in advanced manufacturing. The objective of this study is to develop a data visualization and information fusion platform using VR/XR to assist operators and field engineers in monitoring the equipment in real time. This study employs XR to develop a mixed twin in an advanced manufacturing setting while using computer vision techniques to provide an immersive experience for operators. This immersive experience will allow users to visualize the processes in an information-rich environment and help dynamic and intelligent decision-making. This platform provides a dynamic and interactive 3D model of the physical environment, complete with functional digital replicas of key industrial equipment. A case study of virtual assembly is presented to demonstrate the potential of the proposed framework. The findings of this research highlight the potential of mixed reality to transform user experiences in various applications in the manufacturing industry and workforce development, as well as offer advances in remote equipment monitoring.