Enhancing Immersive Experiences: Computer Vision Enhanced Mixed Reality in Smart Manufacturing
摘要
The advances in virtual and mixed-reality technologies have provided new opportunities to promote interactive experiences and real-time monitoring in advanced manufacturing. The objective of this study is to develop a data visualization and information fusion platform using VR/XR to assist operators and field engineers in monitoring the equipment in real time. This study employs XR to develop a mixed twin in an advanced manufacturing setting while using computer vision techniques to provide an immersive experience for operators. This immersive experience will allow users to visualize the processes in an information-rich environment and help dynamic and intelligent decision-making. This platform provides a dynamic and interactive 3D model of the physical environment, complete with functional digital replicas of key industrial equipment. A case study of virtual assembly is presented to demonstrate the potential of the proposed framework. The findings of this research highlight the potential of mixed reality to transform user experiences in various applications in the manufacturing industry and workforce development, as well as offer advances in remote equipment monitoring.