Digital twins and immersive mixed reality have been improving digital transformation within the industrial context. In computer vision, photogrammetry-based techniques for 3D environment reconstruction make it possible to create virtual models of real scenery based on a set of digital images. This paper addresses the problem of building virtual layouts through the 3D mapping of the real environment and its corresponding digital twin, with a focus on human interaction and training. In the context of human-in-the-loop and Industry 5.0, the research goal is to define a method for preparing humans to be trained using synthetic information, enabling them to perform the real operations required in some productive processes. Through photogrammetry using images, layouts and objects can be recreated, but it is essential to evaluate the accuracy and richness of details to reconstruct a realistic process. Thus, we studied the main technological requirements to perform an automated method for shop-floor layout digitalization and digital twin creation, allowing humans to interact and simulate operations as in a real industrial scenario. The research conducts this investigation using a manufacturing automation laboratory and addresses experimental digitalization task planning.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Manufacturing Simulation: A Computer Vision Approach with Immersive Technologies and Digital Twins

  • Marcelo Rudek,
  • Ana Paula Rafael Valle,
  • Ricardo Bertolin

摘要

Digital twins and immersive mixed reality have been improving digital transformation within the industrial context. In computer vision, photogrammetry-based techniques for 3D environment reconstruction make it possible to create virtual models of real scenery based on a set of digital images. This paper addresses the problem of building virtual layouts through the 3D mapping of the real environment and its corresponding digital twin, with a focus on human interaction and training. In the context of human-in-the-loop and Industry 5.0, the research goal is to define a method for preparing humans to be trained using synthetic information, enabling them to perform the real operations required in some productive processes. Through photogrammetry using images, layouts and objects can be recreated, but it is essential to evaluate the accuracy and richness of details to reconstruct a realistic process. Thus, we studied the main technological requirements to perform an automated method for shop-floor layout digitalization and digital twin creation, allowing humans to interact and simulate operations as in a real industrial scenario. The research conducts this investigation using a manufacturing automation laboratory and addresses experimental digitalization task planning.