Simulation in the field of robotics is a less costly, safer, more scalable, and more versatile alternative to real-world scenarios. In this work, we present a pipeline for the digital reconstruction of environments using the panoptic segmentation technique . The overall aim is to automate the transcription of real geometries into the digital environment, creating a virtual scene where objects are meticulously segmented, making it possible to manipulate, replicate, remove, and practically move these objects. The methodology is based on Neural Radiance Field for segmentation and reconstruction of scenes, classical methods for manipulating structures, SDFormat as a scene description file, and Gazebo as a 3D robotic simulation platform . The results show that the method is capable of transcribing the scene into a virtual environment and using it as a space for testing, validating, and training robots.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Digital Environment Description and Reconstruction Using Panoptic Segmentation

  • João Francisco de Souza Santos Lemos,
  • Gabriel Amaral Dorneles,
  • Igor Pardo Maurell,
  • Stephanie Loi Brião,
  • Rodrigo da Silva Guerra,
  • Paulo Lilles Jorge Drews Junior

摘要

Simulation in the field of robotics is a less costly, safer, more scalable, and more versatile alternative to real-world scenarios. In this work, we present a pipeline for the digital reconstruction of environments using the panoptic segmentation technique . The overall aim is to automate the transcription of real geometries into the digital environment, creating a virtual scene where objects are meticulously segmented, making it possible to manipulate, replicate, remove, and practically move these objects. The methodology is based on Neural Radiance Field for segmentation and reconstruction of scenes, classical methods for manipulating structures, SDFormat as a scene description file, and Gazebo as a 3D robotic simulation platform . The results show that the method is capable of transcribing the scene into a virtual environment and using it as a space for testing, validating, and training robots.