Multimodal Pipeline for Underwater Artifact Detection and 3D Reconstruction with VLM and Gaussian Splatting
摘要
In this work, we present a complete pipeline for the detection and three-dimensional reconstruction of archaeological artifacts in underwater environments. Our approach leverages the advantages of Large Multimodal Models (LMMs) that allow for integrating historical, geographical, and contextual data with captured images, a necessary step in the identification and interpretation of objects of possible archaeological interest, otherwise unattainable through unimodal models. In addition to multimodal integration, our pipeline suggests the use of a 3D visualization method (Gaussian Splatting) that has not yet been applied to underwater archaeology but is, in many respects, a natural candidate to replace photogrammetry techniques, which encounter many problems in underwater environments. To demonstrate the effectiveness of the methodology, we have concretely implemented a version of this pipeline and applied it to the study of the wreck of the SS Main steamship (1892), located in Porto Pim Bay, Faial Island, Azores.