Real-time quality assessment of indoor 2D and 3D point clouds using VGG16 with multimodal feature fusion
摘要
This study presents a real-time deep learning framework for no-reference quality assessment of indoor 3D point clouds. The proposed method combines geometric descriptors-curvature, planarity, and sphericity-with LAB color features using a multimodal fusion strategy. Segmented point cloud patches are converted into pseudo-image tensors and fed into a fine-tuned VGG16 model to estimate local quality scores. These scores are aggregated into a Global Quality Index (GQI) to evaluate overall scene quality. The framework is implemented on a Raspberry Pi with a depth camera to enable on-device real-time processing. Unlike existing methods, this is one of the first frameworks to achieve real-time, no-reference point cloud quality assessment with edge device implementation. Experimental results validate its accuracy and robustness across various indoor conditions, demonstrating advantages over traditional and deep learning-based baselines.