Accurate understanding of the transportation environment is fundamental for enabling mobility. To support this need, image-based surveying techniques such as photogrammetry and remote sensing play a critical role in capturing detailed spatial information. In this study, we focus on the technical advancement of image data processing for such applications. Transformer-based neural networks have significantly advanced the field of computer vision, including aerial image analysis. However, their increasing computational and memory demands pose practical challenges, especially in large-scale photogrammetric workflows. This research explores the impact of transformer network compression on aerial photogrammetry and semantic segmentation performance. Using the ISPRS-EuroSDR Benchmark dataset, we apply various compression methods via the CompressAI framework to high-resolution aerial images. Standard photogrammetric pipelines are then used to generate 3D point clouds from both original and compressed image sets, allowing us to evaluate geometric reconstruction fidelity. Additionally, transformer models are trained to perform semantic segmentation across three land cover classes, assessing the influence of compression on classification accuracy. Key evaluation metrics—such as PSNR, SSIM, IoU, and point cloud completeness and accuracy—are used to quantify the trade-offs. The results provide practical insights into balancing compression efficiency with data quality, and inform the deployment of transformer models in bandwidth-constrained or resource-limited aerial mapping scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Effect of Transformer Neural Network Compression on Aerial Photogrammetry

  • Viktor Győző Horváth,
  • Árpád Barsi

摘要

Accurate understanding of the transportation environment is fundamental for enabling mobility. To support this need, image-based surveying techniques such as photogrammetry and remote sensing play a critical role in capturing detailed spatial information. In this study, we focus on the technical advancement of image data processing for such applications. Transformer-based neural networks have significantly advanced the field of computer vision, including aerial image analysis. However, their increasing computational and memory demands pose practical challenges, especially in large-scale photogrammetric workflows. This research explores the impact of transformer network compression on aerial photogrammetry and semantic segmentation performance. Using the ISPRS-EuroSDR Benchmark dataset, we apply various compression methods via the CompressAI framework to high-resolution aerial images. Standard photogrammetric pipelines are then used to generate 3D point clouds from both original and compressed image sets, allowing us to evaluate geometric reconstruction fidelity. Additionally, transformer models are trained to perform semantic segmentation across three land cover classes, assessing the influence of compression on classification accuracy. Key evaluation metrics—such as PSNR, SSIM, IoU, and point cloud completeness and accuracy—are used to quantify the trade-offs. The results provide practical insights into balancing compression efficiency with data quality, and inform the deployment of transformer models in bandwidth-constrained or resource-limited aerial mapping scenarios.