<p>The sizes of objects within an image can vary significantly. In particular, in fields such as construction, manufacturing, and healthcare, where image analysis directly affects human life and safety, it is crucial to accurately detect even small objects. To address this, the present study proposes a multiscale object detection model that employs the Pyramid Vision Transformer (PVT) as the backbone network for the YOLO model. This approach compensates for the limitations of the Spatial Pyramid Pooling Feature (SPPF) used in conventional YOLO models and improves the detection accuracy for small objects. The proposed transformer-based multiscale object detection model aims to effectively capture long-range dependencies while simplifying complex pre-processing and post-processing procedures. Furthermore, it generates feature maps at various resolutions, enabling multiscale feature representation and object detection. In particular, by leveraging Global Self-Attention, the model leverages contextual information from the entire image, thereby enhancing understanding of object relationships and improving overall scene comprehension.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multiscale object detection model based on pyramid vision transformer

  • Ji-Won Baek,
  • Dongjoon Suh,
  • Kyungyong Chung

摘要

The sizes of objects within an image can vary significantly. In particular, in fields such as construction, manufacturing, and healthcare, where image analysis directly affects human life and safety, it is crucial to accurately detect even small objects. To address this, the present study proposes a multiscale object detection model that employs the Pyramid Vision Transformer (PVT) as the backbone network for the YOLO model. This approach compensates for the limitations of the Spatial Pyramid Pooling Feature (SPPF) used in conventional YOLO models and improves the detection accuracy for small objects. The proposed transformer-based multiscale object detection model aims to effectively capture long-range dependencies while simplifying complex pre-processing and post-processing procedures. Furthermore, it generates feature maps at various resolutions, enabling multiscale feature representation and object detection. In particular, by leveraging Global Self-Attention, the model leverages contextual information from the entire image, thereby enhancing understanding of object relationships and improving overall scene comprehension.