In computer vision tasks, camouflaged object detection aims to detect highly covert objects, which has important practical significance in military reconnaissance, medical monitoring and other fields. In recent years, camouflaged object detection models based on Transformer have become a new research hotspot. However, the training cost of classic Transformer models is high, and the dot-product attention mechanism has a quadratic computational complexity, which will cause excessive memory usage and limit their application on embedded edge devices with limited memory and computing resources. In view of the above issues, a lightweight camouflaged target detection model E-UGTR with improved attention mechanism is proposed. By introducing a linear complexity attention mechanism to reduce the computational complexity of the model, a flexible attention mechanism control strategy is adopted to enhance the performance compatibility of the model under different computing resource requirements. Then, based on the UGTR model, a universal linear attention module E-Attention is introduced to design and implement a lightweight adaptive camouflaged object detection model E-UGTR. The experimental results show that on the common public data set, the training speed of the E-UGTR model is about 1.8 times that of the UGTR model, and the inference speed is about 1.5 times that of the UGTR model. When compared with other classic SOTA models, the E-UGTR model has strong compatibility and can maintain good detection performance while being lightweight.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Lightweight Camouflaged Object Detection Model Based on Improved Attention Mechanism

  • Jinyu Song,
  • Xianzhi Luo,
  • Li Jiang,
  • Yan Zhang,
  • Chun Liu

摘要

In computer vision tasks, camouflaged object detection aims to detect highly covert objects, which has important practical significance in military reconnaissance, medical monitoring and other fields. In recent years, camouflaged object detection models based on Transformer have become a new research hotspot. However, the training cost of classic Transformer models is high, and the dot-product attention mechanism has a quadratic computational complexity, which will cause excessive memory usage and limit their application on embedded edge devices with limited memory and computing resources. In view of the above issues, a lightweight camouflaged target detection model E-UGTR with improved attention mechanism is proposed. By introducing a linear complexity attention mechanism to reduce the computational complexity of the model, a flexible attention mechanism control strategy is adopted to enhance the performance compatibility of the model under different computing resource requirements. Then, based on the UGTR model, a universal linear attention module E-Attention is introduced to design and implement a lightweight adaptive camouflaged object detection model E-UGTR. The experimental results show that on the common public data set, the training speed of the E-UGTR model is about 1.8 times that of the UGTR model, and the inference speed is about 1.5 times that of the UGTR model. When compared with other classic SOTA models, the E-UGTR model has strong compatibility and can maintain good detection performance while being lightweight.