A Lightweight Camouflaged Object Detection Model Based on Improved Attention Mechanism
摘要
In computer vision tasks, camouflaged object detection aims to detect highly covert objects, which has important practical significance in military reconnaissance, medical monitoring and other fields. In recent years, camouflaged object detection models based on Transformer have become a new research hotspot. However, the training cost of classic Transformer models is high, and the dot-product attention mechanism has a quadratic computational complexity, which will cause excessive memory usage and limit their application on embedded edge devices with limited memory and computing resources. In view of the above issues, a lightweight camouflaged target detection model E-UGTR with improved attention mechanism is proposed. By introducing a linear complexity attention mechanism to reduce the computational complexity of the model, a flexible attention mechanism control strategy is adopted to enhance the performance compatibility of the model under different computing resource requirements. Then, based on the UGTR model, a universal linear attention module E-Attention is introduced to design and implement a lightweight adaptive camouflaged object detection model E-UGTR. The experimental results show that on the common public data set, the training speed of the E-UGTR model is about 1.8 times that of the UGTR model, and the inference speed is about 1.5 times that of the UGTR model. When compared with other classic SOTA models, the E-UGTR model has strong compatibility and can maintain good detection performance while being lightweight.