A computer vision framework for proactive anomaly detection and risk reduction in airport baggage logistics
摘要
This research addresses the challenges in airport baggage handling, focusing on the automated detection of key components-bags, handles, straps-and the identification of damages such as cracks. The proposed system employs the YOLOv8 algorithm for object detection and instance segmentation, trained on a self-generated dataset of 2528 images. For bag accessory detection, the model achieved precision, recall, and F1-scores of 0.92, 0.88, and 0.90 for bags; 0.89, 0.94, and 0.91 for handles; and 0.74, 0.58, and 0.65 for straps, respectively. For damage (crack) detection, YOLOv8’s instance segmentation attained a precision of 0.75, recall of 0.80, F1-score of 0.77, and mean Average Precision (mAP) of 0.76. These results indicate robust detection performance for bags and handles, with scope for improvement in strap and damage detection. A novel aspect of this work is the integration of OpenAI GPT-4 Vision into the baggage inspection pipeline. GPT-4 Vision was employed to perform higher-level reasoning on the detection outputs-such as contextual verification of detected components, natural language description of detected damages, and flagging of anomalies-thereby complementing YOLOv8’s pixel-level predictions with semantic analysis. This hybrid approach enables not only precise localization of components and damages but also contextual interpretation, making the system more adaptable to real-world operational variability. We additionally report deployment-oriented runtime metrics: accessory detection (YOLOv8s) runs at