Integrating Local Features Into Vision Transformer Architecture for Vietnamese Visual Question Answering
摘要
In this paper, we introduce a novel approach to the task of Visual Question Answering (VQA). The highlight of this approach is the integration of both local and global image features, which are then combined with linguistic features to enhance reasoning capabilities and improve the quality of VQA processing. We illustrate the effectiveness and feasibility of this strategy by conducting thorough evaluations on various combinations of these features. Also, we identify combination models with a high potential for future development. These evaluations also pave the way for future research aimed at developing and enhancing accuracy in VQA tasks. The contributions of this study will support researchers by enabling them to utilize the combined power of pre-trained models to enhance image reasoning capabilities in VQA.