Parameter-Efficient Fine-Tuning of BLIP2 for Arabic Question-Answering on Real-World Images
摘要
Visual language models have accelerated many multimodal tasks, such as generating image description and answering questions from images or videos. Most work in this field has focused on the English language, in contrast to the few efforts that have addressed Arabic. This paper aims to propose a new model for answering real-world Arabic image questions using the PEFT method on the BLIP2 model and the Arabic version of the DAQUAR dataset (Ara-DAQUAR). As a multi-label classification task, our proposed model yields high performance with a training loss of 0.3916, a validation loss of 0.4408, and a hamming accuracy of 92% after four epochs.