On Combining Embeddings, Ontology and LLM to Retrieve Semantically Similar Quranic Verses and Generate Their Explanations
摘要
This paper presents a hybrid approach that not only retrieves semantically similar English translations of Quranic verse(s) against a query verse but also explains its results by generating natural language based explanations. The work aims to help in a better understanding of Quranic teachings by providing precise and clear explanations emphasizing commonalities in Quranic verses scattered at different places in Quran. The presented approach is a combination of embeddings, ontology and LLMs. Its performance was evaluated against a benchmark dataset, QurSim, and the quality of generated explanations results was evaluated using human evaluators. The hybrid approach performed better than a fine-tuned BERT and a custom-trained Word2Vec. Additionally, experiments show that the explanations generated by LLM(ChatGPT-3.5) are of good quality with a Completeness accuracy of 86% and a Correctness accuracy score of 83% as evaluated by human judges.