A Scalable Retrieval-Augmented Generation Pipeline for Reliable Biomedical Question Answering
摘要
The explosive growth of biomedical literature in PubMed creates a challenge for the retrieval of accurate and context-sensitive information. To address this, we introduce a PubMed-integrated Retrieval-Augmented Generation (RAG) framework that integrates Google's Gemini 1.5 Flash with semantic storage in ChromaDB. Biomedical abstracts are dynamically queried using NCBI E-utilities, pre-processed using XML parsing, cleaning, and chunking, prior to being semantically embedded using Google Generative AI embeddings. The resultant embeddings are stored in Chroma DB to facilitate effective similarity-based retrieval and context-aware response generation. Upon receiving user queries, the system enriches them with appropriate PubMed fragments and uses Gemini to generate response with supporting citation. Experimental analysis reports an overall accuracy of 81%, demonstrating a reduction in hallucination on biomedical queries. Conversely, Gemini without retrieval (no RAG) attained 62% accuracy, highlighting the efficacy of the new method. Qualitative case studies, such as papillary thyroid cancer and Paget disease, also reinforce factual grounding, traceability of citations, and openness. The framework thus shows an evidence-based, scalable assistant to facilitate biomedical research, clinical decision support, and higher education.