Enhancing RAG System Performance Through Semantic Layout Chunking
摘要
Retrieval-Augmented Generation (RAG) has proven effective in enhancing large language model (LLM) performance on tasks that require up-to-date, private, or domain-specific knowledge. In RAG systems, documents are segmented into chunks and stored in vector databases ready for retrieval. However, while the chunking strategy plays a critical role in overall system performance, it is often overlooked in RAG system implementation. Common strategies include chunking by character or token count, or using recursive splitting. Although recent research has introduced more advanced approaches, these typically rely either on semantic coherence between sentences or on presentational layout cues to determine chunk boundaries. We propose that semantic layout chunking better preserves both structural integrity and semantic flow, particularly in formal documents that follow logical organizational patterns. Our method integrates semantic labels during chunk storage to enable structure retrieval. We evaluated this approach using the Unstructured Document Analysis (UDA) dataset, which contains PDF documents across multiple domains, comparing it against purely semantic and boundary-aware baselines on retrieval accuracy and question-answering accuracy. The results show that our method achieves superior performance compared to existing approaches, demonstrating the value of combining semantic and structural signals for document chunking in RAG systems.