Contract review is a common challenge for governments, businesses, and individuals. It becomes challenging when manual reviews are slow, legal expertise is lacking, and clauses are complex. These issues often lead to legal disputes and business conflicts. Traditional rule-based contract review tools often struggle with ambiguous language and unstructured content. Large language models (LLM) can quickly analyze contracts and find risks. But, they are unreliable due to “hallucinations” and a lack of knowledge of rare clauses. This study used retrieval-augmented generation (RAG) technology to overcome these challenges. It integrated verified legal data with large language models. This improved review accuracy to 93.67%. The F1-scores reached 91.95% for compliant clauses and 94.79% for non-compliant ones. The ROC-AUC metric improved to 0.93. The results show that this approach works. It improves the classification and risk identification of contract clauses. It also helps in contract review in the legal and business sectors, promoting the use of legal tech.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Contract Pre-Review Assistance System Based on RAG and LLM

  • Chi-Hung Wang,
  • Xiang-Shun Yang,
  • Jun-Yi Liu,
  • Yao-Jun Liu

摘要

Contract review is a common challenge for governments, businesses, and individuals. It becomes challenging when manual reviews are slow, legal expertise is lacking, and clauses are complex. These issues often lead to legal disputes and business conflicts. Traditional rule-based contract review tools often struggle with ambiguous language and unstructured content. Large language models (LLM) can quickly analyze contracts and find risks. But, they are unreliable due to “hallucinations” and a lack of knowledge of rare clauses. This study used retrieval-augmented generation (RAG) technology to overcome these challenges. It integrated verified legal data with large language models. This improved review accuracy to 93.67%. The F1-scores reached 91.95% for compliant clauses and 94.79% for non-compliant ones. The ROC-AUC metric improved to 0.93. The results show that this approach works. It improves the classification and risk identification of contract clauses. It also helps in contract review in the legal and business sectors, promoting the use of legal tech.