<p>Legal dispute resolution hinges on the weighing of evidence and arguments across parties, yet human biases and bounded rationality can influence outcomes. Simulating this process with large language models can clarify both the capabilities and the anthropomorphic behavior. Most existing studies focus on algorithmic support for adjudication, such as online courts, risk assessment, and sentencing tools. At the same time, the role of AI agents in mediation and conciliatory negotiation remains largely untested. To address this gap, the study designs six scenario types and evaluates them on a multi-agent platform. It addresses two questions: (i) To what extent can LLM agents produce realistic simulations from a juridical perspective? We find that LLMs can reproduce diverse dispute scenarios, but performance varies by role; in particular, judge agents sometimes commit serious legal errors when interpreting clauses and may infer property rights rather than apply the correct rules. (ii) Do sensitive factors and intrinsic properties affect legal dispute resolution? Sensitivity analyses across model-level configurations, framework design choices, and procedural settings confirm the robustness of our findings; we further observe irrational patterns yielding mechanical or unexpected decisions and measurable effects from intrinsic properties. These findings show strengths in fact-heavy money bargaining and mixed remedies, while highlighting limits where careful discretion and normative justification are required. Code and scenarios are publicly available for replication (<a href="https://github.com/TOM-ZHOUch/Legal_Dispute_Resolution">https://github.com/TOM-ZHOUch/Legal_Dispute_Resolution</a>).</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

How well can large language model agents simulate complex legal dispute resolution?

  • Yujin Zhou,
  • Yidan Huang,
  • Sirui Han,
  • Yike Guo

摘要

Legal dispute resolution hinges on the weighing of evidence and arguments across parties, yet human biases and bounded rationality can influence outcomes. Simulating this process with large language models can clarify both the capabilities and the anthropomorphic behavior. Most existing studies focus on algorithmic support for adjudication, such as online courts, risk assessment, and sentencing tools. At the same time, the role of AI agents in mediation and conciliatory negotiation remains largely untested. To address this gap, the study designs six scenario types and evaluates them on a multi-agent platform. It addresses two questions: (i) To what extent can LLM agents produce realistic simulations from a juridical perspective? We find that LLMs can reproduce diverse dispute scenarios, but performance varies by role; in particular, judge agents sometimes commit serious legal errors when interpreting clauses and may infer property rights rather than apply the correct rules. (ii) Do sensitive factors and intrinsic properties affect legal dispute resolution? Sensitivity analyses across model-level configurations, framework design choices, and procedural settings confirm the robustness of our findings; we further observe irrational patterns yielding mechanical or unexpected decisions and measurable effects from intrinsic properties. These findings show strengths in fact-heavy money bargaining and mixed remedies, while highlighting limits where careful discretion and normative justification are required. Code and scenarios are publicly available for replication (https://github.com/TOM-ZHOUch/Legal_Dispute_Resolution).