Explainability is key to building trust in AI systems, especially in autonomous multi-agent decision-making. While many techniques exist, full trust is only achieved when explanations clarify decision criteria and trace them back to original requirements. We extend explainable agents (XAg) by linking decisions to user and system stories, along with their acceptance criteria. This approach ensures full traceability, revealing decision rationale and aligning them with origins. It also allows runtime verification of decisions, flagging errors, and supporting requirement reflection if poor decisions are made.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Requirements-Based Explainability for Multi-agent Systems

  • Sebastian Rodriguez,
  • John Thangarajah,
  • Michael Winikoff

摘要

Explainability is key to building trust in AI systems, especially in autonomous multi-agent decision-making. While many techniques exist, full trust is only achieved when explanations clarify decision criteria and trace them back to original requirements. We extend explainable agents (XAg) by linking decisions to user and system stories, along with their acceptance criteria. This approach ensures full traceability, revealing decision rationale and aligning them with origins. It also allows runtime verification of decisions, flagging errors, and supporting requirement reflection if poor decisions are made.