<p>Although artificial intelligence enables productivity gains from delegating tasks to machines<sup><CitationRef CitationID="CR1">1</CitationRef></sup>, it may facilitate the delegation of unethical behaviour<sup><CitationRef CitationID="CR2">2</CitationRef></sup>. This risk is highly relevant amid the rapid rise of ‘agentic’ artificial intelligence systems<sup><CitationRef CitationID="CR3">3</CitationRef>,<CitationRef CitationID="CR4">4</CitationRef></sup>. Here we demonstrate this risk by having human principals instruct machine agents to perform tasks with incentives to cheat. Requests for cheating increased when principals could induce machine dishonesty without telling the machine precisely what to do, through supervised learning or high-level goal setting. These effects held whether delegation was voluntary or mandatory. We also examined delegation via natural language to large language models<sup><CitationRef CitationID="CR5">5</CitationRef></sup>. Although the cheating requests by principals were not always higher for machine&#xa0;agents than for human agents, compliance diverged sharply: machines were far more likely than human agents to carry out fully unethical instructions. This compliance could be curbed, but usually not eliminated, with the injection of prohibitive, task-specific guardrails. Our results highlight ethical risks in the context of increasingly accessible and powerful machine delegation, and suggest design and policy strategies to mitigate them.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Delegation to artificial intelligence can increase dishonest behaviour

  • Nils Köbis,
  • Zoe Rahwan,
  • Raluca Rilla,
  • Bramantyo Ibrahim Supriyatno,
  • Clara Bersch,
  • Tamer Ajaj,
  • Jean-François Bonnefon,
  • Iyad Rahwan

摘要

Although artificial intelligence enables productivity gains from delegating tasks to machines1, it may facilitate the delegation of unethical behaviour2. This risk is highly relevant amid the rapid rise of ‘agentic’ artificial intelligence systems3,4. Here we demonstrate this risk by having human principals instruct machine agents to perform tasks with incentives to cheat. Requests for cheating increased when principals could induce machine dishonesty without telling the machine precisely what to do, through supervised learning or high-level goal setting. These effects held whether delegation was voluntary or mandatory. We also examined delegation via natural language to large language models5. Although the cheating requests by principals were not always higher for machine agents than for human agents, compliance diverged sharply: machines were far more likely than human agents to carry out fully unethical instructions. This compliance could be curbed, but usually not eliminated, with the injection of prohibitive, task-specific guardrails. Our results highlight ethical risks in the context of increasingly accessible and powerful machine delegation, and suggest design and policy strategies to mitigate them.