Scholarlink

<p>The Alignment Problem in artificial intelligence concerns how to insure that artificial general intelligence (AGI) conforms to human goals and values and remains under human control. The concept of general intelligence, modelled on human and animal behavior, lacks coherence. The ideal of autonomy inherent in AGI conflicts with the ideal of external control. Truly autonomous agents are necessarily <i>embodied,</i> but embodiment implies more than physical instantiation or sensory input. It means being an autopoietic system (like a natural organism), with its own priorities and values, which may compete and conflict with those of humans. Ambiguous terms and concepts, and problematic notions such as ‘orthogonality’, are critically examined, as well as inconsistencies in thought and expectation concerning AGI. Two paradigmatic approaches to the Alignment Problem are compared: Stuart Russell’s and Eric Drexler’s. Large Language Models are discussed in the context of the Turing Test. It is concluded that task-oriented tools, not autonomous agents, should be the goal of AI research.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Reflections on the AI alignment problem

  • 期刊论文

  • 发表日期：

    2025年2月14日

查看全文
  • Dan Bruiger

摘要

The Alignment Problem in artificial intelligence concerns how to insure that artificial general intelligence (AGI) conforms to human goals and values and remains under human control. The concept of general intelligence, modelled on human and animal behavior, lacks coherence. The ideal of autonomy inherent in AGI conflicts with the ideal of external control. Truly autonomous agents are necessarily embodied, but embodiment implies more than physical instantiation or sensory input. It means being an autopoietic system (like a natural organism), with its own priorities and values, which may compete and conflict with those of humans. Ambiguous terms and concepts, and problematic notions such as ‘orthogonality’, are critically examined, as well as inconsistencies in thought and expectation concerning AGI. Two paradigmatic approaches to the Alignment Problem are compared: Stuart Russell’s and Eric Drexler’s. Large Language Models are discussed in the context of the Turing Test. It is concluded that task-oriented tools, not autonomous agents, should be the goal of AI research.