There is a need to redefine the standard model of AI. In this model we aim to build machines able to reach the objectives stated. This can be done in several different ways, for example, by learning a policy that maximizes the expected discounted sum of rewards of the subject, who is a human. There is however a mistake in the standard model deriving from transferring to machines a definition of intelligence perfectly reasonable for humans. In fact, machines are not entitled to pursue their own objectives. A more sensible definition of AI would have machines pursuing our objectives. A new model is needed for AI development in which the machine’s uncertainty about the true objective leads to qualitatively new modes of behavior that are more robust, controllable, and deferential to humans.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Conclusions

  • Nicola Acocella

摘要

There is a need to redefine the standard model of AI. In this model we aim to build machines able to reach the objectives stated. This can be done in several different ways, for example, by learning a policy that maximizes the expected discounted sum of rewards of the subject, who is a human. There is however a mistake in the standard model deriving from transferring to machines a definition of intelligence perfectly reasonable for humans. In fact, machines are not entitled to pursue their own objectives. A more sensible definition of AI would have machines pursuing our objectives. A new model is needed for AI development in which the machine’s uncertainty about the true objective leads to qualitatively new modes of behavior that are more robust, controllable, and deferential to humans.