The AI value alignment problem has now been acknowledged as essential for AI safety as well as very hard. In this chapter we argue that critical parameters are neglected in AI value alignment research, which are consciousness and qualia. The AI value alignment problem is about ensuring that AI systems pursue goals, which are aligned with the interests of moral patients. Briefly summarized, prevalent human interests are to foster happiness and pleasure and to avoid pain; thus, experiences perceived through consciousness and qualia. Therefore, AI systems need not only to understand qualia and consciousness, but also their precious significance in order to be truly aligned with human interests as well as with the interests of other sentient beings. Death constitutes for humans the end of consciousness, thus, the termination of the opportunity to experience happiness and pleasure. Therefore, AI systems must not kill sentient beings. In this chapter we describe the importance of incorporating consciousness and qualia research to AI value alignment research as well as the potential feasibility of such efforts due to developments in neurotechnology. Concluding, we offer recommendations outlining such undertaking as a compulsory component of the ongoing mammoth task to reduce the x- as well as the s-risks posed by a potential superintelligence.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Neglect of Qualia and Consciousness in AI Alignment Research

  • Soenke Ziesche,
  • Roman V. Yampolskiy

摘要

The AI value alignment problem has now been acknowledged as essential for AI safety as well as very hard. In this chapter we argue that critical parameters are neglected in AI value alignment research, which are consciousness and qualia. The AI value alignment problem is about ensuring that AI systems pursue goals, which are aligned with the interests of moral patients. Briefly summarized, prevalent human interests are to foster happiness and pleasure and to avoid pain; thus, experiences perceived through consciousness and qualia. Therefore, AI systems need not only to understand qualia and consciousness, but also their precious significance in order to be truly aligned with human interests as well as with the interests of other sentient beings. Death constitutes for humans the end of consciousness, thus, the termination of the opportunity to experience happiness and pleasure. Therefore, AI systems must not kill sentient beings. In this chapter we describe the importance of incorporating consciousness and qualia research to AI value alignment research as well as the potential feasibility of such efforts due to developments in neurotechnology. Concluding, we offer recommendations outlining such undertaking as a compulsory component of the ongoing mammoth task to reduce the x- as well as the s-risks posed by a potential superintelligence.