<p>Artificial intelligence systems increasingly automate decisions traditionally made by human beings. Contemporary AI ethics, however, lacks a rigorous, quantitative method for evaluating the impacts of automation on human wellbeing. Existing approaches like impact assessment and AI alignment remain either too qualitatively descriptive or normatively shallow. This offers no principled basis for deciding among the ethical tradeoffs that AI deployments often demand. This paper presents a general method for quantitatively measuring the human impacts of AI: the Human Impact Scorecard. Our methodology makes two epistemic commitments. The first is humility: we do not purport to assert a theory of the good; we seek a pragmatic framework that can accommodate a wide range of normative commitments. The second is ecumenism: our method must be tolerable to a diverse range of perspectives, and portable across domains necessary for human flourishing. To satisfy these commitments, we adopt and extend Nussbaum and Sen’s capabilities approach as our normative foundation. The capabilities approach identifies a plural set of dimensions that together constitute a good life; they are each amenable to quantitative measurement. This in hand, we develop a two-step method: first, we identify the capabilities most relevant to a given domain of AI deployment; second, we operationalize those capabilities using established metrics that permit robust quantification; this produces a normatively grounded multicriteria matrix that can be used to broker a set of Pareto-frontier options. We illustrate this using a case study involving competing biometric authentication products, and by discussing the method’s implication for AI alignment and reward function design. We conclude by discussing the conceptual and normative challenges that remain.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Justifying and evaluating automation: a general method for quantifying the impacts of machine learning on human flourishing

  • Lorenzo Nericcio,
  • Ryan Jenkins

摘要

Artificial intelligence systems increasingly automate decisions traditionally made by human beings. Contemporary AI ethics, however, lacks a rigorous, quantitative method for evaluating the impacts of automation on human wellbeing. Existing approaches like impact assessment and AI alignment remain either too qualitatively descriptive or normatively shallow. This offers no principled basis for deciding among the ethical tradeoffs that AI deployments often demand. This paper presents a general method for quantitatively measuring the human impacts of AI: the Human Impact Scorecard. Our methodology makes two epistemic commitments. The first is humility: we do not purport to assert a theory of the good; we seek a pragmatic framework that can accommodate a wide range of normative commitments. The second is ecumenism: our method must be tolerable to a diverse range of perspectives, and portable across domains necessary for human flourishing. To satisfy these commitments, we adopt and extend Nussbaum and Sen’s capabilities approach as our normative foundation. The capabilities approach identifies a plural set of dimensions that together constitute a good life; they are each amenable to quantitative measurement. This in hand, we develop a two-step method: first, we identify the capabilities most relevant to a given domain of AI deployment; second, we operationalize those capabilities using established metrics that permit robust quantification; this produces a normatively grounded multicriteria matrix that can be used to broker a set of Pareto-frontier options. We illustrate this using a case study involving competing biometric authentication products, and by discussing the method’s implication for AI alignment and reward function design. We conclude by discussing the conceptual and normative challenges that remain.