How can human–AI interaction be evaluated? This chapter provides a high-level overview of three main approaches to evaluating human–AI interaction: empirical, analytical, and model based. Empirical methods are based on measurements in controlled or naturalistic settings. Analytical methods use heuristics and walkthroughs based on best practices. Model-based methods use computational or mathematical models to estimate how a user might complete a task. Model-based methods in particular are rapidly changing due to advances in computational methods. Each approach has its scope and limitations, which we discuss in this chapter.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Approaches to Evaluating Human–AI Interaction

  • Antti Oulasvirta

摘要

How can human–AI interaction be evaluated? This chapter provides a high-level overview of three main approaches to evaluating human–AI interaction: empirical, analytical, and model based. Empirical methods are based on measurements in controlled or naturalistic settings. Analytical methods use heuristics and walkthroughs based on best practices. Model-based methods use computational or mathematical models to estimate how a user might complete a task. Model-based methods in particular are rapidly changing due to advances in computational methods. Each approach has its scope and limitations, which we discuss in this chapter.