Markov Decision Processes (MDPs) are commonly used to model sequential decision-making under uncertainty. A notable subclass is the Stochastic Shortest Path (SSP) problem, in which an agent aims to reach a goal state, modeled as absorbing, while minimizing accumulated costs. Policies in SSPs induce the random variable accumulated cost and its corresponding probability distribution function, and decision criteria summarize these distributions into scalar values to guide policy comparison and define optimality. In this work, we propose the Relational Expressivity Coverage method, which quantifies a criterion’s ability to represent preference relations through parameter variation. We apply this framework to the One-State Many-Actions (OSMA) problem and compare multiple risk-sensitive criteria from the literature in terms of their expressivity.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Relational Expressivity Coverage: Comparing Risk-Sensitive Criteria for SSP Problems

  • Igor Miyamura Agostinho,
  • Valdinei Freire da Silva

摘要

Markov Decision Processes (MDPs) are commonly used to model sequential decision-making under uncertainty. A notable subclass is the Stochastic Shortest Path (SSP) problem, in which an agent aims to reach a goal state, modeled as absorbing, while minimizing accumulated costs. Policies in SSPs induce the random variable accumulated cost and its corresponding probability distribution function, and decision criteria summarize these distributions into scalar values to guide policy comparison and define optimality. In this work, we propose the Relational Expressivity Coverage method, which quantifies a criterion’s ability to represent preference relations through parameter variation. We apply this framework to the One-State Many-Actions (OSMA) problem and compare multiple risk-sensitive criteria from the literature in terms of their expressivity.