The robustness analysis of probabilistic models has been recently the research focus towards verifying the extent to which a system is robust against adversaries, as well as for synthesizing worst-case attacks. In addition to the progress achieved in this direction, a system also needs to exhibit resilience against behaviors that undermine its balance in terms of properties referring to quantitative rewards, such as power consumption, work load or other measurable characteristics. In this paper, we introduce a robustness analysis framework for reward properties over Markov decision processes (MDPs). Apart from the problem of adversarial robustness, we also consider the case of strategic entities who seek to maximize their influence in the convergence of network-based systems. To this end, our robustness framework features an infinite horizon analysis for irreducible MDPs.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Robustness Analysis of Probabilistic Models with Adversaries or Strategic Entities

  • Sotirios Gyftopoulos,
  • Stylianos Basagiannis,
  • Panagiotis Katsaros

摘要

The robustness analysis of probabilistic models has been recently the research focus towards verifying the extent to which a system is robust against adversaries, as well as for synthesizing worst-case attacks. In addition to the progress achieved in this direction, a system also needs to exhibit resilience against behaviors that undermine its balance in terms of properties referring to quantitative rewards, such as power consumption, work load or other measurable characteristics. In this paper, we introduce a robustness analysis framework for reward properties over Markov decision processes (MDPs). Apart from the problem of adversarial robustness, we also consider the case of strategic entities who seek to maximize their influence in the convergence of network-based systems. To this end, our robustness framework features an infinite horizon analysis for irreducible MDPs.