Constrained continuous-time nonzero-sum Markov games on the finite horizon
摘要
In this paper, we consider nonzero-sum N-player continuous-time Markov games with constraints and countable states. Players aim to maximize their total expected rewards on the finite horizon, while keeping their finite-horizon expected costs bounded by given constants. For the model with unbounded transition and reward/cost rates, we introduce correlated strategies and associate them with occupation measures. Under suitable continuity-compactness conditions, we obtain some topological properties of the occupation measures. Using these properties and the Kakutani-Fan-Glicksberg fixed point theorem, we prove the existence of constrained Nash equilibria for auxiliary games. These Nash equilibria for auxiliary games are then shown to converge to a constrained Nash equilibrium for our original game. Furthermore, we use a controlled birth and death system to illustrate our main result.