Contextual Bandits: Personalized Exploration and Exploitation

In Chapter 15 , we learned how Multi-armed Bandits balance exploration and exploitation to minimize regret when choosing between a fixed set of arms. But what happens when the best choice varies by user or situation? What if mobile users prefer different content than desktop users or if the best product recommendation depends on a customer’s purchase history?