This chapter provides the theoretical background of the most prominent algorithms used throughout this book. First, the idea of reinforcement learning (RL) will be presented, followed by an introduction to Markov decision processes, which form the basis of each RL algorithm. Then, two RL algorithms, called Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), will be presented. TRPO provides the theory behind PPO, which is used for the placement task. This is followed by the description of a simulated annealing algorithm, which is used besides the PPO algorithm, for solving the placement task. At the end of this chapter, an introduction to the A* algorithm will be presented, which is needed for the routing task.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Theoretical Basics

  • Jakob Ratschenberger,
  • Harald Pretl

摘要

This chapter provides the theoretical background of the most prominent algorithms used throughout this book. First, the idea of reinforcement learning (RL) will be presented, followed by an introduction to Markov decision processes, which form the basis of each RL algorithm. Then, two RL algorithms, called Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), will be presented. TRPO provides the theory behind PPO, which is used for the placement task. This is followed by the description of a simulated annealing algorithm, which is used besides the PPO algorithm, for solving the placement task. At the end of this chapter, an introduction to the A* algorithm will be presented, which is needed for the routing task.