Monte Carlo Tree Search and Monte Carlo Search have good results for many combinatorial problems. In this paper we propose to use Monte Carlo Search to design mathematical expressions that are used as exploration terms for Monte Carlo Tree Search algorithms. The Monte Carlo Tree Search algorithm we aim to optimize is SHUSS (Sequential Halving Using Scores). We automatically design the SHUSS root exploration term. For small search budgets of 32 evaluations the discovered root exploration term makes SHUSS competitive with usual PUCT (Predictor Upper Confidence bounds for Trees).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Monte Carlo Search Algorithms Discovering Monte Carlo Tree Search Exploration Terms

  • Tristan Cazenave

摘要

Monte Carlo Tree Search and Monte Carlo Search have good results for many combinatorial problems. In this paper we propose to use Monte Carlo Search to design mathematical expressions that are used as exploration terms for Monte Carlo Tree Search algorithms. The Monte Carlo Tree Search algorithm we aim to optimize is SHUSS (Sequential Halving Using Scores). We automatically design the SHUSS root exploration term. For small search budgets of 32 evaluations the discovered root exploration term makes SHUSS competitive with usual PUCT (Predictor Upper Confidence bounds for Trees).