チャンス制約付き確率的オリエンテーリング問題をモンテカルロ木探索で解く
Solving Stochastic Orienteering Problems with Chance Constraints Using Monte Carlo Tree Search
移動コストがランダムで予算超過確率に制約があるオリエンテーリング問題に対し、各行動の価値と制約違反確率を推定しながら探索するオンライン・エニタイム型MCTSアルゴリズムを提案した。
著者: Stefano Carpin
分類: cs.RO
原文アブストラクト
We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable probability of exceeding the budget. The algorithm we present is online and anytime, i.e., it alternates planning and execution, and the quality of the solution it produces increases as the allowed computational time increases. Differently from most former MCTS algorithms, for each action available in a state the algorithm maintains estimates of both its value and the probability that its execution will eventually result in a violation of the chance constraint. Then, at action selection time, our proposed solution prunes away trajectories that are estimated to violate the failure probability. Extensive simulation results show that this approach can quickly produce high-quality solutions and is competitive with the optimal but time-consuming solution.
