マクロ行動を用いた非近視眼的ガウス過程最適化
Nonmyopic Gaussian Process Optimization with Macro-Actions
ベイズ最適化において、マクロ行動の概念を導入して先読みを拡大する非近視眼的なガウス過程最適化ポリシーを提案し、その漸近最適な anytime 版も導出した論文。
著者: Dmitrii Kharkovskii, Chun Kai Ling, Kian Hsiang Low
分類: cs.LG, cs.RO, stat.ML
原文アブストラクト
This paper presents a multi-staged approach to nonmyopic adaptive Gaussian process optimization (GPO) for Bayesian optimization (BO) of unknown, highly complex objective functions that, in contrast to existing nonmyopic adaptive BO algorithms, exploits the notion of macro-actions for scaling up to a further lookahead to match up to a larger available budget. To achieve this, we generalize GP upper confidence bound to a new acquisition function defined w.r.t. a nonmyopic adaptive macro-action policy, which is intractable to be optimized exactly due to an uncountable set of candidate outputs. The contribution of our work here is thus to derive a nonmyopic adaptive epsilon-Bayes-optimal macro-action GPO (epsilon-Macro-GPO) policy. To perform nonmyopic adaptive BO in real time, we then propose an asymptotically optimal anytime variant of our epsilon-Macro-GPO policy with a performance guarantee. We empirically evaluate the performance of our epsilon-Macro-GPO policy and its anytime variant in BO with synthetic and real-world datasets.
