リスクを考慮した適応的信念依存確率的制約付き連続POMDP計画
Risk Aware Adaptive Belief-dependent Probabilistically Constrained Continuous POMDP Planning
部分観測可能な連続環境でリスクを避けつつ行動するため、信念依存の確率的制約を導入した新しいPOMDP定式化と解法を提案し、従来法より高速に制約を満たす行動を選択できることを示した。
著者: Andrey Zhitnikov, Vadim Indelman
分類: cs.AI, cs.RO
原文アブストラクト
Although risk awareness is fundamental to an online operating agent, it has received less attention in the challenging continuous domain and under partial observability. This paper presents a novel formulation and solution for risk-averse belief-dependent probabilistically constrained continuous POMDP. We tackle a demanding setting of belief-dependent reward and constraint operators. The probabilistic confidence parameter makes our formulation genuinely risk-averse and much more flexible than the state-of-the-art chance constraint. Our rigorous analysis shows that in the stiffest probabilistic confidence case, our formulation is very close to chance constraint. However, our probabilistic formulation allows much faster and more accurate adaptive acceptance or pruning of actions fulfilling or violating the constraint. In addition, with an arbitrary confidence parameter, we did not find any analogs to our approach. We present algorithms for the solution of our formulation in continuous domains. We also uplift the chance-constrained approach to continuous environments using importance sampling. Moreover, all our presented algorithms can be used with parametric and nonparametric beliefs represented by particles. Last but not least, we contribute, rigorously analyze and simulate an approximation of chance-constrained continuous POMDP. The simulations demonstrate that our algorithms exhibit unprecedented celerity compared to the baseline, with the same performance in terms of collisions.
