嗅覚探索POMDPに対する深層強化学習:定量的ベンチマーク
Deep reinforcement learning for the olfactory search POMDP: a quantitative benchmark
乱流中で匂い源を探す昆虫の行動を模した嗅覚探索POMDPにおいて、深層強化学習が従来の近似解法と比べて軽量なロボット向け方策を生成できることを定量的に示した。
著者: Aurore Loisy, Robin A. Heinonen
分類: cs.RO, physics.bio-ph, physics.flu-dyn
原文アブストラクト
The olfactory search POMDP (partially observable Markov decision process) is a sequential decision-making problem designed to mimic the task faced by insects searching for a source of odor in turbulence, and its solutions have applications to sniffer robots. As exact solutions are out of reach, the challenge consists in finding the best possible approximate solutions while keeping the computational cost reasonable. We provide a quantitative benchmarking of a solver based on deep reinforcement learning against traditional POMDP approximate solvers. We show that deep reinforcement learning is a competitive alternative to standard methods, in particular to generate lightweight policies suitable for robots.
