日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

POMDParXiv:2503.19302

アニーリング重要度リサンプリングによる部分観測マルコフ決定過程の観測適応

Observation Adaptation via Annealed Importance Resampling for Partially Observable Markov Decision Processes

シェア:XThreadsFacebookLINEはてブBluesky

部分観測マルコフ決定過程(POMDP)のオンライン解法において、粒子フィルタのリサンプリング時に生じる粒子退化を防ぐため、アニーリング重要度リサンプリングを導入し、観測に適応した信念分布推定を実現した。

著者: Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay, Abhishek Dubey

分類: cs.AI, cs.LG, cs.RO

原文アブストラクト

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm to adapt to new information in real time. Online solvers typically use bootstrap particle filters based on importance resampling for updating the belief distribution. Since directly sampling from the ideal state distribution given the latest observation and previous state is infeasible, particle filters approximate the posterior belief distribution by propagating states and adjusting weights through prediction and resampling steps. However, in practice, the importance resampling technique often leads to particle degeneracy and sample impoverishment when the state transition model poorly aligns with the posterior belief distribution, especially when the received observation is highly informative. We propose an approach that constructs a sequence of bridge distributions between the state-transition and optimal distributions through iterative Monte Carlo steps, better accommodating noisy observations in online POMDP solvers. Our algorithm demonstrates significantly superior performance compared to state-of-the-art methods when evaluated across multiple challenging POMDP domains.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI