PH-Dreamer: ポート・ハミルトン生成ダイナミクスによる物理駆動ワールドモデル
PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics
リカレント状態空間モデルにポート・ハミルトン構造を導入し、物理法則に従う潜在ダイナミクスを学習するワールドモデルを提案。エネルギー勾配を用いたActor-Criticで制御を最適化し、報酬予測精度とエネルギー効率を向上させた。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Xueyu Luan, Chenwei Shi
分類: cs.LG, cs.AI, cs.CV, cs.RO
原文アブストラクト
World models built on recurrent state space architectures enable efficient latent imagination, yet remain physically unstructured, producing dynamics that violate conservation and dissipative principles. We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms. First, we embed implicit physical priors into recurrent transitions by modeling projected latent evolution as action controlled energy routing governed by flow and dissipation, biasing the projected PH phase space toward a more compact and physically structured representation. Second, we develop a kinematics aware energy world model that estimates the Hamiltonian and power balance from proprioceptive observations, providing an explicit physical signal for thermodynamic reasoning. Third, leveraging these energy gradients, we establish an energy guided Actor-Critic that uses Lagrangian multipliers to regularize policy optimization toward lower energy and smoother control. Across visual control benchmarks, this paradigm not only attains superior asymptotic returns but also elevates internal simulator fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.
関連論文
- WorldCycle: 長期的ビデオワールドモデルのための自己検証型強化学習ワールドモデル/強化学習
