デジタルツイン強化型屋内無線ナビゲーション:ゼロショット強化学習による効率的な環境センシング
Digital Twin-Enhanced Wireless Indoor Navigation: Achieving Efficient Environment Sensing with Zero-Shot Reinforcement Learning
デジタルツインの物理情報を強化学習の報酬設計に組み込み、ミリ波屋内ナビゲーションを未知環境にも汎化できるPIRL手法を提案した。
著者: Tao Li, Haozhe Lei, Hao Guo, Mingsheng Yin, Yaqi Hu, Quanyan Zhu, Sundeep Rangan
分類: cs.RO, cs.LG
原文アブストラクト
Millimeter-wave (mmWave) communication is a vital component of future generations of mobile networks, offering not only high data rates but also precise beams, making it ideal for indoor navigation in complex environments. However, the challenges of multipath propagation and noisy signal measurements in indoor spaces complicate the use of mmWave signals for navigation tasks. Traditional physics-based methods, such as following the angle of arrival (AoA), often fall short in complex scenarios, highlighting the need for more sophisticated approaches. Digital twins, as virtual replicas of physical environments, offer a powerful tool for simulating and optimizing mmWave signal propagation in such settings. By creating detailed, physics-based models of real-world spaces, digital twins enable the training of machine learning algorithms in virtual environments, reducing the costs and limitations of physical testing. Despite their advantages, current machine learning models trained in digital twins often overfit specific virtual environments and require costly retraining when applied to new scenarios. In this paper, we propose a Physics-Informed Reinforcement Learning (PIRL) approach that leverages the physical insights provided by digital twins to shape the reinforcement learning (RL) reward function. By integrating physics-based metrics such as signal strength, AoA, and path reflections into the learning process, PIRL enables efficient learning and improved generalization to new environments without retraining. Our experiments demonstrate that the proposed PIRL, supported by digital twin simulations, outperforms traditional heuristics and standard RL models, achieving zero-shot generalization in unseen environments and offering a cost-effective, scalable solution for wireless indoor navigation.
関連論文
- FlatLands: 単一視点からの生成的フロアマップ補完屋内ナビゲーション
- 長すぎず短すぎず:屋内ナビゲーションにおける音声経路説明の長さの影響屋内ナビゲーション
- AIと機械学習によるモバイル組み込みシステムの屋内測位とナビゲーション屋内ナビゲーション
- AINS: 単眼カメラとライン色識別による低コスト屋内ナビゲーション屋内ナビゲーション
- スマートフォン慣性センサと地図マッチングによる屋内ナビゲーション屋内ナビゲーション
- 屋内ナビゲーションのための空間意味論を捉える物体埋め込みの学習屋内ナビゲーション
