デジタルツイン同期によるSim-RLエージェントと実時間ロボット積層造形制御の橋渡し
Digital Twin Synchronization: Bridging the Sim-RL Agent to a Real-Time Robotic Additive Manufacturing Control
UnityとROS2を連携したデジタルツイン上でSAC強化学習を行い、転移学習で実機のロボット積層造形制御に適応させる枠組みを提案した。
著者: Matsive Ali, Sandesh Giri, Sen Liu, Qin Yang
分類: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
原文アブストラクト
With the rapid development of deep reinforcement learning technology, it gradually demonstrates excellent potential and is becoming the most promising solution in the robotics. However, in the smart manufacturing domain, there is still not too much research involved in dynamic adaptive control mechanisms optimizing complex processes. This research advances the integration of Soft Actor-Critic (SAC) with digital twins for industrial robotics applications, providing a framework for enhanced adaptive real-time control for smart additive manufacturing processing. The system architecture combines Unity's simulation environment with ROS2 for seamless digital twin synchronization, while leveraging transfer learning to efficiently adapt trained models across tasks. We demonstrate our methodology using a Viper X300s robot arm with the proposed hierarchical reward structure to address the common reinforcement learning challenges in two distinct control scenarios. The results show rapid policy convergence and robust task execution in both simulated and physical environments demonstrating the effectiveness of our approach.
