生得的価値駆動強化学習による協調型マルチエージェント認知モデリング
Innate-Values-driven Reinforcement Learning based Cooperative Multi-Agent Cognitive Modeling
エージェントの個人的な選好を「生得的価値」として組み込んだ強化学習アーキテクチャを提案し、StarCraftの協調タスクで集団行動の性能向上を実証した。
著者: Qin Yang
分類: cs.LG, cs.AI, cs.MA, cs.RO
原文アブストラクト
In multi-agent systems (MAS), the dynamic interaction among multiple decision-makers is driven by their innate values, affecting the environment's state, and can cause specific behavioral patterns to emerge. On the other hand, innate values in cognitive modeling reflect individual interests and preferences for specific tasks and drive them to develop diverse skills and plans, satisfying their various needs and achieving common goals in cooperation. Therefore, building the awareness of AI agents to balance the group utilities and system costs and meet group members' needs in their cooperation is a crucial problem for individuals learning to support their community and even integrate into human society in the long term. However, the current MAS reinforcement learning domain lacks a general intrinsic model to describe agents' dynamic motivation for decision-making and learning from an individual needs perspective in their cooperation. To address the gap, this paper proposes a general MAS innate-values reinforcement learning (IVRL) architecture from the individual preferences angle. We tested the Multi-Agent IVRL Actor-Critic Model in different StarCraft Multi-Agent Challenge (SMAC) settings, which demonstrated its potential to organize the group's behaviours to achieve better performance.
