コントローラ蒸留による脆弱な脳-身体共適応の緩和とMAP-Elitesにおける移行の促進
Controller Distillation Reduces Fragile Brain-Body Co-Adaptation and Enables Migrations in MAP-Elites
MAP-Elitesで形態と制御を共最適化する際、身体の変異が脳の過剰特化を壊し移行が妨げられる問題に対し、蒸留コントローラで定期的に置換するPollinationを提案し、移行と質的多様性を改善した。
著者: Alican Mertan, Nick Cheney
分類: cs.RO, cs.LG, cs.NE
原文アブストラクト
Brain-body co-optimization suffers from fragile co-adaptation where brains become over-specialized for particular bodies, hindering their ability to transfer well to others. Evolutionary algorithms tend to discard such low-performing solutions, eliminating promising morphologies. Previous work considered applying MAP-Elites, where niche descriptors are based on morphological features, to promote better search over morphology space. In this work, we show that this approach still suffers from fragile co-adaptation: where a core mechanism of MAP-Elites, creating stepping stones through solutions that migrate from one niche to another, is disrupted. We suggest that this disruption occurs because the body mutations that move an offspring to a new morphological niche break the robots' fragile brain-body co-adaptation and thus significantly decrease the performance of those potential solutions -- reducing their likelihood of outcompeting an existing elite in that new niche. We utilize a technique, we call Pollination, that periodically replaces the controllers of certain solutions with a distilled controller with better generalization across morphologies to reduce fragile brain-body co-adaptation and thus promote MAP-Elites migrations. Pollination increases the success of body mutations and the number of migrations, resulting in better quality-diversity metrics. We believe we develop important insights that could apply to other domains where MAP-Elites is used.
関連論文
- ゼロから進化する器用なロボット進化ロボティクス
- 適応的制御学習によるロボット形態進化ダイナミクスの形成進化ロボティクス
- VLMによる主観的評価を用いたアニマットの進化モデル進化ロボティクス
- ECo-MoE: 身体条件付き混合エキスパートによるロボットの進化可能性の向上進化ロボティクス
- 動的環境におけるラマルク的継承:進化ダイナミクスに影響を与える主要変数の解明進化ロボティクス
- ロボットにも教育が必要:進化ロボティクスにおける学習の複雑さについて進化ロボティクス
