限られたリソース下でのAUV動力学モデリング:不確実性を活用した効率的なオンライン学習
Modeling of AUV Dynamics with Limited Resources: Efficient Online Learning Using Uncertainty
水中ロボットの動力学モデルをオンライン学習する際、保存容量が限られる状況で不確実性に基づいてリハーサルするデータを選ぶ3手法を提案し、実機データで検証した。
著者: Michal Tešnar, Bilal Wehbe, Matias Valdenegro-Toro
分類: cs.LG, cs.RO
原文アブストラクト
Machine learning proves effective in constructing dynamics models from data, especially for underwater vehicles. Continuous refinement of these models using incoming data streams, however, often requires storage of an overwhelming amount of redundant data. This work investigates the use of uncertainty in the selection of data points to rehearse in online learning when storage capacity is constrained. The models are learned using an ensemble of multilayer perceptrons as they perform well at predicting epistemic uncertainty. We present three novel approaches: the Threshold method, which excludes samples with uncertainty below a specified threshold, the Greedy method, designed to maximize uncertainty among the stored points, and Threshold-Greedy, which combines the previous two approaches. The methods are assessed on data collected by an underwater vehicle Dagon. Comparison with baselines reveals that the Threshold exhibits enhanced stability throughout the learning process and also yields a model with the least cumulative testing loss. We also conducted detailed analyses on the impact of model parameters and storage size on the performance of the models, as well as a comparison of three different uncertainty estimation methods.
