単眼パンチルトカメラを搭載した車輪型ロボットの人物追従
Human Following for Wheeled Robot with Monocular Pan-tilt Camera
深度センサを使わず、単眼パンチルトカメラだけで人物を視野内に捉えながら追従する車輪型ロボットシステムを構築し、シミュレーションと実機で有効性を示した。
著者: Zheng Zhu, Hongxuan Ma, Wei Zou
分類: cs.RO, cs.CV
原文アブストラクト
Human following on mobile robots has witnessed significant advances due to its potentials for real-world applications. Currently most human following systems are equipped with depth sensors to obtain distance information between human and robot, which suffer from the perception requirements and noises. In this paper, we design a wheeled mobile robot system with monocular pan-tilt camera to follow human, which can stay the target in the field of view and keep following simultaneously. The system consists of fast human detector, real-time and accurate visual tracker, and unified controller for mobile robot and pan-tilt camera. In visual tracking algorithm, both Siamese networks and optical flow information are exploited to locate and regress human simultaneously. In order in perform following with a monocular camera, the constraint of human height is introduced to design the controller. In experiments, human following are conducted and analysed in simulations and a real robot platform, which demonstrate the effectiveness and robustness of the overall system.
