DroneTrap:色ベース力覚検出とジェスチャ認識を備えたソフトロボットハンドによる空中ドローン捕獲
DroneTrap: Drone Catching in Midair by Soft Robotic Hand with Color-Based Force Detection and Hand Gesture Recognition
柔らかい3本指ハンドと触覚・色変化による力推定、モーショングローブのジェスチャ認識を用いて、空中でドローンを安全に捕まえるシステムを開発した。
著者: Aleksey Fedoseev, Valerii Serpiva, Ekaterina Karmanova, Miguel Altamirano Cabrera, Vladimir Shirokun, Iakov Vasilev, Stanislav Savushkin, Dzmitry Tsetserukou
分類: cs.RO
原文アブストラクト
The paper proposes a novel concept of docking drones to make this process as safe and fast as possible. The idea behind the project is that a robot with a soft gripper grasps the drone in midair. The human operator navigates the robotic arm with the ML-based gesture recognition interface. The 3-finger robot hand with soft fingers is equipped with touch sensors, making it possible to achieve safe drone catching and avoid inadvertent damage to the drone's propellers and motors. Additionally, the soft hand is featured with a unique color-based force estimation technology based on a computer vision (CV) system. Moreover, the visual color-changing system makes it easier for the human operator to interpret the applied forces. Without any additional programming, the operator has full real-time control of the robot's motion and task execution by wearing a mocap glove with gesture recognition, which was developed and applied for the high-level control of DroneTrap. The experimental results revealed that the developed color-based force estimation can be applied for rigid object capturing with high precision (95.3\%). The proposed technology can potentially revolutionize the landing and deployment of drones for parcel delivery on uneven ground, structure maintenance and inspection, risque operations, and etc.
関連論文
- 流体興奮性ニューロンのためのエネルギーベースモデリングソフトロボティクス
- 剛体マニピュレータの動きで受動腱駆動ソフト延長部を駆動・制御する手法ソフトロボティクス
- 太陽光で自走するサブグラム級ソフトロボットソフトロボティクス
- データ駆動によるソフトヘリコイドロボットの精密制御ソフトロボティクス
- PneuGen:LLMエージェントによるソフト空気圧ロボットのタスク駆動型協調設計ソフトロボティクス
- 柔軟トランクロボットの動的形状制御ソフトロボティクス
