農業ロボット収穫におけるセンシングのロバスト性課題
Sensing-based Robustness Challenges in Agricultural Robotic Harvesting
農業用収穫ロボットが果実を検出・位置推定する際の環境外乱の影響を、HSV変換とYOLOv8を用いて屋内・屋外で評価した研究。
著者: C. Beldek, J. Cunningham, M. Aydin, E. Sariyildiz, S. L. Phung, G. Alici
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
This paper presents the challenges agricultural robotic harvesters face in detecting and localising fruits under various environmental disturbances. In controlled laboratory settings, both the traditional HSV (Hue Saturation Value) transformation and the YOLOv8 (You Only Look Once) deep learning model were employed. However, only YOLOv8 was utilised in outdoor experiments, as the HSV transformation was not capable of accurately drawing fruit contours. Experiments include ten distinct fruit patterns with six apples and six oranges. A grid structure for homography (perspective) transformation was employed to convert detected midpoints into 3D world coordinates. The experiments evaluated detection and localisation under varying lighting and background disturbances, revealing accurate performance indoors, but significant challenges outdoors. Our results show that indoor experiments using YOLOv8 achieved 100% detection accuracy, while outdoor conditions decreased performance, with an average accuracy of 69.15% for YOLOv8 under direct sunlight. The study demonstrates that real-world applications reveal significant limitations due to changing lighting, background disturbances, and colour and shape variability. These findings underscore the need for further refinement of algorithms and sensors to enhance the robustness of robotic harvesters for agricultural use.
関連論文
- Agibot:農業ロボティクス研究・教育向けのオープンソースモジュラー式スワーブ駆動ロボットプラットフォーム農業ロボティクス
- 農業収穫技術の統一的分類体系に向けて:物理的相互作用・自動化・選択性の関連付け農業ロボティクス
- エージェント型農業ロボティクス表現型解析の最近の進展:断片化されたマルチモーダルセンシングから統合PhenoAgent知能への展望レビュー農業ロボティクス
- PlantShade: 照明を考慮したロボット農業作業のための植物影予測農業ロボティクス
- ロボット収穫のための選択的ワタボール位置推定:圃場条件下での深層学習視覚モデル評価農業ロボティクス
- CLASP: 生食用ブルーベリー収穫のためのソフトローリングバンドグリッパを備えたクラスタ単位自律選択収穫ロボット農業ロボティクス
