構造光と深層学習による食品パッケージの認識・仕分けシステム
A Food Package Recognition and Sorting System Based on Structured Light and Deep Learning
透明・反射素材の食品パッケージを対象に、MASK R-CNNで2D認識し、構造光3D再構成で3D座標を算出してロボットアームの把持を自動化する仕分けシステムを構築した。
著者: Xuanzhi Liu, Jixin Liang, Yuping Ye, Zhan Song, Juan Zhao
分類: cs.RO
原文アブストラクト
Vision algorithm-based robotic arm grasping system is one of the robotic arm systems that can be applied to a wide range of scenarios. It uses algorithms to automatically identify the location of the target and guide the robotic arm to grasp it, which has more flexible features than the teachable robotic arm grasping system. However, for some food packages, their transparent packages or reflective materials bring challenges to the recognition of vision algorithms, and traditional vision algorithms cannot achieve high accuracy for these packages. In addition, in the process of robotic arm grasping, the positioning on the z-axis height still requires manual setting of parameters, which may cause errors. Based on the above two problems, we designed a sorting system for food packaging using deep learning algorithms and structured light 3D reconstruction technology. Using a pre-trained MASK R-CNN model to recognize the class of the object in the image and get its 2D coordinates, then using structured light 3D reconstruction technique to calculate its 3D coordinates, and finally after the coordinate system conversion to guide the robotic arm for grasping. After testing, it is shown that the method can fully automate the recognition and grasping of different kinds of food packages with high accuracy. Using this method, it can help food manufacturers to reduce production costs and improve production efficiency.
関連論文
- 学習済み力学系を用いた協調モバイルマニピュレーションマニピュレーション
- 内視鏡環境におけるMoveItを用いた逆運動学の改善マニピュレーション
- 複数の安定目標を持つ動作プリミティブを模倣学習するmulti-CONDORマニピュレーション
- 制御バリア関数と可変インピーダンス制御による全電動重作業ロボットマニピュレータの安全な物理的相互作用マニピュレーション
- 腕全体で大型物体を持ち上げる把持姿勢を学習するARMFULマニピュレーション
- ReuseMem:ロボットマニピュレーションにおける単一記憶の複数目標への再利用マニピュレーション
