QueryCAD：CADモデルに対する根拠付き質問応答
QueryCAD: Grounded Question Answering for CAD Models
自然言語クエリでCADモデルから情報を抽出する初の質問応答システムQueryCADを提案し、オープン語彙インスタンスセグメンテーションモデルSegCADやベンチマークを開発、ロボットプログラム自動合成に統合した。
著者: Claudius Kienle, Benjamin Alt, Darko Katic, Rainer Jäkel, Jan Peters
分類: cs.RO
原文アブストラクト
CAD models are widely used in industry and are essential for robotic automation processes. However, these models are rarely considered in novel AI-based approaches, such as the automatic synthesis of robot programs, as there are no readily available methods that would allow CAD models to be incorporated for the analysis, interpretation, or extraction of information. To address these limitations, we propose QueryCAD, the first system designed for CAD question answering, enabling the extraction of precise information from CAD models using natural language queries. QueryCAD incorporates SegCAD, an open-vocabulary instance segmentation model we developed to identify and select specific parts of the CAD model based on part descriptions. We further propose a CAD question answering benchmark to evaluate QueryCAD and establish a foundation for future research. Lastly, we integrate QueryCAD within an automatic robot program synthesis framework, validating its ability to enhance deep-learning solutions for robotics by enabling them to process CAD models (https://claudius-kienle.github.com/querycad).
