ANSELフォトボット：意味理解に基づくイベント撮影ロボット
ANSEL Photobot: A Robot Event Photographer with Semantic Intelligence
大規模言語モデルと視覚言語モデルを活用し、イベント内容を理解して適切な写真を自動撮影するロボットを実現した。
著者: Dmitriy Rivkin, Gregory Dudek, Nikhil Kakodkar, David Meger, Oliver Limoyo, Xue Liu, Francois Hogan
分類: cs.RO
原文アブストラクト
Our work examines the way in which large language models can be used for robotic planning and sampling, specifically the context of automated photographic documentation. Specifically, we illustrate how to produce a photo-taking robot with an exceptional level of semantic awareness by leveraging recent advances in general purpose language (LM) and vision-language (VLM) models. Given a high-level description of an event we use an LM to generate a natural-language list of photo descriptions that one would expect a photographer to capture at the event. We then use a VLM to identify the best matches to these descriptions in the robot's video stream. The photo portfolios generated by our method are consistently rated as more appropriate to the event by human evaluators than those generated by existing methods.
