シーンに欠けているもの・誤っているものは何か?関係性を考慮したハイブリッド深層ボルツマンマシンによるシーン理解
What is (missing or wrong) in the scene? A Hybrid Deep Boltzmann Machine For Contextualized Scene Modeling
物体間の関係を三方向エッジで統合したハイブリッドボルツマンマシンを提案し、シーン内の物体の有無や不整合を推論するタスクで従来モデルより高い性能を示した。
著者: İlker Bozcan, Yağmur Oymak, İdil Zeynep Alemdar, Sinan Kalkan
分類: cs.CV, cs.RO
原文アブストラクト
Scene models allow robots to reason about what is in the scene, what else should be in it, and what should not be in it. In this paper, we propose a hybrid Boltzmann Machine (BM) for scene modeling where relations between objects are integrated. To be able to do that, we extend BM to include tri-way edges between visible (object) nodes and make the network to share the relations across different objects. We evaluate our method against several baseline models (Deep Boltzmann Machines, and Restricted Boltzmann Machines) on a scene classification dataset, and show that it performs better in several scene reasoning tasks.
