SpectralWasteデータセット:廃棄物選別自動化のためのマルチモーダルデータ
SpectralWaste Dataset: Multimodal Data for Waste Sorting Automation
実際のプラスチック廃棄物選別施設で取得したハイパースペクトル画像とRGB画像の同期データセットを構築し、物体セグメンテーションのマルチモーダル手法を評価した。
著者: Sara Casao, Fernando Peña, Alberto Sabater, Rosa Castillón, Darío Suárez, Eduardo Montijano, Ana C. Murillo
分類: cs.CV, cs.RO
原文アブストラクト
The increase in non-biodegradable waste is a worldwide concern. Recycling facilities play a crucial role, but their automation is hindered by the complex characteristics of waste recycling lines like clutter or object deformation. In addition, the lack of publicly available labeled data for these environments makes developing robust perception systems challenging. Our work explores the benefits of multimodal perception for object segmentation in real waste management scenarios. First, we present SpectralWaste, the first dataset collected from an operational plastic waste sorting facility that provides synchronized hyperspectral and conventional RGB images. This dataset contains labels for several categories of objects that commonly appear in sorting plants and need to be detected and separated from the main trash flow for several reasons, such as security in the management line or reuse. Additionally, we propose a pipeline employing different object segmentation architectures and evaluate the alternatives on our dataset, conducting an extensive analysis for both multimodal and unimodal alternatives. Our evaluation pays special attention to efficiency and suitability for real-time processing and demonstrates how HSI can bring a boost to RGB-only perception in these realistic industrial settings without much computational overhead.
関連論文
- BODYinTRANSIT-Lab:身体知覚と情動体験の感覚駆動型変化を調べるマルチモーダルデータセットマルチモーダル知覚
- UniOMA:最適輸送によるロボット知覚のための統合マルチモーダル構造アライメントマルチモーダル知覚
- ズームなしで詳細を見るv2:汎化可能なマルチモーダル知覚のための証拠連結マルチモーダル知覚
- SenseWeather: 極限環境下でのロボット知覚を支えるマルチモーダルセンシングマルチモーダル知覚
- ROMA: 実世界の物体中心マルチセンサ能動知覚のためのLLMシステムマルチモーダル知覚
- ReSPEC: 動的環境におけるオンライン多スペクトルセンサ再構成フレームワークマルチモーダル知覚
