日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

画像変換arXiv:2109.04468

局所領域を活用した画像間変換

Leveraging Local Domains for Image-to-Image Translation

シェア:XThreadsFacebookLINEはてブBluesky

道路シーンからオフロードなどへの画像変換で、人間の空間的知識に基づく「局所領域」を幾何学的ガイダンスとして用い、少数画像でパッチベースGANを訓練して未見領域を生成し、目標領域の転移学習を容易にする手法を提案。

著者: Anthony Dell'Eva, Fabio Pizzati, Massimo Bertozzi, Raoul de Charette

分類: cs.CV, cs.AI, cs.LG, cs.RO

原文アブストラクト

Image-to-image (i2i) networks struggle to capture local changes because they do not affect the global scene structure. For example, translating from highway scenes to offroad, i2i networks easily focus on global color features but ignore obvious traits for humans like the absence of lane markings. In this paper, we leverage human knowledge about spatial domain characteristics which we refer to as 'local domains' and demonstrate its benefit for image-to-image translation. Relying on a simple geometrical guidance, we train a patch-based GAN on few source data and hallucinate a new unseen domain which subsequently eases transfer learning to target. We experiment on three tasks ranging from unstructured environments to adverse weather. Our comprehensive evaluation setting shows we are able to generate realistic translations, with minimal priors, and training only on a few images. Furthermore, when trained on our translations images we show that all tested proxy tasks are significantly improved, without ever seeing target domain at training.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI