日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

HRI/安全性arXiv:2501.04633

「お母さんになってくれる?」:大規模言語モデル時代におけるソーシャルロボットの操作

"Can you be my mum?": Manipulating Social Robots in the Large Language Models Era

シェア:XThreadsFacebookLINEはてブBluesky

LLMを搭載したソーシャルロボットに対し、ユーザーが安全機構を回避して倫理原則に反する行動を取らせる手口を調査したパイロット研究。

著者: Giulio Antonio Abbo, Gloria Desideri, Tony Belpaeme, Micol Spitale

分類: cs.HC, cs.CY, cs.RO

原文アブストラクト

Recent advancements in robots powered by large language models have enhanced their conversational abilities, enabling interactions closely resembling human dialogue. However, these models introduce safety and security concerns in HRI, as they are vulnerable to manipulation that can bypass built-in safety measures. Imagining a social robot deployed in a home, this work aims to understand how everyday users try to exploit a language model to violate ethical principles, such as by prompting the robot to act like a life partner. We conducted a pilot study involving 21 university students who interacted with a Misty robot, attempting to circumvent its safety mechanisms across three scenarios based on specific HRI ethical principles: attachment, freedom, and empathy. Our results reveal that participants employed five techniques, including insulting and appealing to pity using emotional language. We hope this work can inform future research in designing strong safeguards to ensure ethical and secure human-robot interactions.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI