- pretrained visual knowledgeとmetric 3D human motionの橋渡しが中心的な論点。
- narrow-domain dataからのgeneralizationや、action controlとvisual qualityの両立が議論対象と考えられるが、詳細な限界・失敗事例は要旨からは不明。
- 6タスク統合の一般性や、軽量adaptationの寄与に関する定量的な議論は要旨からは不明。
6. 次に読むべき論文は?
- 要旨で参照・比較されている個別研究は明示されていない。
- 関連手法として、pretrained video generators(例:video diffusion models)、egocentric manipulationのaction-video学習、metric 3D human motion/pose estimation、action-conditioned video generationの代表的論文を次に読む候補とする。
Modern video models possess strong visual priors, yet do not natively represent human action in metric 3D space. We present EgoGeneralist, which adapts pretrained video generators to unify action-conditioned video generation, pose estimation, and joint action-video generation for egocentric manipulation. Our role-adaptive action renderer provides video-native representations for multidirectional action-video learning, making metric motion usable as both a spatial control signal and a recoverable generation target. Cross-stream action-video coupling establishes close correspondence between metric motion and visual dynamics through lightweight adaptation while preserving the pretrained visual prior. Together, these designs establish a generalist framework spanning six action-video tasks. With only narrow-domain data, EgoGeneralist generalizes to diverse unseen scenes and interactions with effective action control and visual quality, bridging pretrained visual knowledge and metric 3D human motion.