FairForensics: 視覚言語モデルによる表情認識と人口統計解析を用いた汎化可能な公平なディープフェイク検出
FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection
人口統計的にバランスの取れたベンチマークを構築し、表情と人口統計を考慮した視覚言語モデルを導入して、未見の操作や人口統計グループ間での公平性を向上させるディープフェイク検出器を提案した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Yaning Zhang, Jiao Wu, Zan Gao, Linlin Shen
分類: cs.CV
原文アブストラクト
The challenge of fair deepfake detection (FDD) has attracted increasing attention. Existing fairness-enhanced detectors often suffer from suboptimal generalization to unseen manipulations and fairness across demographic groups. They are typically developed and evaluated on demographically imbalanced distributions, resulting in biased predictions toward minority groups. In this paper, we construct a novel demographically balanced FDD benchmark to train and evaluate the fairness of detectors under both balanced and imbalanced population scenarios. Additionally, we introduce a novel expression and demographic perceptual vision-language model, termed FairForensics, for generalizable fair deepfake detection. FairForensics conducts face forgery generalization enhancement and demographic-aware fairness regularization. During face forgery generalization enhancement, built upon the novel observation of significant distribution differences between pristine and forged expression vectors, we design an expression encoder to capture high-level expression-guided forgery patterns, and an expression-perceptual visual encoder that integrates global appearance and expression forgery features while mitigating identity bias using an identity-aware patch perturbation module. Under demographic-aware fairness regularization, we propose a demographic-guided language encoder to extract population-aware global language embeddings, which boosts the decoupling of forgery features from demographic information via vision-language alignment. We devise a population-aware prototype fairness objective to enforce both inter-class separability and intra-class alignment across demographic subgroups. Extensive experiments on our balanced demographic benchmark show that our method achieves the state-of-the-art in terms of generalization and fairness.
関連論文
- 脈拍か由来か?rPPGベースのディープフェイク検出器が学ぶものディープフェイク検出
- MoSTE:動画ディープフェイク検出のための時空間エキスパート混合ディープフェイク検出
- Spectra: マルチスケール暗黙分解によるディープフェイク検出ディープフェイク検出
- RoboFake:ディープフェイク検出器はヒューマノイド顔ロボットに対応できるか?ディープフェイク検出
- MSUチームによる説明可能なディープフェイク検出チャレンジ2026への挑戦:根拠あるアーティファクト証拠に基づく検出ディープフェイク検出
- MOTIF: 3DMM係数を超えた特定人物向けディープフェイク検出ディープフェイク検出
