论文研究 arXiv cs.CV Tue, 15 Sep 2026 正文 ok 252 words

BEACON:面向特定人物视频生成的行为与外观控制

英文标题:BEACON: Behavior and Appearance Control for Subject-Specific Video Generation

BEACON 是一种轻量级的特定人物视频生成框架,旨在同时保留人物的视觉身份和个体化面部表情行为。该方法使用参考图像编码身份,并使用参考视频捕捉人物特有的面部动态,从而将外观与表达行为解耦。实验显示,在 MEAD 和 RAVDESS 数据集上,BEACON 仅需微调约 2,000 个样本对、更新预训练 Wan 视频扩散模型约 1% 的参数,即可较现有先进方法提升面部表情表现力,同时维持具有竞争力的身份保持能力。该方法还支持身份与表情的迁移,为更可控、更具个性化的视频生成提供了新的实现路径。
打开原文相关 2.4 · 机会 0
media2.1 KB media640 B media612 B media380 B media9.1 KB media32.7 KB media22.8 KB media24.2 KB media34.7 KB

中文

[提交于 2026 年 9 月 7 日]

标题:BEACON:面向特定人物视频生成的行为与外观控制

查看由 Pokrzywa Baptiste 及其他 5 位作者撰写的论文《BEACON:面向特定人物视频生成的行为与外观控制》PDF

查看 PDF HTML(实验性)

摘要:生成既能保留视觉身份、又能保留人物特有表达行为的人物中心视频,仍然是一项基础性挑战。除了复现外观外,模型还必须复现能够体现人物如何随时间表达情绪的面部行为。然而,大多数最先进方法仅以单张参考图像作为生成条件,而该图像并不包含这些时间动态信息。因此,这些方法往往能够保留人物的视觉身份,却常常生成变化有限、人物特异性较弱的表情。为缓解这一问题,我们提出 BEACON:一种用于特定人物视频生成的轻量级框架,通过将视觉身份与表达行为解耦,生成更具表现力的视频。BEACON 以两种互补信号作为生成条件:用于编码身份的参考图像,以及用于捕捉人物特有面部动态的参考视频。通过利用这些互补信号进行条件控制,BEACON 生成的视频能够更好地保留人物的外观及其标志性面部动态,同时还支持身份—表情迁移。我们在 MEAD 和 RAVDESS 数据集上的实验表明,通过在约 2,000 个样本对上进行微调,并仅更新预训练 Wan 视频扩散模型约 1% 的参数,BEACON 在维持具有竞争力的身份保持能力的同时,相较于最先进的视频生成方法提升了面部表情表现力。

提交历史

提交者:Baptiste Pokrzywa [

查看邮箱

]

[v1]

2026 年 9 月 7 日,周一,09:09:12 UTC(35,218 KB)

English / 原文

[Submitted on 7 Sep 2026]

Title:BEACON: Behavior and Appearance Control for Subject-Specific Video Generation

View a PDF of the paper titled BEACON: Behavior and Appearance Control for Subject-Specific Video Generation, by Pokrzywa Baptiste and 5 other authors

View PDF HTML (experimental)

Abstract:Generating human-centric videos that preserve both visual identity and person-specific expressive behavior remains a fundamental challenge. In addition to reproducing appearance, a model must replicate the facial behaviors that characterize how a subject expresses emotion over time. However, most state-of-the-art methods condition generation on a single reference image, which contains no information about these temporal dynamics. As a result, they tend to preserve the subject's visual identity but often produce expressions with limited variation and weak subject specificity. To mitigate this issue, we introduce BEACON, a lightweight framework for person-specific video generation that produces more expressive videos by disentangling visual identity from expressive behavior. BEACON conditions generation on two complementary signals: a reference image encoding the identity and a reference video capturing subject-specific facial dynamics. By conditioning on these complementary signals, BEACON generates videos that better preserve both the subject's appearance and characteristic facial dynamics, while also supporting identity-expression transfer. Our experiments on the MEAD and RAVDESS datasets show that by fine-tuning on approximately 2,000 pairs and updating about 1% of the pretrained Wan video diffusion model, BEACON improves facial expressivity over state-of-the-art video generation methods while maintaining competitive identity preservation.

Submission history

From: Baptiste Pokrzywa [

view email

]

[v1]

Mon, 7 Sep 2026 09:09:12 UTC (35,218 KB)