HuggingFace Daily Papers(社区热门论文)· HuggingFace Daily Papers(社区热门论文)·· 7 天前AI 评分40
LongLive-Plug:面向视频生成的一次性蒸馏框架
AI 导读
LongLive-Plug 是一个一次性蒸馏框架,把可复用能力以 LoRA 形式学在基座模型上,无需重训练即可即插即用到兼容的下游模型。这些能力涵盖单次 classifier-free guidance、少步采样和自回归生成的长上下文纠错,即使下游模型新增条件分支或扩展输出通道仍可复用。团队在三个骨干家族、八类任务的 54 个下游模型上验证了免训练部署,包括世界建模、机器人、编辑和多模态生成。
正文
Authors:Shuai Yang, Luozhou Wang, Wei Huang, ZhiFei Chen, Bohan Zhang, Xiao Fu, Qianli Ma, Chen-Hsuan Lin, Weian Mao, Bryan Chu, Song Han, Yukang Chen
Abstract:Video diffusion models are increasingly developed into specialized models for diverse downstream tasks, and this development often includes a distillation stage, for example to accelerate sampling or to improve long-video generation. This stage is typically repeated for every specialized model. We introduce LongLive-Plug, a once-for-all distillation framework that learns reusable capabilities as LoRAs on a base model for training-free, plug-and-play deployment to compatible downstream models. These capabilities include single-pass classifier-free guidance, few-step sampling, and long-context error correction for autoregressive generation. The adapters remain reusable even when downstream models add conditioning branches, expand output channels. Despite training at a fixed guidance scale, our dedicated CFG LoRA provides text guidance control through its inference weight. Combining it with a few-step LoRA simultaneously preserves few-step generation and CFG controllability on downstream tasks. We verify training-free deployment on 54 downstream models across three backbone families and eight task categories, including world modeling, robotics, editing, and multimodal generation. The approach may support additional compatible models. Each capability can thus be distilled once per backbone family and reused without per-target retraining.
| Comments: | Code and models are available at this https URL |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2609.38154 [cs.CV] |
| (or arXiv:2609.38154v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2609.38154 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Shuai Yang [view email]
[v1]
Tue, 29 Sep 2026 17:58:49 UTC (44,482 KB)
来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org