论文研究 arXiv cs.CV Mon, 03 Aug 2026 正文 ok 252 words

WaiT for the Signal:简单的频率感知流匹配

英文标题:WaiT for the Signal: Simple Frequency-Aware Flow-Matching

论文提出 WaiT(Wavelet-aware image Transformer),利用无损小波将图像生成分解为粗粒度与细粒度频带,并让高频频带在低频结构形成前保持纯噪声。作者指出,传统 Flow Matching 对所有空间频率一视同仁,忽略了高频信息比粗粒度结构更早难以与噪声区分的自然频率层级。在 ImageNet 512×512 上,WaiT 实现了 1.43 的像素空间 FID,并在三轴评估中达到帕累托最优,采样计算量最高可降低 50%;其最大的 20 亿参数模型将像素空间模型的 FID 推进至 1.3。该方法还在纹理保真度上超过最强的潜空间模型,并可无需算法改动扩展至 OpenImages 高分辨率生成和视频生成,在 Kinetics-600 上取得 0.84 的 SOTA FVD。
打开原文相关 2.4 · 机会 0
media2.1 KB media640 B media612 B media380 B media9.1 KB media32.7 KB media22.8 KB media24.2 KB media34.7 KB

中文

[提交于 2026 年 7 月 30 日]

标题:WaiT for the Signal:简单的频率感知流匹配

查看题为《WaiT for the Signal:简单的频率感知流匹配》的论文 PDF,作者为 Krunoslav Lehman Pavasovic 及其他 6 位作者

查看 PDF HTML(实验性)

摘要:随着图像生成模型扩展至越来越高的分辨率,全局一致性、局部细节与纹理保真度成为生成质量的关键维度。然而,标准 Flow Matching 对所有空间频率一视同仁,忽略了自然存在的频率层级:高频频带会比粗粒度结构更早变得无法与纯噪声区分。我们提出 WaiT,一种小波感知图像 Transformer,它通过无损小波将生成过程分解为粗粒度和细粒度频带。正如其名称所示,高频频带会等待信号:在粗粒度结构形成之前保持为纯噪声,随后加入流过程进行联合细化。由于标准 FID 会通过激进下采样丢弃细粒度细节,我们提出了更严格的三轴评估协议,以在原生分辨率下衡量质量。在 ImageNet 512×512 上,WaiT 实现了 1.43 的像素空间 FID,并在全部三个维度上达到帕累托最优,同时将采样计算量最多降低 50%。借助我们最大的 20 亿参数模型,我们在 ImageNet 512 分辨率上为像素空间模型创下了 1.3 FID 的新 SOTA。我们的公式化方法即使在纹理保真度上也优于最强的潜空间模型,并且能够无缝扩展至高分辨率 OpenImages 和视频生成;在无需任何算法修改的情况下,其在 Kinetics-600 上实现了 0.84 的 SOTA FVD。

提交历史

来自:Krunoslav Lehman Pavasovic [

查看电子邮件

]

[v1]

2026 年 7 月 30 日,星期四,18:26:19 UTC(29,275 KB)

English / 原文

[Submitted on 30 Jul 2026]

Title:WaiT for the Signal: Simple Frequency-Aware Flow-Matching

View a PDF of the paper titled WaiT for the Signal: Simple Frequency-Aware Flow-Matching, by Krunoslav Lehman Pavasovic and 6 other authors

View PDF HTML (experimental)

Abstract:As image generation models scale to ever higher resolutions, global coherence, local detail, and texture fidelity become critical axes for generation quality. However, standard flow matching treats all spatial frequencies uniformly, ignoring the natural frequency hierarchy where high-frequency bands become indistinguishable from pure noise far earlier than coarse structures. We introduce WaiT, a Wavelet-aware image Transformer that decomposes generation into coarse and fine bands via lossless wavelets. True to its name, the high-frequency bands wait for the signal: staying pure noise until coarse structure has emerged, then joining the flow for joint refinement. Since standard FID discards fine-grained detail through aggressive downsampling, we introduce a more stringent three-axis evaluation protocol to assess quality at native resolution. On ImageNet 512x512, WaiT achieves a pixel-space FID of 1.43 and is Pareto-optimal across all three axes, reducing sampling compute by up to 50%. With our largest 2B model, we set a new state-of-the-art FID of 1.3 for pixel-space models on ImageNet 512 resolution. Our formulation outperforms even the strongest latent-space models on texture fidelity, and scales seamlessly to high-resolution OpenImages and to video generation, achieving a state-of-the-art FVD of 0.84 on Kinetics-600 with no algorithmic modifications.

Submission history

From: Krunoslav Lehman Pavasovic [

view email

]

[v1]

Thu, 30 Jul 2026 18:26:19 UTC (29,275 KB)