Qwen-Image-2.1 GGUF:面向本地图像生成的量化模型
英文标题:🤗 abenzerps/Qwen-Image-2.1-GGUF
该仓库提供基于上游 Qwen/Qwen-Image-2.1 原始权重的 GGUF 量化版本,用于通过 ComfyUI 在本地进行文生图和图像编辑。作者推荐 Q4_K_M 量化,以在模型体积与生成质量之间取得较好平衡;推荐配置下,扩散模型约占用 4.6GB 显存,INT8 文本编码器约占用 9.35GB 系统内存。开发者可配合 leejet/ComfyUI-GGUF、Qwen3VL 文本编码器及专用 VAE 部署,并通过将文本编码器卸载至 CPU 内存节省 9–17GB 显存。仓库称当前版本不内置安全检查器或内容过滤器,并表示完整的无审查版本仍在开发中。
7.8 KB
263.3 KB
410.7 KB
中文
注意: 完整无审查版本目前正在开发中,并将很快添加到此仓库。
Qwen-Image-2.1 GGUF
基于上游原始基础权重,为使用本地图像生成的 Qwen/Qwen-Image-2.1 提供的 GGUF 量化版本。
基准测试
GGUF 文件
推荐使用 Q4_K_M,以获得模型体积和质量之间的最佳平衡。
文本编码器与 VAE
为 ComfyUI 打包的配套模型文件:
使用方法
请通过 ComfyUI 和 ComfyUI-GGUF 使用该模型。
所有必需的配套文件(GGUF Transformer、文本编码器和 VAE)均直接托管在此仓库中。
1. 下载与文件放置
下载文件,并将其放入对应的 ComfyUI 目录:
ComfyUI/
└── models/
├── diffusion_models/
│ └── qwen-image-2.1-Q4_K_M.gguf # Choose one GGUF quantization (Q4_K_M recommended)
├── text_encoders/
│ └── qwen3vl_8b_bf16.safetensors # Or qwen3vl_8b_int8_convrot.safetensors (recommended for lower memory)
└── vae/
└── qwen_image_2.1_vae_bf16.safetensors
2. ComfyUI 设置
-
安装 ComfyUI-GGUF:将具备原生 Qwen-Image 2.1 支持的维护版 fork leejet/ComfyUI-GGUF 克隆到自定义节点目录:
cd ComfyUI/custom_nodes git clone https://github.com/leejet/ComfyUI-GGUF
(注意:如果你安装的是较旧的 city96/ComfyUI-GGUF,并遇到 Unknown model architecture! 错误,请更新至上述 leejet fork,或将 ModelQwenImage 添加至 tools/convert.py。)
-
节点配置:
- 扩散模型:添加
Unet Loader (GGUF)节点,并选择已下载的.gguf文件。 - 文本编码器:添加标准
CLIPLoader节点,选择qwen3vl_8b_bf16.safetensors(或int8版本),并将type设置为qwen_image。 - VAE:添加标准
VAELoader节点,并选择qwen_image_2.1_vae_bf16.safetensors。
- 扩散模型:添加
-
官方工作流:
内存与性能说明
- 最佳设置(GPU + RAM):将 GGUF 扩散模型保留在 GPU 显存中(采样期间速度至关重要),并让 文本编码器在系统内存(CPU)中运行或卸载至系统内存。由于每个提示词仅需运行一次文本编码,这种方式可节省 9–17GB 显存,且几乎不会影响生成速度。
- 推荐配置:
- 扩散模型:
qwen-image-2.1-Q4_K_M.gguf(显存占用约 4.6GB) - 文本编码器:
qwen3vl_8b_int8_convrot.safetensors(内存占用约 9.35GB)
- 扩散模型:
- 低显存模式:如果遇到显存不足错误,请使用
--lowvram参数启动 ComfyUI。
无审查
此 GGUF 版本不包含内置安全检查器或内容过滤器。它可直接生成成人、NSFW 和敏感图像,不会拒绝提示词,也不会输出被黑屏处理的图像。输出行为完全取决于输入提示词以及模型执行所处的环境。
来源与构建
English / 原文
Notice: A fully uncensored version is currently in development and will be added to this repository soon.
Qwen-Image-2.1 GGUF
GGUF quantizations of Qwen/Qwen-Image-2.1 for local image generation using the original upstream base weights.
Benchmark
GGUF files
Q4_K_M is recommended for the best balance of size and quality.
Text Encoders & VAE
Companion model files packaged for ComfyUI:
Usage
Use the model with ComfyUI and ComfyUI-GGUF.
All required companion files (GGUF transformer, text encoder, and VAE) are hosted directly in this repository.
1. Download & File Placement
Download the files and place them in their respective ComfyUI directories:
ComfyUI/
└── models/
├── diffusion_models/
│ └── qwen-image-2.1-Q4_K_M.gguf # Choose one GGUF quantization (Q4_K_M recommended)
├── text_encoders/
│ └── qwen3vl_8b_bf16.safetensors # Or qwen3vl_8b_int8_convrot.safetensors (recommended for lower memory)
└── vae/
└── qwen_image_2.1_vae_bf16.safetensors
2. ComfyUI Setup
-
Install ComfyUI-GGUF : Use the maintained fork with native Qwen-Image 2.1 support by cloning leejet/ComfyUI-GGUF into your custom nodes:
cd ComfyUI/custom_nodes git clone https://github.com/leejet/ComfyUI-GGUF
(Note: If you have the oldercity96/ComfyUI-GGUF installed and encounter an Unknown model architecture! error, update to the leejet fork above or add ModelQwenImage to tools/convert.py).
2. Node Configuration :
* Diffusion Model : Add the Unet Loader (GGUF) node and select your downloaded .gguf file.
* Text Encoder : Add the standard CLIPLoader node, select qwen3vl_8b_bf16.safetensors (or int8), and set type to qwen_image.
* VAE : Add the standard VAELoader node and select qwen_image_2.1_vae_bf16.safetensors.
3. Official Workflows :
* You can use the official Comfy-Org workflow templates: Text-to-Image or Image Edit.
* In the workflow, simply replace the default UNETLoader node with Unet Loader (GGUF).
Memory & Performance Notes
- Optimal Setup (GPU + RAM) : Keep the GGUF diffusion model in GPU VRAM (where speed is crucial during sampling) and let the text encoder run in / offload to System RAM (CPU). Because text encoding only runs once per prompt, this saves 9–17 GB of VRAM with virtually zero impact on generation speed.
- Recommended Configuration :
- Diffusion :
qwen-image-2.1-Q4_K_M.gguf(~4.6 GB in VRAM) - Text Encoder :
qwen3vl_8b_int8_convrot.safetensors(~9.35 GB in RAM)
- Diffusion :
- Low VRAM Mode : If you experience VRAM out-of-memory errors, start ComfyUI with the
--lowvramargument.
Uncensored
This GGUF release has no built-in safety checker or content filter. It generates adult, NSFW, and sensitive imagery directly without prompt refusals or blacked-out images. Output behavior depends solely on the input prompts and the environment in which the model is executed.
