20.10.2026, 10:56
Hello,
Flux2 is a 30B model and there is no way to run it on 4GB VRAM. I tried LongCat Q2, but the quality is bad. So I suggest you to use longcat_q3 (3.05GB) or longcat_q4 (3.60GB) with 4 steps (manually override the current default of 2steps). The comfy_bridge is able to run quantized model even on system with low VRAM (it will stream the model from disk), but you need to install the HAVCDitServer on SSD to get a decent speed. I tested it on RTX2080 with 8GB VRAM and 16GB RAM, it run slow, but it works. To get a decent speed you need to enable "Fast Pipeline" (enabled by default).
Good luck!
Dan
Flux2 is a 30B model and there is no way to run it on 4GB VRAM. I tried LongCat Q2, but the quality is bad. So I suggest you to use longcat_q3 (3.05GB) or longcat_q4 (3.60GB) with 4 steps (manually override the current default of 2steps). The comfy_bridge is able to run quantized model even on system with low VRAM (it will stream the model from disk), but you need to install the HAVCDitServer on SSD to get a decent speed. I tested it on RTX2080 with 8GB VRAM and 16GB RAM, it run slow, but it works. To get a decent speed you need to enable "Fast Pipeline" (enabled by default).
Good luck!
Dan