Bringing Nunchaku 4-bit Diffusion Inference to Diffusers
Bringing Nunchaku 4-bit Diffusion Inference to Diffusers Most of these backends are weight-only . This means that they store the weights in low precision and dequantize them back to high precision at compute time. This reduces memory usage...
Scan with your phone
Scan with your phone