flux-4bit / README.md
newgenai79's picture
Upload README.md
bf182af verified
metadata
library_name: diffusers
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
base_model:
  - black-forest-labs/FLUX.1-dev
pipeline_tag: text-to-image

Credits: eramth

The Flux model with 4bit transformer and T5 encoder.

Usage

from diffusers import FluxPipeline
import torch
pipe = FluxPipeline.from_pretrained("newgenai79/flux-4bit",torch_dtype=torch.float16).to("cuda:1")

pipe_kwargs = {
    "prompt": "A cat holding a sign that says hello world",
    "height": 1024,
    "width": 1024,
    "guidance_scale": 3.5,
    "num_inference_steps": 50,
    "max_sequence_length": 512,
}

image = pipe(**pipe_kwargs, generator=torch.manual_seed(0),).images[0]