a-r-r-o-w HF staff commited on
Commit
273991e
·
verified ·
1 Parent(s): 031acb3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - THUDM/CogView4-6B
4
+ datasets:
5
+ - multimodalart/1920-raider-waite-tarot-public-domain
6
+ library_name: diffusers
7
+ license: other
8
+ license_link: https://huggingface.co/THUDM/CogView4-6B/blob/main/LICENSE
9
+ widget:
10
+ - text: >-
11
+ TRTCRD a trtcrd of a knight mounting a running horse wearing an armor and holding a staff, \"knight of wands\"
12
+ output:
13
+ url: final-5000-0-2-TRTCRD-a-trtcrd-of-a-knig-1741227419.png
14
+ - text: >-
15
+ TRTCRD a trtcrd of a woman sitting on a throne, wearing a crown and holding a trophee, \"queen of cups\"
16
+ output:
17
+ url: final-5000-1-2-TRTCRD-a-trtcrd-of-a-woma-1741227417.png
18
+ - text: >-
19
+ TRTCRD a trtcrd of a person in a red robe holding a scale and giving coins to two kneeling figures, surrounded by six pentacles
20
+ output:
21
+ url: final-5000-1-2-TRTCRD-a-trtcrd-of-a-pers-1741227455.png
22
+ tags:
23
+ - text-to-image
24
+ - diffusers-training
25
+ - diffusers
26
+ - template:sd-lora
27
+ - cogview4
28
+ ---
29
+
30
+ <Gallery />
31
+
32
+ This is a LoRA fine-tune of the [THUDM/CogView4-6B](https://huggingface.co/THUDM/CogView4-6B) model.
33
+
34
+ Code: https://github.com/a-r-r-o-w/finetrainers
35
+
36
+ Inference code:
37
+
38
+ ```python
39
+ import torch
40
+ from diffusers import CogView4Pipeline
41
+ from diffusers.utils import export_to_video
42
+
43
+ pipe = CogView4Pipeline.from_pretrained(
44
+ "THUDM/CogView4-6B", torch_dtype=torch.bfloat16
45
+ ).to("cuda")
46
+ pipe.load_lora_weights("finetrainers/CogView4-6B-rider-waite-tarot-v0", adapter_name="cogview4-lora")
47
+ pipe.set_adapters(["cogview4-lora"], [0.9])
48
+
49
+ image = pipe("<my-awesome-prompt>").images[0]
50
+ image.save("output.png")
51
+ ```
52
+
53
+ Training logs are available on WandB [here](https://wandb.ai/aryanvs/finetrainers-cogview4).
54
+
55
+ NOTE: this checkpoint uses sigmas logit_normal weighting. For shifted_sigmas logit_normal weighting, check https://huggingface.co/finetrainers/CogView4-6B-rider-waite-tarot-v0-shifted-sigmas