Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model:
|
3 |
+
- THUDM/CogView4-6B
|
4 |
+
datasets:
|
5 |
+
- multimodalart/1920-raider-waite-tarot-public-domain
|
6 |
+
library_name: diffusers
|
7 |
+
license: other
|
8 |
+
license_link: https://huggingface.co/THUDM/CogView4-6B/blob/main/LICENSE
|
9 |
+
widget:
|
10 |
+
- text: >-
|
11 |
+
TRTCRD a trtcrd of a knight mounting a running horse wearing an armor and holding a staff, \"knight of wands\"
|
12 |
+
output:
|
13 |
+
url: final-5000-0-2-TRTCRD-a-trtcrd-of-a-knig-1741227419.png
|
14 |
+
- text: >-
|
15 |
+
TRTCRD a trtcrd of a woman sitting on a throne, wearing a crown and holding a trophee, \"queen of cups\"
|
16 |
+
output:
|
17 |
+
url: final-5000-1-2-TRTCRD-a-trtcrd-of-a-woma-1741227417.png
|
18 |
+
- text: >-
|
19 |
+
TRTCRD a trtcrd of a person in a red robe holding a scale and giving coins to two kneeling figures, surrounded by six pentacles
|
20 |
+
output:
|
21 |
+
url: final-5000-1-2-TRTCRD-a-trtcrd-of-a-pers-1741227455.png
|
22 |
+
tags:
|
23 |
+
- text-to-image
|
24 |
+
- diffusers-training
|
25 |
+
- diffusers
|
26 |
+
- template:sd-lora
|
27 |
+
- cogview4
|
28 |
+
---
|
29 |
+
|
30 |
+
<Gallery />
|
31 |
+
|
32 |
+
This is a LoRA fine-tune of the [THUDM/CogView4-6B](https://huggingface.co/THUDM/CogView4-6B) model.
|
33 |
+
|
34 |
+
Code: https://github.com/a-r-r-o-w/finetrainers
|
35 |
+
|
36 |
+
Inference code:
|
37 |
+
|
38 |
+
```python
|
39 |
+
import torch
|
40 |
+
from diffusers import CogView4Pipeline
|
41 |
+
from diffusers.utils import export_to_video
|
42 |
+
|
43 |
+
pipe = CogView4Pipeline.from_pretrained(
|
44 |
+
"THUDM/CogView4-6B", torch_dtype=torch.bfloat16
|
45 |
+
).to("cuda")
|
46 |
+
pipe.load_lora_weights("finetrainers/CogView4-6B-rider-waite-tarot-v0", adapter_name="cogview4-lora")
|
47 |
+
pipe.set_adapters(["cogview4-lora"], [0.9])
|
48 |
+
|
49 |
+
image = pipe("<my-awesome-prompt>").images[0]
|
50 |
+
image.save("output.png")
|
51 |
+
```
|
52 |
+
|
53 |
+
Training logs are available on WandB [here](https://wandb.ai/aryanvs/finetrainers-cogview4).
|
54 |
+
|
55 |
+
NOTE: this checkpoint uses sigmas logit_normal weighting. For shifted_sigmas logit_normal weighting, check https://huggingface.co/finetrainers/CogView4-6B-rider-waite-tarot-v0-shifted-sigmas
|