Update README.md
Browse files
README.md
CHANGED
@@ -14,18 +14,36 @@ instance_prompt: null
|
|
14 |
---
|
15 |
# Wan-LoRA-Arcane-Jinx-v1
|
16 |
<Gallery />
|
17 |
-
<b>Please note that this is just a quick test I made. I didn't intend to share it, but eventually uploaded the LoRA model upon request.
|
18 |
-
Because of this, there isn't much information shared about it and most probably I'll remove the repo in the next 24 hours.
|
19 |
-
In the future, I'll dig deeper into it and upload the final models.</b>
|
20 |
|
21 |
-
|
|
|
22 |
|
23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
|
25 |
-
|
26 |
|
27 |
-
##
|
28 |
|
29 |
-
|
|
|
|
|
30 |
|
31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
---
|
15 |
# Wan-LoRA-Arcane-Jinx-v1
|
16 |
<Gallery />
|
|
|
|
|
|
|
17 |
|
18 |
+
## Trainig details:
|
19 |
+
I tried a method where I first trained the LoRA on images only and then after a certain number of steps continued training only on videos.
|
20 |
|
21 |
+
- LR: 2e-5
|
22 |
+
- Optimizer: adamw_optimi
|
23 |
+
- epochs: 15 (image) + 7 (video)
|
24 |
+
- steps: 2550 (image) + 2520 (video)
|
25 |
+
- dataset: 135 videos and 135 images
|
26 |
+
- repeats: 10
|
27 |
+
- rank: 128
|
28 |
+
- batch size: 2
|
29 |
+
- gradient accumulation steps: 1
|
30 |
|
31 |
+
For training I used the [Diffusion-Pipe](https://github.com/tdrussell/diffusion-pipe/tree/main) repo.
|
32 |
|
33 |
+
## Inference
|
34 |
|
35 |
+
For inference you can use
|
36 |
+
- [ComfyUI native nodes](https://blog.comfy.org/p/wan21-video-model-native-support)
|
37 |
+
- [Kijai's wrapper nodes](https://github.com/kijai/ComfyUI-WanVideoWrapper)
|
38 |
|
39 |
+
<b>Trigger words</b>: csetiarcane, Nfj1nx
|
40 |
+
|
41 |
+
(If it isn't enough so you don't get the style/character, I recommend adding "animation style" to you prompt. It can help providing the style but in some cases the result will be too cartoony)
|
42 |
+
|
43 |
+
<b>Strength</b>: 0.9-1.0
|
44 |
+
|
45 |
+
## Acknowledgement
|
46 |
+
|
47 |
+
Special thanks to Kijai for the tireless and excelent work done for the community to enable us to use these solutions as soon as possible,
|
48 |
+
as well, as to Comfyanonymous for implementing them so quickly with such a good quality natively into ComfyUI,
|
49 |
+
and also to TDRussel for making LoRA training available to the community so quickly.
|