Cseti commited on
Commit
d5db431
·
verified ·
1 Parent(s): 5b4fc07

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -9
README.md CHANGED
@@ -14,18 +14,36 @@ instance_prompt: null
14
  ---
15
  # Wan-LoRA-Arcane-Jinx-v1
16
  <Gallery />
17
- <b>Please note that this is just a quick test I made. I didn't intend to share it, but eventually uploaded the LoRA model upon request.
18
- Because of this, there isn't much information shared about it and most probably I'll remove the repo in the next 24 hours.
19
- In the future, I'll dig deeper into it and upload the final models.</b>
20
 
21
- This LoRA was trained on the 1.3B Wan t2v model.
 
22
 
23
- <b>TRIGGER WORDS</b>: csetiarcane, J1nx
 
 
 
 
 
 
 
 
24
 
25
- <b>Strength</b>: try lowering it during inference. It is possible that the model is overtrained a bit. I didn't had a chance to test it properly.
26
 
27
- ## Download model
28
 
29
- Weights for this model are available in Safetensors format.
 
 
30
 
31
- [Download](/Cseti/Wan-LoRA-Arcane-Jinx-v1/tree/main) them in the Files & versions tab.
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
  # Wan-LoRA-Arcane-Jinx-v1
16
  <Gallery />
 
 
 
17
 
18
+ ## Trainig details:
19
+ I tried a method where I first trained the LoRA on images only and then after a certain number of steps continued training only on videos.
20
 
21
+ - LR: 2e-5
22
+ - Optimizer: adamw_optimi
23
+ - epochs: 15 (image) + 7 (video)
24
+ - steps: 2550 (image) + 2520 (video)
25
+ - dataset: 135 videos and 135 images
26
+ - repeats: 10
27
+ - rank: 128
28
+ - batch size: 2
29
+ - gradient accumulation steps: 1
30
 
31
+ For training I used the [Diffusion-Pipe](https://github.com/tdrussell/diffusion-pipe/tree/main) repo.
32
 
33
+ ## Inference
34
 
35
+ For inference you can use
36
+ - [ComfyUI native nodes](https://blog.comfy.org/p/wan21-video-model-native-support)
37
+ - [Kijai's wrapper nodes](https://github.com/kijai/ComfyUI-WanVideoWrapper)
38
 
39
+ <b>Trigger words</b>: csetiarcane, Nfj1nx
40
+
41
+ (If it isn't enough so you don't get the style/character, I recommend adding "animation style" to you prompt. It can help providing the style but in some cases the result will be too cartoony)
42
+
43
+ <b>Strength</b>: 0.9-1.0
44
+
45
+ ## Acknowledgement
46
+
47
+ Special thanks to Kijai for the tireless and excelent work done for the community to enable us to use these solutions as soon as possible,
48
+ as well, as to Comfyanonymous for implementing them so quickly with such a good quality natively into ComfyUI,
49
+ and also to TDRussel for making LoRA training available to the community so quickly.