Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,36 @@
|
|
|
|
|
| 1 |
---
|
| 2 |
-
|
| 3 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
---
|
| 3 |
+
tags:
|
| 4 |
+
- stable-diffusion
|
| 5 |
+
- Image-to-Video
|
| 6 |
+
- lora
|
| 7 |
+
- character
|
| 8 |
+
- diffusionpipe
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Dragon Ball Fight Scene Adaptation.
|
| 12 |
+
|
| 13 |
+
This repository contains **a 60 epoch** lora training to adapt the fight scene motion of the famous dragon ball anime series. The Lora was trained on 60, 5 second videos from a recent dragon ball movie, using the **WAN2.1 14B** I2V model as a base.
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
## How to Use with
|
| 18 |
+
|
| 19 |
+
- Download the models you want and load into comfyUI.
|
| 20 |
+
- Load the **Wan 2.1 14B I2v** model.
|
| 21 |
+
- Genereate videos using the **dbz_fight_style,** Trigger word and then writing your prompt.
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
## Training Details
|
| 25 |
+
Base Model: The LoRAs were trained on top of the WAN2.1 14B parameter I2V model.
|
| 26 |
+
Training Library: The training was implemented using the diffusionpipe library.
|
| 27 |
+
Hyperparameters: For a detailed look at the training configuration and hyperparameters, please visit the training repository [here](https://github.com/Long-form-AI-video-generation/lora_training_experiment/blob/master/training/wan_14b_min_vram.toml).
|
| 28 |
+
|
| 29 |
+
## Dataset
|
| 30 |
+
You can find the dataset used [here](https://huggingface.co/datasets/Bisre/dbz-fight-style-dataset)
|
| 31 |
+
|
| 32 |
+
|
| 33 |
+
## Demo video
|
| 34 |
+
<img src="https://huggingface.co/Bisre/dbz-fight-style-lora/resolve/main/1_with_lora.webp" width="512" height="512">
|
| 35 |
+
|
| 36 |
+
- More videos can be found [here](https://drive.google.com/drive/folders/1yREYnDl277vXfdis59mIcPOmI1n0vB2T?usp=drive_link).
|