Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,94 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
base_model:
|
4 |
+
- black-forest-labs/FLUX.1-Kontext-dev
|
5 |
+
pipeline_tag: text-to-image
|
6 |
+
tags:
|
7 |
+
- flux
|
8 |
+
- kontext
|
9 |
+
- img2img
|
10 |
+
- controlnet
|
11 |
+
- flux-kontext
|
12 |
+
- image
|
13 |
+
- editing
|
14 |
+
- lora
|
15 |
+
---
|
16 |
+
license: apache-2.0
|
17 |
+
base_model:
|
18 |
+
- black-forest-labs/FLUX.1-Kontext-dev
|
19 |
+
pipeline_tag: image-to-image
|
20 |
+
---
|
21 |
+
|
22 |
+
# RefControl Flux Kontext β Reference Pose LoRA
|
23 |
+
|
24 |
+
## π Short description
|
25 |
+
A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **pose control map** (right).
|
26 |
+
It preserves **identity and style** from the reference while following the **pose and body structure** from the control.
|
27 |
+
|
28 |
+
**Trigger word:** `refcontrolpose`
|
29 |
+
---
|
30 |
+
## π₯ Demo Video
|
31 |
+
|
32 |
+
[Demo Video] https://youtu.be/8eTjC7InE44
|
33 |
+
---
|
34 |
+
## π Examples
|
35 |
+
|
36 |
+
| Input | Oupttut |
|
37 |
+
|-----------|--------|
|
38 |
+
|  |  |
|
39 |
+
|  |  |
|
40 |
+
|  |  |
|
41 |
+
|  |  |
|
42 |
+
|  |  |
|
43 |
+
|
44 |
+
---
|
45 |
+
|
46 |
+
## π Extended description
|
47 |
+
This LoRA was primarily trained on **humans**, but it can also be applied to stylized characters and some objects.
|
48 |
+
Its main goal is to **transfer identity** β facial features, hairstyle, clothing, or object details β from the **reference image**, while adapting them to the **pose and skeleton structure** defined by the control map.
|
49 |
+
|
50 |
+
---
|
51 |
+
|
52 |
+
## βοΈ How to use
|
53 |
+
1. Concatenate two images side by side:
|
54 |
+
- **Left:** reference image (character, person, or object).
|
55 |
+
- **Right:** pose control map (skeleton, keypoints).
|
56 |
+
2. Add the trigger word `refcontrolpose` in your prompt.
|
57 |
+
3. Adjust LoRA weight (recommended **0.8β1.0**) depending on how strongly you want to preserve identity.
|
58 |
+
|
59 |
+
|
60 |
+
Worklow:
|
61 |
+
|
62 |
+
for workflow you need to install in ComfyUI:
|
63 |
+
[comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux)
|
64 |
+
[comfyui-kjnodes] (https://github.com/kijai/ComfyUI-KJNodes)
|
65 |
+
|
66 |
+
|
67 |
+
### β
Example prompt
|
68 |
+
|
69 |
+
refcontrolpose change pose to photo with reference from left side
|
70 |
+
|
71 |
+
---
|
72 |
+
|
73 |
+
## π― What it does
|
74 |
+
- Preserves **character identity** across generations.
|
75 |
+
- Adapts the subject to a **new pose or action**.
|
76 |
+
- Works well for **character consistency** in sequential generations.
|
77 |
+
|
78 |
+
---
|
79 |
+
|
80 |
+
## β‘ Tips
|
81 |
+
- Best results when the pose map has **similar proportions** to the reference image.
|
82 |
+
- Combine with **text prompts** to refine background or mood.
|
83 |
+
- Can be chained with other RefControl LoRAs (depth, lineart, canny) for **multi-constraint generation**.
|
84 |
+
|
85 |
+
---
|
86 |
+
|
87 |
+
## π Use cases
|
88 |
+
- Character posing for illustrations, comics, or storyboards.
|
89 |
+
- Consistent **character design** across different poses.
|
90 |
+
- Re-posing **stylized characters** while keeping their identity.
|
91 |
+
- Creating **animation keyframes** from static references.
|
92 |
+
|
93 |
+
---
|
94 |
+
|