thedeoxen commited on
Commit
c02a022
Β·
verified Β·
1 Parent(s): 77e4606

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +94 -3
README.md CHANGED
@@ -1,3 +1,94 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - black-forest-labs/FLUX.1-Kontext-dev
5
+ pipeline_tag: text-to-image
6
+ tags:
7
+ - flux
8
+ - kontext
9
+ - img2img
10
+ - controlnet
11
+ - flux-kontext
12
+ - image
13
+ - editing
14
+ - lora
15
+ ---
16
+ license: apache-2.0
17
+ base_model:
18
+ - black-forest-labs/FLUX.1-Kontext-dev
19
+ pipeline_tag: image-to-image
20
+ ---
21
+
22
+ # RefControl Flux Kontext – Reference Pose LoRA
23
+
24
+ ## πŸ“ Short description
25
+ A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **pose control map** (right).
26
+ It preserves **identity and style** from the reference while following the **pose and body structure** from the control.
27
+
28
+ **Trigger word:** `refcontrolpose`
29
+ ---
30
+ ## πŸŽ₯ Demo Video
31
+
32
+ [Demo Video] https://youtu.be/8eTjC7InE44
33
+ ---
34
+ ## πŸ“Š Examples
35
+
36
+ | Input | Oupttut |
37
+ |-----------|--------|
38
+ | ![ref1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/1a.png) | ![res1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/1b.png) |
39
+ | ![ref2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/2a.png) | ![res2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/2b.png) |
40
+ | ![ref3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/3a.png) | ![res3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/3b.png) |
41
+ | ![ref4](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/4a.png) | ![res4](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/4b.png) |
42
+ | ![ref5](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/5a.png) | ![res5](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-pose-lora/resolve/main/examples/5b.png) |
43
+
44
+ ---
45
+
46
+ ## πŸ“– Extended description
47
+ This LoRA was primarily trained on **humans**, but it can also be applied to stylized characters and some objects.
48
+ Its main goal is to **transfer identity** β€” facial features, hairstyle, clothing, or object details β€” from the **reference image**, while adapting them to the **pose and skeleton structure** defined by the control map.
49
+
50
+ ---
51
+
52
+ ## βš™οΈ How to use
53
+ 1. Concatenate two images side by side:
54
+ - **Left:** reference image (character, person, or object).
55
+ - **Right:** pose control map (skeleton, keypoints).
56
+ 2. Add the trigger word `refcontrolpose` in your prompt.
57
+ 3. Adjust LoRA weight (recommended **0.8–1.0**) depending on how strongly you want to preserve identity.
58
+
59
+
60
+ Worklow:
61
+
62
+ for workflow you need to install in ComfyUI:
63
+ [comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux)
64
+ [comfyui-kjnodes] (https://github.com/kijai/ComfyUI-KJNodes)
65
+
66
+
67
+ ### βœ… Example prompt
68
+
69
+ refcontrolpose change pose to photo with reference from left side
70
+
71
+ ---
72
+
73
+ ## 🎯 What it does
74
+ - Preserves **character identity** across generations.
75
+ - Adapts the subject to a **new pose or action**.
76
+ - Works well for **character consistency** in sequential generations.
77
+
78
+ ---
79
+
80
+ ## ⚑ Tips
81
+ - Best results when the pose map has **similar proportions** to the reference image.
82
+ - Combine with **text prompts** to refine background or mood.
83
+ - Can be chained with other RefControl LoRAs (depth, lineart, canny) for **multi-constraint generation**.
84
+
85
+ ---
86
+
87
+ ## πŸ“Œ Use cases
88
+ - Character posing for illustrations, comics, or storyboards.
89
+ - Consistent **character design** across different poses.
90
+ - Re-posing **stylized characters** while keeping their identity.
91
+ - Creating **animation keyframes** from static references.
92
+
93
+ ---
94
+