|
|
--- |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- black-forest-labs/FLUX.1-Kontext-dev |
|
|
pipeline_tag: image-to-image |
|
|
tags: |
|
|
- flux |
|
|
- kontext |
|
|
- img2img |
|
|
- controlnet |
|
|
- flux-kontext |
|
|
- image |
|
|
- editing |
|
|
- lora |
|
|
--- |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- black-forest-labs/FLUX.1-Kontext-dev |
|
|
pipeline_tag: image-to-image |
|
|
--- |
|
|
|
|
|
# RefControl Flux Kontext – Reference Pose LoRA |
|
|
|
|
|
## 📝 Short description |
|
|
A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **pose control map** (right). |
|
|
It preserves **identity and style** from the reference while following the **pose and body structure** from the control. |
|
|
|
|
|
**Trigger word:** `refcontrolpose` |
|
|
--- |
|
|
[🎥 Demo Video](https://youtu.be/8eTjC7InE44) |
|
|
|
|
|
--- |
|
|
## 📊 Examples |
|
|
| Input | Oupttut | |
|
|
|-----------|--------| |
|
|
|  |  | |
|
|
|  |  | |
|
|
|  |  | |
|
|
|  |  | |
|
|
|  |  | |
|
|
|
|
|
--- |
|
|
|
|
|
## 📖 Extended description |
|
|
This LoRA was primarily trained on **humans**, but it can also be applied to stylized characters and some objects. |
|
|
Its main goal is to **transfer identity** — facial features, hairstyle, clothing, or object details — from the **reference image**, while adapting them to the **pose and skeleton structure** defined by the control map. |
|
|
|
|
|
--- |
|
|
|
|
|
## ⚙️ How to use |
|
|
1. Concatenate two images side by side: |
|
|
- **Left:** reference image (character, person, or object). |
|
|
- **Right:** pose control map (skeleton, keypoints). |
|
|
2. Add the trigger word `refcontrolpose` in your prompt. |
|
|
3. Adjust LoRA weight (recommended **0.8–1.0**) depending on how strongly you want to preserve identity. |
|
|
|
|
|
|
|
|
### Worklow: |
|
|
You can find workflow in the workflows folder. |
|
|
|
|
|
For workflow you need to install in ComfyUI: |
|
|
|
|
|
- [comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux) |
|
|
- [comfyui-kjnodes](https://github.com/kijai/ComfyUI-KJNodes) |
|
|
|
|
|
|
|
|
### ✅ Example prompt |
|
|
|
|
|
refcontrolpose change pose to photo with reference from left side |
|
|
|
|
|
--- |
|
|
|
|
|
## 🎯 What it does |
|
|
- Preserves **character identity** across generations. |
|
|
- Adapts the subject to a **new pose or action**. |
|
|
- Works well for **character consistency** in sequential generations. |
|
|
|
|
|
--- |
|
|
|
|
|
## ⚡ Tips |
|
|
- Best results when the pose map has **similar proportions** to the reference image. |
|
|
- Combine with **text prompts** to refine background or mood. |
|
|
- Can be chained with other RefControl LoRAs (depth, lineart, canny) for **multi-constraint generation**. |
|
|
|
|
|
--- |
|
|
|
|
|
## 📌 Use cases |
|
|
- Character posing for illustrations, comics, or storyboards. |
|
|
- Consistent **character design** across different poses. |
|
|
- Re-posing **stylized characters** while keeping their identity. |
|
|
- Creating **animation keyframes** from static references. |
|
|
|
|
|
--- |
