QwenEdit InStyle LoRA
Model Description
QwenEdit InStyle is a LoRA fine-tune for QwenEdit that significantly improves its ability to generate images based on a style reference. While the base model has style transfer capabilities, it often misses the nuances of styles and can transplant unwanted details from the input image. This LoRA addresses these limitations to provide more accurate style-based image generation.
How to Use
To get the best results, start your prompt with the phrase:
Make an image in this style of
And then describe what you want to generate.
For example:
Make an image in this style of a serene mountain landscape at sunset.
Strengths & Weaknesses
The model excels at:
- Capturing subtle style nuances from reference images
- Avoiding unwanted detail transplantation from source images
- Generating coherent images that match the intended style
- Strong prompt adherence
The model may struggle with:
- Extremely abstract or unconventional artistic styles
- Very specific technical details that conflict with the reference style
- Occasional anatomy issues
Training Data
The QwenEdit InStyle LoRA was trained on a curated dataset of high-quality Midjourney style references. This dataset focuses on diverse artistic styles and provides clean style-content separation for better training.
You can find the public dataset used for training here: https://huggingface.co/datasets/peteromallet/high-quality-midjouney-srefs
Links
Model tree for peteromallet/Qwen-Image-Edit-InStyle
Base model
Qwen/Qwen-Image-Edit