Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,116 @@
|
|
1 |
-
---
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- text-to-image
|
4 |
+
- lora
|
5 |
+
- diffusers
|
6 |
+
- template:diffusion-lora
|
7 |
+
widget:
|
8 |
+
- text: >-
|
9 |
+
autumnProxy orange and red tree surrounded by grass and leaves with a double
|
10 |
+
rainbow in the sky above the tree
|
11 |
+
parameters:
|
12 |
+
negative_prompt: cartoon, fake
|
13 |
+
output:
|
14 |
+
url: images/seasonallandsfluxdev_000100_04_20241227200714.png
|
15 |
+
base_model: black-forest-labs/FLUX.1-dev
|
16 |
+
instance_prompt: autumnProxy
|
17 |
+
license: apache-2.0
|
18 |
+
|
19 |
+
---
|
20 |
+
# FLUX.1-dev-LoRA-AutumnSpringTrees
|
21 |
+
|
22 |
+
<Gallery />
|
23 |
+
|
24 |
+
## Model description
|
25 |
+
|
26 |
+
# FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1 LoRA
|
27 |
+
|
28 |
+
A LoRA fine-tune for FLUX.1 [dev] that specializes in generating HuggingFace/SmolLM emoji icons. Trained using Fluxgym, by cocktail peanut: https://github.com/cocktailpeanut/fluxgym utilizing SmolLM's Model Card and other HF emojis.
|
29 |
+
|
30 |
+
## Overview
|
31 |
+
This LoRA enhances FLUX.1 [dev]'s ability to generate Hugging Face Emoji Icon's for utility in new projects on hugging face. Use the trigger word `HuggingFaceIcons` to activate the Hugging Face Icon specific capabilities.
|
32 |
+
|
33 |
+
## Installation
|
34 |
+
|
35 |
+
First, ensure you have FLUX.1 [dev] installed:
|
36 |
+
|
37 |
+
```python
|
38 |
+
# Install
|
39 |
+
pip install -U diffusers
|
40 |
+
|
41 |
+
# Loading with Diffusers
|
42 |
+
import torch
|
43 |
+
from diffusers import FluxPipeline
|
44 |
+
|
45 |
+
# Load base model
|
46 |
+
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
|
47 |
+
pipe.enable_model_cpu_offload()
|
48 |
+
|
49 |
+
# Load and apply LoRA weights
|
50 |
+
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
|
51 |
+
|
52 |
+
# Generate image
|
53 |
+
prompt = "HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background."
|
54 |
+
image = pipe(
|
55 |
+
prompt,
|
56 |
+
height=1024,
|
57 |
+
width=1024,
|
58 |
+
guidance_scale=3.5,
|
59 |
+
num_inference_steps=50,
|
60 |
+
max_sequence_length=512,
|
61 |
+
generator=torch.Generator("cpu").manual_seed(0)
|
62 |
+
).images[0]
|
63 |
+
image.save("autumn-scene.png")
|
64 |
+
|
65 |
+
# Unload LoRA weights if needed
|
66 |
+
pipe.unload_lora_weights()
|
67 |
+
|
68 |
+
# Optional: Merge LoRA weights permanently
|
69 |
+
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
|
70 |
+
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
|
71 |
+
pipe.merge_lora_weights()
|
72 |
+
pipe.save_pretrained("FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
|
73 |
+
```
|
74 |
+
|
75 |
+
# Trigger Word
|
76 |
+
|
77 |
+
Use autumnProxy in your prompts to activate the seasonal enhancements
|
78 |
+
Best results achieved when placing the trigger word at the start of the prompt
|
79 |
+
|
80 |
+
Prompt Examples
|
81 |
+
"HuggingFaceIcons a yellow smiley face emoji with its hands on its face, set against a black background. It is an animated emoji, with a cheerful expression and bright colors."
|
82 |
+
"HuggingFaceIcons a yellow smiley face emoji watering a potted plant with a blue watering can. The plant is in a pot and the background is white."
|
83 |
+
"HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background."
|
84 |
+
Specialized Features
|
85 |
+
|
86 |
+
a yellow smiley face emoji
|
87 |
+
with its hands holding a
|
88 |
+
whereing a jetpack
|
89 |
+
|
90 |
+
|
91 |
+
# Limitations
|
92 |
+
|
93 |
+
This is a LoRA for FLUX.1 [dev] and requires the base model to function
|
94 |
+
Focus on Hugging Face Icons.
|
95 |
+
Trained on a small dataset.
|
96 |
+
Inherits base limitations from FLUX.1 [dev]
|
97 |
+
|
98 |
+
License
|
99 |
+
This LoRA falls under the same licensing terms as FLUX.1 [dev]. Please refer to the base model's license for usage terms.
|
100 |
+
Credits
|
101 |
+
|
102 |
+
Base model: FLUX.1 [dev] by Black Forest Labs
|
103 |
+
LoRA training and development: [Borcherding at BorchInk]
|
104 |
+
|
105 |
+
|
106 |
+
## Trigger words
|
107 |
+
|
108 |
+
You should use `HuggingFaceIcons` to trigger the image generation.
|
109 |
+
|
110 |
+
|
111 |
+
## Download model
|
112 |
+
|
113 |
+
Weights for this model are available in Safetensors format.
|
114 |
+
|
115 |
+
[Download](/Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1/tree/main) them in the Files & versions tab.
|
116 |
+
|