Borcherding commited on
Commit
966f1ec
·
verified ·
1 Parent(s): f3030ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +116 -3
README.md CHANGED
@@ -1,3 +1,116 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-image
4
+ - lora
5
+ - diffusers
6
+ - template:diffusion-lora
7
+ widget:
8
+ - text: >-
9
+ autumnProxy orange and red tree surrounded by grass and leaves with a double
10
+ rainbow in the sky above the tree
11
+ parameters:
12
+ negative_prompt: cartoon, fake
13
+ output:
14
+ url: images/seasonallandsfluxdev_000100_04_20241227200714.png
15
+ base_model: black-forest-labs/FLUX.1-dev
16
+ instance_prompt: autumnProxy
17
+ license: apache-2.0
18
+
19
+ ---
20
+ # FLUX.1-dev-LoRA-AutumnSpringTrees
21
+
22
+ <Gallery />
23
+
24
+ ## Model description
25
+
26
+ # FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1 LoRA
27
+
28
+ A LoRA fine-tune for FLUX.1 [dev] that specializes in generating HuggingFace/SmolLM emoji icons. Trained using Fluxgym, by cocktail peanut: https://github.com/cocktailpeanut/fluxgym utilizing SmolLM's Model Card and other HF emojis.
29
+
30
+ ## Overview
31
+ This LoRA enhances FLUX.1 [dev]&#39;s ability to generate Hugging Face Emoji Icon's for utility in new projects on hugging face. Use the trigger word &#x60;HuggingFaceIcons&#x60; to activate the Hugging Face Icon specific capabilities.
32
+
33
+ ## Installation
34
+
35
+ First, ensure you have FLUX.1 [dev] installed:
36
+
37
+ ```python
38
+ # Install
39
+ pip install -U diffusers
40
+
41
+ # Loading with Diffusers
42
+ import torch
43
+ from diffusers import FluxPipeline
44
+
45
+ # Load base model
46
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
47
+ pipe.enable_model_cpu_offload()
48
+
49
+ # Load and apply LoRA weights
50
+ pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
51
+
52
+ # Generate image
53
+ prompt = "HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background."
54
+ image = pipe(
55
+ prompt,
56
+ height=1024,
57
+ width=1024,
58
+ guidance_scale=3.5,
59
+ num_inference_steps=50,
60
+ max_sequence_length=512,
61
+ generator=torch.Generator("cpu").manual_seed(0)
62
+ ).images[0]
63
+ image.save("autumn-scene.png")
64
+
65
+ # Unload LoRA weights if needed
66
+ pipe.unload_lora_weights()
67
+
68
+ # Optional: Merge LoRA weights permanently
69
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
70
+ pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
71
+ pipe.merge_lora_weights()
72
+ pipe.save_pretrained("FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
73
+ ```
74
+
75
+ # Trigger Word
76
+
77
+ Use autumnProxy in your prompts to activate the seasonal enhancements
78
+ Best results achieved when placing the trigger word at the start of the prompt
79
+
80
+ Prompt Examples
81
+ &quot;HuggingFaceIcons a yellow smiley face emoji with its hands on its face, set against a black background. It is an animated emoji, with a cheerful expression and bright colors.&quot;
82
+ &quot;HuggingFaceIcons a yellow smiley face emoji watering a potted plant with a blue watering can. The plant is in a pot and the background is white.&quot;
83
+ &quot;HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background.&quot;
84
+ Specialized Features
85
+
86
+ a yellow smiley face emoji
87
+ with its hands holding a
88
+ whereing a jetpack
89
+
90
+
91
+ # Limitations
92
+
93
+ This is a LoRA for FLUX.1 [dev] and requires the base model to function
94
+ Focus on Hugging Face Icons.
95
+ Trained on a small dataset.
96
+ Inherits base limitations from FLUX.1 [dev]
97
+
98
+ License
99
+ This LoRA falls under the same licensing terms as FLUX.1 [dev]. Please refer to the base model&#39;s license for usage terms.
100
+ Credits
101
+
102
+ Base model: FLUX.1 [dev] by Black Forest Labs
103
+ LoRA training and development: [Borcherding at BorchInk]
104
+
105
+
106
+ ## Trigger words
107
+
108
+ You should use `HuggingFaceIcons` to trigger the image generation.
109
+
110
+
111
+ ## Download model
112
+
113
+ Weights for this model are available in Safetensors format.
114
+
115
+ [Download](/Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1/tree/main) them in the Files & versions tab.
116
+