File size: 4,956 Bytes
966f1ec a3e3237 966f1ec fda49ca 0031c6e 61b60fe dd173b5 80b2f0e b77e81f 7302d19 ae32383 d81c1bf 966f1ec 6ca65b7 966f1ec 7f4a96a 966f1ec 98f735b 966f1ec |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 |
---
datasets:
- Borcherding/HuggingFaceIcons-imageAnnotations-v0.1
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora
widget:
- text: >-
HuggingFaceIcons a yellow smiley face sun with a book in its hands,
surrounded by planets and stars in a dark background.
output:
url: images/example_8lqdj7555.png
- text: >-
HuggingFaceIcons a blue icey brrr face emoji with hands holding itself,
chilly surrounded by snow and ice, made of ice going brr.
output:
url: images/example_5v4kiodrg.png
- text: >-
HuggingFaceIcons a lava smiley face with fire in its hands, surrounded by a
black background.
output:
url: images/example_hq5huia8y.png
- text: HuggingFaceIcons a yellow smiley face with a chef hat, cooking food
output:
url: images/example_t6h96s5is.png
- text: HuggingFaceIcons a smiley face emoji robot C-3PO from star wars
output:
url: images/e1a8be19-f267-4eb7-acd6-f17f961cdfad.jpg
- text: HuggingFaceIcons a smiley face emoji robot R2-D2 from star wars
output:
url: images/example_xr3572e93.png
- text: HuggingFaceIcons a lime green alien smiley face in a flying saucer
output:
url: images/example_zbpq5oz6v.png
- text: HuggingFaceIcons a grey smiley rock emoji face with a black background
output:
url: images/example_l79ynatvl.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: autumnProxy
license: apache-2.0
---
# FLUX.1-dev-LoRA-AutumnSpringTrees
<Gallery />
## Model description
# FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1 LoRA
A LoRA fine-tune for FLUX.1 [dev] that specializes in generating [HuggingFace](https://huggingface.co/brand)/[SmolLM](https://huggingface.co/HuggingFaceTB/SmolLM-360M) emoji icons. Trained using Fluxgym, by cocktail peanut: https://github.com/cocktailpeanut/fluxgym utilizing [SmolLM's Model Card and other HF emojis](https://huggingface.co/datasets/Borcherding/HuggingFaceIcons-imageAnnotations-v0.1).
## Overview
This LoRA enhances FLUX.1 [dev]'s ability to generate Hugging Face Emoji Icon's for utility in new projects on hugging face. Start making your own unique model cards for finetunes with this HF icon aesthetic. Use the trigger word `HuggingFaceIcons` to activate the Hugging Face Icon specific capabilities.
## Installation
First, ensure you have FLUX.1 [dev] installed:
```python
# Install
pip install -U diffusers
# Loading with Diffusers
import torch
from diffusers import FluxPipeline
# Load base model
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload()
# Load and apply LoRA weights
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
# Generate image
prompt = "HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background."
image = pipe(
prompt,
height=1024,
width=1024,
guidance_scale=3.5,
num_inference_steps=50,
max_sequence_length=512,
generator=torch.Generator("cpu").manual_seed(0)
).images[0]
image.save("autumn-scene.png")
# Unload LoRA weights if needed
pipe.unload_lora_weights()
# Optional: Merge LoRA weights permanently
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
pipe.merge_lora_weights()
pipe.save_pretrained("FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1")
```
# Trigger Word
Use trigger word "HuggingFaceIcons" in your prompts to activate the hugging face icon LoRA.
Best results achieved when placing the trigger word at the start of the prompt
Prompt Examples
"HuggingFaceIcons a yellow smiley face emoji with its hands on its face, set against a black background. It is an animated emoji, with a cheerful expression and bright colors."
"HuggingFaceIcons a yellow smiley face emoji watering a potted plant with a blue watering can. The plant is in a pot and the background is white."
"HuggingFaceIcons a yellow smiley face sun with a book in its hands, surrounded by planets and stars in a dark background."
Specialized Features
a yellow smiley face emoji
with its hands holding a
whereing a jetpack
# Limitations
This is a LoRA for FLUX.1 [dev] and requires the base model to function
Focus on Hugging Face Icons.
Trained on a small dataset.
Inherits base limitations from FLUX.1 [dev]
License
This LoRA falls under the same licensing terms as FLUX.1 [dev]. Please refer to the base model's license for usage terms.
Credits
Base model: FLUX.1 [dev] by Black Forest Labs
LoRA training and development: [Borcherding at BorchInk]
## Trigger words
You should use `HuggingFaceIcons` to trigger the image generation.
## Download model
Weights for this model are available in Safetensors format.
[Download](/Borcherding/FLUX.1-dev-LoRA-HuggingFaceIcons-v0.1/tree/main) them in the Files & versions tab.
|