Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,79 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
library_name: diffusers
|
| 6 |
+
pipeline_tag: text-to-image
|
| 7 |
+
tags:
|
| 8 |
+
- stable-diffusion-xl
|
| 9 |
+
- nathmath
|
| 10 |
+
- usage
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
### sdxl-0.9-usage
|
| 14 |
+
|
| 15 |
+
- This repo is a tutoral intended to help beginners to use the new released model, stable-diffusion-xl-0.9 in ComfyUI, with both base model and refiner to achieve a magnificent quality of image generation.
|
| 16 |
+
|
| 17 |
+
### Usage
|
| 18 |
+
|
| 19 |
+
- 1. Go to Github and find the latest version of ComfyUI, which is a cutting-edge GUI platform for you to use all kinds of diffusion models.
|
| 20 |
+
Note that in the link below, it provides both a standalone version (do not need an extra python environment), and a source version.
|
| 21 |
+
Link: https://github.com/comfyanonymous/ComfyUI
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
2. Extract all files into your disk if you have chosen the standalone version of this ComfyUI, or install all the dependences to create a essential python environment.
|
| 27 |
+
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
3. Get into the folder or the environment you have just created, when you have finished the last step.
|
| 32 |
+
Next, what you can find includes those two ".bat" files named "run_cpu.bat" and "run_nvidia_gpu.bat" respectively.
|
| 33 |
+
Then, choose the suitable version and click it, which means, to use CUDA or not, and double click to run the script.
|
| 34 |
+
Note that with the application of xformers, you do not need to load all of your models simultaneously, but it is going to be stored in RAM and move back and force when interfereing.
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
4. Download the latest version of stable-diffusion-xl-base-0.9 and stable-diffusion-xl-refiner-0.9 from the official repo on huggingaface.
|
| 40 |
+
It is appreciated that your availability of the model has become unprecedentedly effortless now, so hurry up to try and get on.
|
| 41 |
+
Note that for generation use, you do not need to download all model components, but only the two "safetensors" fron the repo, which are respectively "sd_xl_base_0.9.safetensors" and "sd_xl_refiner_0.9.safetensors".
|
| 42 |
+
Link: https://huggingface.co/stabilityai/stable-diffusion-xl-base-0.9
|
| 43 |
+
Link: https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-0.9
|
| 44 |
+
|
| 45 |
+
|
| 46 |
+
5. Move your "base" and "refiner" models into the ComfyUI's subfolder, like "...\ComfyUI\models\checkpoints\", where "..." means your root folder of your ComfyUI environment.
|
| 47 |
+
And click into the file folder of THIS REPO, and find some files named "sdxl-0.9-...-.json", which is a demo environment I have created for testing and using the stable-diffusion-xl-0.9 in ComfyUI.
|
| 48 |
+
Note that the 3-digit number in the file name represents the version of my demo, and always, you should download the latest one owing the biggest number.
|
| 49 |
+
Link: https://huggingface.co/NathMath/sdxl-0.9-usage/tree/main
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
5. When you have loaded into the ComfyUI, it will show this default interface shown below:
|
| 53 |
+
|
| 54 |
+
|
| 55 |
+
Then, find out the "load" button on a floating panel, click, and choose the ".json" file download from THIS REPO, it will quickly load a friendly interface to use the stable-diffusion-xl-0.9 series.
|
| 56 |
+
|
| 57 |
+
|
| 58 |
+
Things will become easy soon.
|
| 59 |
+
As labels of all components are shown explicitly in interface, you can find enterpoints and panels by their names.
|
| 60 |
+
Then, load the "base" and "refiner" model, set relevant parameters, and type your favorite prompts to start your exciting journey.
|
| 61 |
+
Note that it will automatically save TWO images of EACH queue, respectively before applying with the refiner, and after.
|
| 62 |
+
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
! Congratulations, you have sucessfully learned how to use sdxl with FULL MODELS.
|
| 66 |
+
|
| 67 |
+
|
| 68 |
+
|
| 69 |
+
### Tips
|
| 70 |
+
|
| 71 |
+
- Need to be updated...
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
|
| 75 |
+
### Q&A
|
| 76 |
+
|
| 77 |
+
- Please feel free to leave all of your questions in the community of this repo, and I will soon answer them if I am able to solve them out.
|
| 78 |
+
|
| 79 |
+
|