Spaces:
				
			
			
	
			
			
		Runtime error
		
	
	
	
			
			
	
	
	
	
		
		
		Runtime error
		
	
		Patrick Esser
		
	commited on
		
		
					Commit 
							
							·
						
						49117c2
	
1
								Parent(s):
							
							635548d
								
add inpainting model
Browse filesFormer-commit-id: 32a9661b4eb92cfd0c6f74e7223fdf8b036b868e
- README.md +15 -2
- scripts/download_models.sh +2 -5
    	
        README.md
    CHANGED
    
    | @@ -70,10 +70,23 @@ We provide a first script for sampling from our unconditional models. Start it v | |
| 70 | 
             
            CUDA_VISIBLE_DEVICES=<GPU_ID> python scripts/sample_diffusion.py -r models/ldm/<model_spec>/model.ckpt -l <logdir> -n <\#samples> --batch_size <batch_size> -c <\#ddim steps> -e <\#eta> 
         | 
| 71 | 
             
            ```
         | 
| 72 |  | 
| 73 | 
            -
             | 
| 74 | 
            -
             | 
| 75 | 
             
            
         | 
| 76 |  | 
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
| 77 | 
             
            * Code for training LDMs and the corresponding compression models.
         | 
| 78 | 
             
            * Inference scripts for conditional LDMs for various conditioning modalities.
         | 
| 79 | 
             
            * In the meantime, you can play with our colab notebook https://colab.research.google.com/drive/1xqzUi2iXQXDqXBHQGP9Mqt2YrYW6cx-J?usp=sharing
         | 
|  | |
| 70 | 
             
            CUDA_VISIBLE_DEVICES=<GPU_ID> python scripts/sample_diffusion.py -r models/ldm/<model_spec>/model.ckpt -l <logdir> -n <\#samples> --batch_size <batch_size> -c <\#ddim steps> -e <\#eta> 
         | 
| 71 | 
             
            ```
         | 
| 72 |  | 
| 73 | 
            +
            # Inpainting
         | 
|  | |
| 74 | 
             
            
         | 
| 75 |  | 
| 76 | 
            +
            Download the pre-trained weights
         | 
| 77 | 
            +
            ```
         | 
| 78 | 
            +
            wget -O models/ldm/inpainting_big/last.ckpt https://heibox.uni-heidelberg.de/f/4d9ac7ea40c64582b7c9/?dl=1
         | 
| 79 | 
            +
            ```
         | 
| 80 | 
            +
             | 
| 81 | 
            +
            and sample with
         | 
| 82 | 
            +
            ```
         | 
| 83 | 
            +
            python scripts/inpaint.py --indir data/inpainting_examples/ --outdir outputs/inpainting_results
         | 
| 84 | 
            +
            ```
         | 
| 85 | 
            +
            `indir` should contain images `*.png` and masks `<image_fname>_mask.png` like
         | 
| 86 | 
            +
            the examples provided in `data/inpainting_examples`.
         | 
| 87 | 
            +
             | 
| 88 | 
            +
            ## Coming Soon...
         | 
| 89 | 
            +
             | 
| 90 | 
             
            * Code for training LDMs and the corresponding compression models.
         | 
| 91 | 
             
            * Inference scripts for conditional LDMs for various conditioning modalities.
         | 
| 92 | 
             
            * In the meantime, you can play with our colab notebook https://colab.research.google.com/drive/1xqzUi2iXQXDqXBHQGP9Mqt2YrYW6cx-J?usp=sharing
         | 
    	
        scripts/download_models.sh
    CHANGED
    
    | @@ -8,7 +8,7 @@ wget -O models/ldm/cin256/model.zip https://ommer-lab.com/files/latent-diffusion | |
| 8 | 
             
            wget -O models/ldm/semantic_synthesis512/model.zip https://ommer-lab.com/files/latent-diffusion/semantic_synthesis.zip
         | 
| 9 | 
             
            wget -O models/ldm/bsr_sr/model.zip https://ommer-lab.com/files/latent-diffusion/sr_bsr.zip
         | 
| 10 | 
             
            wget -O models/ldm/layout2img-openimages256/model.zip https://ommer-lab.com/files/latent-diffusion/layout2img_model.zip
         | 
| 11 | 
            -
            wget -O models/ldm/inpainting_big/ | 
| 12 |  | 
| 13 |  | 
| 14 |  | 
| @@ -39,7 +39,4 @@ unzip -o model.zip | |
| 39 | 
             
            cd ../layout2img-openimages256
         | 
| 40 | 
             
            unzip -o model.zip
         | 
| 41 |  | 
| 42 | 
            -
            cd  | 
| 43 | 
            -
            unzip -o model.zip
         | 
| 44 | 
            -
             | 
| 45 | 
            -
            cd ../..
         | 
|  | |
| 8 | 
             
            wget -O models/ldm/semantic_synthesis512/model.zip https://ommer-lab.com/files/latent-diffusion/semantic_synthesis.zip
         | 
| 9 | 
             
            wget -O models/ldm/bsr_sr/model.zip https://ommer-lab.com/files/latent-diffusion/sr_bsr.zip
         | 
| 10 | 
             
            wget -O models/ldm/layout2img-openimages256/model.zip https://ommer-lab.com/files/latent-diffusion/layout2img_model.zip
         | 
| 11 | 
            +
            wget -O models/ldm/inpainting_big/last.ckpt https://heibox.uni-heidelberg.de/f/4d9ac7ea40c64582b7c9/?dl=1
         | 
| 12 |  | 
| 13 |  | 
| 14 |  | 
|  | |
| 39 | 
             
            cd ../layout2img-openimages256
         | 
| 40 | 
             
            unzip -o model.zip
         | 
| 41 |  | 
| 42 | 
            +
            cd ../..
         | 
|  | |
|  | |
|  | 
