Hugging Face's logo
Sayak Paul's picture
359 26 174

Sayak Paul

sayakpaul
pprp's profile picture itsJB's profile picture mrtedu's profile picture
·
https://sayak.dev

AI & ML interests

Diffusion models, representation learning

Recent Activity

updated a dataset about 8 hours ago
sayakpaul/arxiv-new-datasets
posted an update about 10 hours ago
We have been cooking a couple of fine-tuning runs on CogVideoX with finetrainers, smol datasets, and LoRA to generate cool video effects like crushing, dissolving, etc. We are also releasing a LoRA extraction utility from a fully fine-tuned checkpoint. I know that kind of stuff has existed since eternity, but the quality on video models was nothing short of spectacular. Below are some links: * Models and datasets: https://huggingface.co/finetrainers * finetrainers: https://github.com/a-r-r-o-w/finetrainers * LoRA extraction: https://github.com/huggingface/diffusers/blob/main/scripts/extract_lora_from_model.py
published a dataset about 10 hours ago
sayakpaul/arxiv-new-datasets
View all activity

Articles

Organizations

Hugging Face's profile picture Deprem Private's profile picture 🧨Diffusers's profile picture TensorFlow TPU's profile picture Hugging Face Internal Testing Organization's profile picture ControlNet 1.1 Preview's profile picture Keras's profile picture All Things ViTs's profile picture Carted's profile picture Amazon ML's profile picture Instruction-tuned Diffusion Models's profile picture Probing ViTs's profile picture Evaluation on the Hub's profile picture JAX ♥️ Diffusers 🧨's profile picture (De)fusing's profile picture Huggingface Projects's profile picture Keras Dreambooth Event's profile picture Hugging Face OSS Metrics's profile picture Deploy HF TF ViTs's profile picture Parti Prompts Diffusers's profile picture Open Generative AI's profile picture UniDiffuser Testing's profile picture Kandinsky Community's profile picture Personal Coding Assistant's profile picture Diffusers Demo at ICCV 2023's profile picture diffusers-adapter's profile picture xin-ic sayak-hf's profile picture PixArt's profile picture huggingPartyParis's profile picture Latent Consistency's profile picture Spatial-T2I's profile picture ZeroGPU Explorers's profile picture SPRIGHT's profile picture PEFT's profile picture NYU VisionX's profile picture Data Is Better Together's profile picture Social Post Explorers's profile picture MaPO's profile picture diffusers-internal-dev's profile picture AuraFlow's profile picture Anonymous T2I Model's profile picture Optimum Internal Testing's profile picture ZP's profile picture Diffusion Guidance's profile picture syn-t2i's profile picture Vchitect-XL's profile picture Data Is Better Together Contributor's profile picture DDUF's profile picture HunyuanVideo Community's profile picture Video Intrinsics's profile picture Finetrainers's profile picture

Posts 20

view post
Post
587
We have been cooking a couple of fine-tuning runs on CogVideoX with finetrainers, smol datasets, and LoRA to generate cool video effects like crushing, dissolving, etc.

We are also releasing a LoRA extraction utility from a fully fine-tuned checkpoint. I know that kind of stuff has existed since eternity, but the quality on video models was nothing short of spectacular. Below are some links:

* Models and datasets: https://huggingface.co/finetrainers
* finetrainers: https://github.com/a-r-r-o-w/finetrainers
* LoRA extraction: https://github.com/huggingface/diffusers/blob/main/scripts/extract_lora_from_model.py
view post
Post
1777
We have authored a post to go over the state of video generation in the Diffusers ecosystem 🧨

We cover the models supported, the knobs of optims our users can fire, fine-tuning, and more 🔥

5-6GBs for HunyuanVideo, sky is the limit 🌌 🤗
https://huggingface.co/blog/video_gen
View all posts

Collections 2

Optimizing diffusion models
Provides a list of papers focusing on optimizing T2I diffusion models, targeting fewer timesteps, architecture optimization, and more.

Papers 13