amazon-sagemaker/repository-metadata
Preview
โข
Updated
โข
92
โข
1
Amazon SageMaker
company
AI & ML interests
Assets for Amazon SageMaker
Recent Activity
View all activity
amazon-sagemaker's activity
florentgbelidjiย
updated
a
dataset
about 6 hours ago
Post
476
We published https://huggingface.co/blog/deepseek-r1-aws!
If you are using AWS, give a read. It is a running document to showcase how to deploy and fine-tune DeepSeek R1 models with Hugging Face on AWS.
We're working hard to enable all the scenarios, whether you want to deploy to Inference Endpoints, Sagemaker or EC2; with GPUs or with Trainium & Inferentia.
We have full support for the distilled models, DeepSeek-R1 support is coming soon!! I'll keep you posted.
Cheers
If you are using AWS, give a read. It is a running document to showcase how to deploy and fine-tune DeepSeek R1 models with Hugging Face on AWS.
We're working hard to enable all the scenarios, whether you want to deploy to Inference Endpoints, Sagemaker or EC2; with GPUs or with Trainium & Inferentia.
We have full support for the distilled models, DeepSeek-R1 support is coming soon!! I'll keep you posted.
Cheers
pagezyhfย
updated
a
dataset
about 9 hours ago
Update modal.json
#29 opened 1 day ago
by
pagezyhf
florentgbelidjiย
posted
an
update
13 days ago
Post
1404
๐ฃ๐น๐ฎ๐ป๐ป๐ถ๐ป๐ด ๐ฌ๐ผ๐๐ฟ ๐ก๐ฒ๐
๐ ๐ฆ๐ธ๐ถ ๐๐ฑ๐๐ฒ๐ป๐๐๐ฟ๐ฒ ๐๐๐๐ ๐๐ผ๐ ๐ฆ๐บ๐ฎ๐ฟ๐๐ฒ๐ฟ: ๐๐ป๐๐ฟ๐ผ๐ฑ๐๐ฐ๐ถ๐ป๐ด ๐๐น๐ฝ๐ถ๐ป๐ฒ ๐๐ด๐ฒ๐ป๐!๐๏ธโท๏ธ
With the big hype around AI agents these days, I couldnโt stop thinking about how AI agents could truly enhance real-world activities.
What sort of applications could we build with those AI agents: agentic RAG? self-correcting text-to-sql? Nah, boringโฆ
Passionate about outdoors, Iโve always dreamed of a tool that could simplify planning mountain trips while accounting for all potential risks. Thatโs why I built ๐๐น๐ฝ๐ถ๐ป๐ฒ ๐๐ด๐ฒ๐ป๐, a smart assistant designed to help you plan safe and enjoyable itineraries in the French Alps and Pyrenees.
Built using Hugging Face's ๐๐บ๐ผ๐น๐ฎ๐ด๐ฒ๐ป๐๐ library, Alpine Agent combines the power of AI with trusted resources like ๐๐ฌ๐ช๐ต๐ฐ๐ถ๐ณ.๐ง๐ณ (https://skitour.fr/) and METEO FRANCE. Whether itโs suggesting a route with moderate difficulty or analyzing avalanche risks and weather conditions, this agent dynamically integrates data to deliver personalized recommendations.
In my latest blog post, I share how I developed this projectโfrom defining tools and integrating APIs to selecting the best LLMs like ๐๐ธ๐ฆ๐ฏ2.5-๐๐ฐ๐ฅ๐ฆ๐ณ-32๐-๐๐ฏ๐ด๐ต๐ณ๐ถ๐ค๐ต, ๐๐ญ๐ข๐ฎ๐ข-3.3-70๐-๐๐ฏ๐ด๐ต๐ณ๐ถ๐ค๐ต, or ๐๐๐-4.
โท๏ธ Curious how AI can enhance adventure planning?โจTry the app and share your thoughts: florentgbelidji/alpine-agent
๐ Want to build your own agents? Whether for cooking, sports training, or other passions, the possibilities are endless. Check out the blog post to learn more: https://huggingface.co/blog/florentgbelidji/alpine-agent
Many thanks to @m-ric for helping on building this tool with smolagents!
With the big hype around AI agents these days, I couldnโt stop thinking about how AI agents could truly enhance real-world activities.
What sort of applications could we build with those AI agents: agentic RAG? self-correcting text-to-sql? Nah, boringโฆ
Passionate about outdoors, Iโve always dreamed of a tool that could simplify planning mountain trips while accounting for all potential risks. Thatโs why I built ๐๐น๐ฝ๐ถ๐ป๐ฒ ๐๐ด๐ฒ๐ป๐, a smart assistant designed to help you plan safe and enjoyable itineraries in the French Alps and Pyrenees.
Built using Hugging Face's ๐๐บ๐ผ๐น๐ฎ๐ด๐ฒ๐ป๐๐ library, Alpine Agent combines the power of AI with trusted resources like ๐๐ฌ๐ช๐ต๐ฐ๐ถ๐ณ.๐ง๐ณ (https://skitour.fr/) and METEO FRANCE. Whether itโs suggesting a route with moderate difficulty or analyzing avalanche risks and weather conditions, this agent dynamically integrates data to deliver personalized recommendations.
In my latest blog post, I share how I developed this projectโfrom defining tools and integrating APIs to selecting the best LLMs like ๐๐ธ๐ฆ๐ฏ2.5-๐๐ฐ๐ฅ๐ฆ๐ณ-32๐-๐๐ฏ๐ด๐ต๐ณ๐ถ๐ค๐ต, ๐๐ญ๐ข๐ฎ๐ข-3.3-70๐-๐๐ฏ๐ด๐ต๐ณ๐ถ๐ค๐ต, or ๐๐๐-4.
โท๏ธ Curious how AI can enhance adventure planning?โจTry the app and share your thoughts: florentgbelidji/alpine-agent
๐ Want to build your own agents? Whether for cooking, sports training, or other passions, the possibilities are endless. Check out the blog post to learn more: https://huggingface.co/blog/florentgbelidji/alpine-agent
Many thanks to @m-ric for helping on building this tool with smolagents!
- 1 reply
Post
412
Learn how to deploy multiple LoRA adapters on Vertex AI with this blogpost, using Hugging Face Deep Learning Containers on GCP.
https://medium.com/google-cloud/open-models-on-vertex-ai-with-hugging-face-serving-multiple-lora-adapters-on-vertex-ai-e3ceae7b717c
https://medium.com/google-cloud/open-models-on-vertex-ai-with-hugging-face-serving-multiple-lora-adapters-on-vertex-ai-e3ceae7b717c
jeffboudierย
posted
an
update
24 days ago
Post
571
NVIDIA just announced the Cosmos World Foundation Models, available on the Hub:
nvidia/cosmos-6751e884dc10e013a0a0d8e6
Cosmos is a family of pre-trained models purpose-built for generating physics-aware videos and world states to advance physical AI development.
The release includes Tokenizers nvidia/cosmos-tokenizer-672b93023add81b66a8ff8e6
Learn more in this great community article by @mingyuliutw and @PranjaliJoshi https://huggingface.co/blog/mingyuliutw/nvidia-cosmos
Cosmos is a family of pre-trained models purpose-built for generating physics-aware videos and world states to advance physical AI development.
The release includes Tokenizers nvidia/cosmos-tokenizer-672b93023add81b66a8ff8e6
Learn more in this great community article by @mingyuliutw and @PranjaliJoshi https://huggingface.co/blog/mingyuliutw/nvidia-cosmos
- 1 reply
philschmidย
updated
a
dataset
about 2 months ago
Post
367
Today you are able to access some of the most famous models from the Hugging Face community in Amazon Bedrock ๐คฏ
Amazon Bedrock expands its model catalog with Bedrock Marketplace to hundreds of specialized models.
https://us-west-2.console.aws.amazon.com/bedrock/home?region=us-west-2#/model-catalog
Amazon Bedrock expands its model catalog with Bedrock Marketplace to hundreds of specialized models.
https://us-west-2.console.aws.amazon.com/bedrock/home?region=us-west-2#/model-catalog
Post
974
Itโs 2nd of December , hereโs your Cyber Monday present ๐ !
Weโre cutting our price down on Hugging Face Inference Endpoints and Spaces!
Our folks at Google Cloud are treating us with a 40% price cut on GCP Nvidia A100 GPUs for the next 3๏ธโฃ months. We have other reductions on all instances ranging from 20 to 50%.
Sounds like the time to give Inference Endpoints a try? Get started today and find in our documentation the full pricing details.
https://ui.endpoints.huggingface.co/
https://huggingface.co/pricing
Weโre cutting our price down on Hugging Face Inference Endpoints and Spaces!
Our folks at Google Cloud are treating us with a 40% price cut on GCP Nvidia A100 GPUs for the next 3๏ธโฃ months. We have other reductions on all instances ranging from 20 to 50%.
Sounds like the time to give Inference Endpoints a try? Get started today and find in our documentation the full pricing details.
https://ui.endpoints.huggingface.co/
https://huggingface.co/pricing
Post
304
Hello Hugging Face Community,
if you use Google Kubernetes Engine to host you ML workloads, I think this series of videos is a great way to kickstart your journey of deploying LLMs, in less than 10 minutes! Thank you @wietse-venema-demo !
To watch in this order:
1. Learn what are Hugging Face Deep Learning Containers
https://youtu.be/aWMp_hUUa0c?si=t-LPRkRNfD3DDNfr
2. Learn how to deploy a LLM with our Deep Learning Container using Text Generation Inference
https://youtu.be/Q3oyTOU1TMc?si=V6Dv-U1jt1SR97fj
3. Learn how to scale your inference endpoint based on traffic
https://youtu.be/QjLZ5eteDds?si=nDIAirh1r6h2dQMD
If you want more of these small tutorials and have any theme in mind, let me know!
if you use Google Kubernetes Engine to host you ML workloads, I think this series of videos is a great way to kickstart your journey of deploying LLMs, in less than 10 minutes! Thank you @wietse-venema-demo !
To watch in this order:
1. Learn what are Hugging Face Deep Learning Containers
https://youtu.be/aWMp_hUUa0c?si=t-LPRkRNfD3DDNfr
2. Learn how to deploy a LLM with our Deep Learning Container using Text Generation Inference
https://youtu.be/Q3oyTOU1TMc?si=V6Dv-U1jt1SR97fj
3. Learn how to scale your inference endpoint based on traffic
https://youtu.be/QjLZ5eteDds?si=nDIAirh1r6h2dQMD
If you want more of these small tutorials and have any theme in mind, let me know!
jeffboudierย
posted
an
update
2 months ago
Post
1063
New - add your bluesky account to your HF profile:
https://huggingface.co/settings/profile
Is the grass greener, the sky bluer? Will try and figure it out at https://bsky.app/profile/jeffboudier.bsky.social
By the way, HF people starter pack https://bsky.app/starter-pack/huggingface.bsky.social/3laz5x7naiz22
https://huggingface.co/settings/profile
Is the grass greener, the sky bluer? Will try and figure it out at https://bsky.app/profile/jeffboudier.bsky.social
By the way, HF people starter pack https://bsky.app/starter-pack/huggingface.bsky.social/3laz5x7naiz22
Post
1363
Hello Hugging Face Community,
I'd like to share here a bit more about our Deep Learning Containers (DLCs) we built with Google Cloud, to transform the way you build AI with open models on this platform!
With pre-configured, optimized environments for PyTorch Training (GPU) and Inference (CPU/GPU), Text Generation Inference (GPU), and Text Embeddings Inference (CPU/GPU), the Hugging Face DLCs offer:
โก Optimized performance on Google Cloud's infrastructure, with TGI, TEI, and PyTorch acceleration.
๐ ๏ธ Hassle-free environment setup, no more dependency issues.
๐ Seamless updates to the latest stable versions.
๐ผ Streamlined workflow, reducing dev and maintenance overheads.
๐ Robust security features of Google Cloud.
โ๏ธ Fine-tuned for optimal performance, integrated with GKE and Vertex AI.
๐ฆ Community examples for easy experimentation and implementation.
๐ TPU support for PyTorch Training/Inference and Text Generation Inference is coming soon!
Find the documentation at https://huggingface.co/docs/google-cloud/en/index
If you need support, open a conversation on the forum: https://discuss.huggingface.co/c/google-cloud/69
I'd like to share here a bit more about our Deep Learning Containers (DLCs) we built with Google Cloud, to transform the way you build AI with open models on this platform!
With pre-configured, optimized environments for PyTorch Training (GPU) and Inference (CPU/GPU), Text Generation Inference (GPU), and Text Embeddings Inference (CPU/GPU), the Hugging Face DLCs offer:
โก Optimized performance on Google Cloud's infrastructure, with TGI, TEI, and PyTorch acceleration.
๐ ๏ธ Hassle-free environment setup, no more dependency issues.
๐ Seamless updates to the latest stable versions.
๐ผ Streamlined workflow, reducing dev and maintenance overheads.
๐ Robust security features of Google Cloud.
โ๏ธ Fine-tuned for optimal performance, integrated with GKE and Vertex AI.
๐ฆ Community examples for easy experimentation and implementation.
๐ TPU support for PyTorch Training/Inference and Text Generation Inference is coming soon!
Find the documentation at https://huggingface.co/docs/google-cloud/en/index
If you need support, open a conversation on the forum: https://discuss.huggingface.co/c/google-cloud/69
jeffboudierย
posted
an
update
4 months ago
Post
1093
This week in Inference Endpoints - thx
@erikkaum
for the update!
๐ https://huggingface.co/blog/erikkaum/endpoints-changelog
๐ https://huggingface.co/blog/erikkaum/endpoints-changelog
- 1 reply
jeffboudierย
posted
an
update
4 months ago
Post
457
Inference Endpoints got a bunch of cool updates yesterday, this is my top 3
jeffboudierย
posted
an
update
5 months ago
Post
4042
Pro Tip - if you're a Firefox user, you can set up Hugging Chat as integrated AI Assistant, with contextual links to summarize or simplify any text - handy!
In this short video I show how to set it up
In this short video I show how to set it up
- 3 replies
jeffboudierย
posted
an
update
9 months ago
Post
1697
TGI v2.0.2 is out!
- New models (idefics2, phi3)
- Cleaner VLM support in the openai layer
- Upgraded to pytorch 2.3.0
https://github.com/huggingface/text-generation-inference/releases/tag/v2.0.2
Kudos @Narsil @olivierdehaene @drbh and so many contributors!
- New models (idefics2, phi3)
- Cleaner VLM support in the openai layer
- Upgraded to pytorch 2.3.0
https://github.com/huggingface/text-generation-inference/releases/tag/v2.0.2
Kudos @Narsil @olivierdehaene @drbh and so many contributors!
jeffboudierย
posted
an
update
10 months ago
Post
1880
These 15 open models are available for serverless inference on Cloudflare Workers AI, powered by GPUs distributed in 150 datacenters globally - ๐
@rita3ko
@mchenco
@jtkipp
@nkothariCF
@philschmid
Cloudflare/hf-curated-models-available-on-workers-ai-66036e7ad5064318b3e45db6
Cloudflare/hf-curated-models-available-on-workers-ai-66036e7ad5064318b3e45db6
philschmidย
posted
an
update
10 months ago
Post
7296
New state-of-the-art open LLM! ๐ Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. ๐คฏ
TL;DR
๐งฎ 132B MoE with 16 experts with 4 active in generation
๐ช 32 000 context window
๐ Outperforms open LLMs on common benchmarks, including MMLU
๐ Up to 2x faster inference than Llama 2 70B
๐ป Trained on 12T tokens
๐ก Uses the GPT-4 tokenizer
๐ Custom License, commercially useable
Collection: databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://huggingface.co/spaces/databricks/dbrx-instruct
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! ๐ค
TL;DR
๐งฎ 132B MoE with 16 experts with 4 active in generation
๐ช 32 000 context window
๐ Outperforms open LLMs on common benchmarks, including MMLU
๐ Up to 2x faster inference than Llama 2 70B
๐ป Trained on 12T tokens
๐ก Uses the GPT-4 tokenizer
๐ Custom License, commercially useable
Collection: databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://huggingface.co/spaces/databricks/dbrx-instruct
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! ๐ค
-
- 4 replies
philschmidย
posted
an
update
about 1 year ago
Post
What's the best way to fine-tune open LLMs in 2024? Look no further! ๐ย I am excited to share โHow to Fine-Tune LLMs in 2024 with Hugging Faceโ using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. ๐
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with:
๐กDefine and understand use cases for fine-tuning
๐ง๐ปโ๐ปย Setup of the development environment
๐งฎย Create and prepare dataset (OpenAI format)
๐๏ธโโ๏ธย Fine-tune LLM using TRL and the SFTTrainer
๐ฅย Test and evaluate the LLM
๐ย Deploy for production with TGI
๐ย https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. ๐
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with:
๐กDefine and understand use cases for fine-tuning
๐ง๐ปโ๐ปย Setup of the development environment
๐งฎย Create and prepare dataset (OpenAI format)
๐๏ธโโ๏ธย Fine-tune LLM using TRL and the SFTTrainer
๐ฅย Test and evaluate the LLM
๐ย Deploy for production with TGI
๐ย https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. ๐
- 4 replies