3.14k
The Ultra-Scale Playbook
🌌
The ultimate guide to training LLM on large GPU Clusters
Erik Kaunismäki
erikkaum
AI & ML interests
None yet
Recent Activity
new activity
19 days ago
openai/whisper-large-v3-turbo:WTF is going on?
commented on
their
article
about 1 month ago
Test-Driving the LLMD Inference Engine by ZML 🚀
posted
an
update
about 2 months ago
ZML just released a technical preview of their new Inference Engine: LLMD.
- Just 2.4GB container, which means fast startup times and efficient autoscaling
- Cross-Platform GPU Support: works on both NVIDIA and AMD GPUs.
- written in Zig
I just tried it out and deployed it on Hugging Face Inference Endpoints and wrote a quick guide 👇 You can try it in like 5 minutes!
https://huggingface.co/blog/erikkaum/test-driving-llmd-inference-engine
Organizations
liked
a
Space
6 months ago
liked
a
Space
9 months ago