ll-re-hf 's activity
All
Models
Datasets
Spaces
Papers
Collections
Community
Posts
Articles
view post
It's now posible to do end-2-end ML without leaving the
@huggingface Hub, by combining TRL + HF jobs + Trackio!! 🐡We just released a full guide explaining the process. Go check it out! 📖 Guide: https://huggingface.co/docs/trl/main/en/jobs_training 💡 Reminder: HF Jobs is only available for Pro, Team, or Enterprise plans. Yet another reason to upgrade
See translation
view post
New Zero-Shot Object Detectors in transformers! 🥽 We’ve added LLMDet and MM GroundingDINO, plus a demo Space to compare them with others 🖼️ Play with it: ariG23498/zero-shot-od
See translation
view post
Latest TRL release brings major upgrades for multimodal alignment! We dive into 3 new techniques to improve VLM post-training in our new blog: 🌋 GRPO 🎞️ GSPO 🐙 MPO ➕ vLLM integration for online training w/ transformers backend\ 🐡 Blog: https://huggingface.co/blog/trl-vlm-alignment
See translation
view post
GPT-4.1-mini level model right in your iPhone 🤯 openbmb/MiniCPM-V-4 is only 4B while surpassing GPT-4.1-mini in vision benchmarks 🔥 allows commercial use as well!
See translation
view post
we're all sleeping on this OCR model rednote-hilab/dots.ocr 🔥 dots.ocr is a new 3B model with sota performance, support for 100 languages & allowing commercial use! 🤯 single e2e model to extract image, convert tables, formula, and more into markdown 📝 try it MohamedRashad/Dots-OCR See translation
view post
Want to learn how to align a Vision Language Model (VLM) for reasoning using GRPO and TRL? 🌋 🧑🍳 We've got you covered!! NEW multimodal post training recipe to align a VLM using TRL in
@HuggingFace 's Cookbook. Go to the recipe 👉https://huggingface.co/learn/cookbook/fine_tuning_vlm_grpo_trl Powered by the latest TRL v0.20 release, this recipe shows how to teach Qwen2.5-VL-3B-Instruct to reason over images 🌋
See translation
view post
Did you miss this? 👓 🧙♂️vLLM + transformers integration just got upgraded with direct VLM support. Select a VLM + model_impl=transformers and play via vLLM!
See translation
view post
We just released TRL v0.20 with major multimodal upgrades! 👁️ VLM support for GRPO (highly requested by the community!) 🎞️ New GSPO trainer (from
@Qwen , released last week, VLM-ready) 🐙 New MPO trainer (multimodal by design, as in the paper) 📝 Full release notes here: https://github.com/huggingface/trl/releases/tag/v0.20.0
See translation
view post
🤯 241B VLM with apache-2.0 license internlm/Intern-S1 internlm released Intern-S1: multimodal reasoning model based on 235B MoE Qwen3 and 6B InternViT 😍 benchmarks look great (👑 best model ✅ best open model)
See translation
view post
Yet Another New Multimodal Fine-Tuning Recipe 🥧 🧑🍳 In this
@HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl. 💡 This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer! We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs). Check it out! ➡️ https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo
See translation
2 replies ·
Reply
