SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations
Paper
โข
2512.14080
โข
Published
โข
5
AI & ML interests
None defined yet.
eliebakย
submitted
a
paper
to Daily Papers
16 days ago
Post
7493
deepseek-ai/DeepSeek-OCR is out! ๐ฅ my take โคต๏ธ
> pretty insane it can parse and re-render charts in HTML
> it uses CLIP and SAM features concatenated, so better grounding
> very efficient per vision tokens/performance ratio
> covers 100 languages
> pretty insane it can parse and re-render charts in HTML
> it uses CLIP and SAM features concatenated, so better grounding
> very efficient per vision tokens/performance ratio
> covers 100 languages
- 4 replies
jfchiย
authored
6
papers
3 months ago
FFB: A Fair Fairness Benchmark for In-Processing Group Fairness Methods
Paper
โข
2306.09468
โข
Published
โข
1
The Llama 3 Herd of Models
Paper
โข
2407.21783
โข
Published
โข
117
Persistent Pre-Training Poisoning of LLMs
Paper
โข
2410.13722
โข
Published
Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks
Paper
โข
2410.18210
โข
Published
Large Reasoning Models Learn Better Alignment from Flawed Thinking
Paper
โข
2510.00938
โข
Published
โข
58
Shape it Up! Restoring LLM Safety during Finetuning
Paper
โข
2505.17196
โข
Published
โข
1
Post
6809
large AI labs open-sourced a ton of models last week ๐ฅ
here's few picks, find even more here merve/sep-16-releases-68d13ea4c547f02f95842f05 ๐ค
> IBM released a new Docling model with 258M params based on Granite (A2.0) ๐ ibm-granite/granite-docling-258M
> Xiaomi released 7B audio LM with base and instruct variants (MIT) XiaomiMiMo/mimo-audio-68cc7202692c27dae881cce0
> DecartAI released Lucy Edit, open Nano Banana ๐ (NC) decart-ai/Lucy-Edit-Dev
> OpenGVLab released a family of agentic computer use models (3B/7B/32B) with the dataset ๐ป OpenGVLab/scalecua-68c912cf56f7ff4c8e034003
> Meituan Longcat released thinking version of LongCat-Flash ๐ญ meituan-longcat/LongCat-Flash-Thinking
here's few picks, find even more here merve/sep-16-releases-68d13ea4c547f02f95842f05 ๐ค
> IBM released a new Docling model with 258M params based on Granite (A2.0) ๐ ibm-granite/granite-docling-258M
> Xiaomi released 7B audio LM with base and instruct variants (MIT) XiaomiMiMo/mimo-audio-68cc7202692c27dae881cce0
> DecartAI released Lucy Edit, open Nano Banana ๐ (NC) decart-ai/Lucy-Edit-Dev
> OpenGVLab released a family of agentic computer use models (3B/7B/32B) with the dataset ๐ป OpenGVLab/scalecua-68c912cf56f7ff4c8e034003
> Meituan Longcat released thinking version of LongCat-Flash ๐ญ meituan-longcat/LongCat-Flash-Thinking
- 2 replies
Post
3391
IBM just released small swiss army knife for the document models: granite-docling-258M on Hugging Face ๐ฅ
> not only a document converter but also can do document question answering, understand multiple languages ๐คฏ
> best part: released with Apache 2.0 license ๐ use it with your commercial projects!
> it supports transformers, vLLM and MLX from the get-go! ๐ค
> built on SigLIP2 & granite-165M
model: ibm-granite/granite-docling-258M
demo: ibm-granite/granite-docling-258m-demo ๐
> not only a document converter but also can do document question answering, understand multiple languages ๐คฏ
> best part: released with Apache 2.0 license ๐ use it with your commercial projects!
> it supports transformers, vLLM and MLX from the get-go! ๐ค
> built on SigLIP2 & granite-165M
model: ibm-granite/granite-docling-258M
demo: ibm-granite/granite-docling-258m-demo ๐
Post
1199
a ton of image/video generation models and LLMs from big labs ๐ฅ
> Meta released facebook/mobilellm-r1-68c4597b104fac45f28f448e, smol LLMs for on-device use ๐ฌ
> Tencent released tencent/SRPO, high res image generation model and tencent/POINTS-Reader, cutting edge OCR ๐
> ByteDance released bytedance-research/HuMo, video generation from any input โฏ๏ธ
find more models, datasets, demos here merve/sep-11-releases-68c7dbfa26bea8cd921fa0ac
> Meta released facebook/mobilellm-r1-68c4597b104fac45f28f448e, smol LLMs for on-device use ๐ฌ
> Tencent released tencent/SRPO, high res image generation model and tencent/POINTS-Reader, cutting edge OCR ๐
> ByteDance released bytedance-research/HuMo, video generation from any input โฏ๏ธ
find more models, datasets, demos here merve/sep-11-releases-68c7dbfa26bea8cd921fa0ac
Post
1006
fan-favorite vision LM Florence-2 is now officially supported in transformers ๐ค
find all the models in
florence-community
org ๐ซก
find all the models in
Post
1824
past week was great for open LLMs ๐ฅ
merve/sep-1-releases-68bede0e729c12597eefd050
> Google released google/embeddinggemma-300m, new embedding model with 300M params
> new update to Kimi-K2 just landed moonshotai/Kimi-K2-Instruct-0905 ๐
> OpenBMB released a new version to MiniCPM with 8B params openbmb/MiniCPM4.1-8B
also soooo many Qwen-Image & Kontext LoRAs dropped!
> Google released google/embeddinggemma-300m, new embedding model with 300M params
> new update to Kimi-K2 just landed moonshotai/Kimi-K2-Instruct-0905 ๐
> OpenBMB released a new version to MiniCPM with 8B params openbmb/MiniCPM4.1-8B
also soooo many Qwen-Image & Kontext LoRAs dropped!
Post
3708
upgrade your transformers ๐ฅ
it comes with insanely capable models like merve/sam2-66ac9deac6fca3bc5482fe30, microsoft/kosmos-2.5, and more ๐ซก
I built a notebook you can run with free Colab T4 to walk through the API for new models ๐๐ปโโ๏ธ merve/smol-vision
fine-tuning will follow-up soon!
it comes with insanely capable models like merve/sam2-66ac9deac6fca3bc5482fe30, microsoft/kosmos-2.5, and more ๐ซก
I built a notebook you can run with free Colab T4 to walk through the API for new models ๐๐ปโโ๏ธ merve/smol-vision
fine-tuning will follow-up soon!
Post
3874
Super excited to announce that our research team at Hugging Face will be doing an AMA on reddit r/LocalLLaMA.
Come ask any questions to the team behind SmolLM, FineWeb and more! And who knows, maybe thereโll be a shiny new release to talk about?
Thursday 4th September, 8AM-11AM PST ๐ค
science
Come ask any questions to the team behind SmolLM, FineWeb and more! And who knows, maybe thereโll be a shiny new release to talk about?
Thursday 4th September, 8AM-11AM PST ๐ค
Post
6287
large AI labs have dropped so many open models last week ๐ฅ don't miss out on them
โ Apple released on-device vision LMs apple/fastvlm-68ac97b9cd5cacefdd04872e & apple/mobileclip2-68ac947dcb035c54bcd20c47
โ OpenGVLab released InternVL3.5, 32 new vision LMs with one based on gpt-oss! (OS) OpenGVLab/internvl35-68ac87bd52ebe953485927fb
โ MSFT released a killer small TTS model (OS) microsoft/VibeVoice-1.5B
find more herehttps://huggingface.co/collections/merve/august-29-releases-68b5a3754cfb8abf59e2b486
โ Apple released on-device vision LMs apple/fastvlm-68ac97b9cd5cacefdd04872e & apple/mobileclip2-68ac947dcb035c54bcd20c47
โ OpenGVLab released InternVL3.5, 32 new vision LMs with one based on gpt-oss! (OS) OpenGVLab/internvl35-68ac87bd52ebe953485927fb
โ MSFT released a killer small TTS model (OS) microsoft/VibeVoice-1.5B
find more herehttps://huggingface.co/collections/merve/august-29-releases-68b5a3754cfb8abf59e2b486
- 1 reply
ankits0052ย
authored
a
paper
4 months ago
Post
6072
first vision language model built off
openai/gpt-oss-20b just dropped! ๐ฅ
InternVL3.5 comes with 32 models ๐คฏ pre-trained, fine-tuned, aligned in various sizes OpenGVLab/internvl35-68ac87bd52ebe953485927fb
comes with gpt-oss or Qwen3 for LLM part โคต๏ธ
InternVL3.5 comes with 32 models ๐คฏ pre-trained, fine-tuned, aligned in various sizes OpenGVLab/internvl35-68ac87bd52ebe953485927fb
comes with gpt-oss or Qwen3 for LLM part โคต๏ธ
- 1 reply
Post
712
Motif 2.6B tech report is pretty insane, first time i see a model with differential attention and polynorm trained at scale!
> It's trained on 2.5T of token, with a "data mixture schedule" to continuously adjust the mixture over training.
> They use WSD with a "Simple moving average" averaging the last 6 ckpt every 8B token.
> They trained on Finemath, Fineweb2, DCLM, TxT360.
> Lot of details in the finetuning data they used, for instance they used EvolKit and did some "dataset fusion" to have more compressed knowledge into the data.
> They mention they also tried Normalized GPT, QK-Norm and Cross Layer Attention.
Motif-Technologies/Motif-2.6B
> It's trained on 2.5T of token, with a "data mixture schedule" to continuously adjust the mixture over training.
> They use WSD with a "Simple moving average" averaging the last 6 ckpt every 8B token.
> They trained on Finemath, Fineweb2, DCLM, TxT360.
> Lot of details in the finetuning data they used, for instance they used EvolKit and did some "dataset fusion" to have more compressed knowledge into the data.
> They mention they also tried Normalized GPT, QK-Norm and Cross Layer Attention.
Motif-Technologies/Motif-2.6B
Post
3321
GPT-4.1-mini level model right in your iPhone ๐คฏ
openbmb/MiniCPM-V-4 is only 4B while surpassing GPT-4.1-mini in vision benchmarks ๐ฅ
allows commercial use as well!
openbmb/MiniCPM-V-4 is only 4B while surpassing GPT-4.1-mini in vision benchmarks ๐ฅ
allows commercial use as well!