Scaled Prompt-Tuning for Few-Shot Natural Language Generation
Paper
•
2309.06759
•
Published
•
1
Haojin Yang
yanghaojin
AI & ML interests
None yet
Recent Activity
posted
an
update
about 22 hours ago
Our new blog post Smaller Models, Smarter Agents 🚀 https://huggingface.co/blog/yanghaojin/greenbit-3-bit-stronger-reasoning
DeepSeek’s R1-0528 proved that 8B can reason like 235B. Anthropic showed that multi-agent systems boost performance by 90%. The challenge? Both approaches burn massive compute and tokens.
💡 GreenBitAI cracked the code:
We launched the first 3-bit deployable reasoning model — DeepSeek-R1-0528-Qwen3-8B (3.2-bit).
✅ Runs complex multi-agent research tasks (e.g. Pop Mart market analysis)
✅ Executes flawlessly on an Apple M3 laptop in under 5 minutes
✅ 1351 tokens/s prefill, 105 tokens/s decode
✅ Near-FP16 reasoning quality with just 30–40% token usage
This is how extreme compression meets collaborative intelligence — making advanced reasoning practical on edge devices.
upvoted
an
article
4 days ago
4× Smaller, 2× Faster, 100% Smarts - GreenBitAI's 4-bit Models Redefine AI Efficiency
Organizations
authored
a
paper
almost 2 years ago