view article Article Accelerating LLM Code Generation Through Mask Store Streamlining By vivien โข 21 days ago โข 1
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning Paper โข 2406.06469 โข Published Jun 10, 2024 โข 25 โข 2
view article Article Fast, High-Fidelity LLM Decoding with Regex Constraints By vivien โข Feb 23, 2024 โข 6
view article Article An Optimal Lossy Variant of Speculative Decoding By vivien โข Jun 12, 2024 โข 2