SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification
Paper
•
2305.09781
•
Published
•
4
CMU-Catalyst
university
AI & ML interests
None defined yet.