Di Liu

diliu0349's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted an article 2 months ago

view article

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By •

Jul 11, 2024

• 12

upvoted a paper 2 months ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published Sep 16, 2024 • 41