AdapMoE: Adaptive Sensitivity-based Expert Gating and Management for Efficient MoE Inference Paper • 2408.10284 • Published Aug 19, 2024 • 1
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference Paper • 2504.05897 • Published Apr 8 • 18
ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding Paper • 2402.13485 • Published Feb 21, 2024