June 24, 2026 Efficient Memory Management for Large Language Model Serving with PagedAttention 通过 PagedAttention 算法实现高效 KV cache 内存管理,构建 vLLM 高吞吐量 LLM 服务系统 llm-serving memory-management paged-attention kv-cache system-design production-system vllm
June 24, 2026 Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving 面向 Kimi 的 KVCache 中心化解耦架构,通过分离 Prefill 和 Decode 集群实现 525% 吞吐量提升 llm-serving disaggregated-serving kv-cache system-design production-system moonshot-ai