Blog Tags GitHub

cxl

5 posts tagged with "cxl"

August 10, 2026

Topology-Aware Data Movement for Disaggregated GPU Inference

TopKV — 拓扑感知的KV缓存传输编排器，利用GPU互连层次结构将KV缓存传输延迟降低3-18倍

disaggregated-inference kv-cache gpu-interconnect nvlink cxl moe system-optimization

Scalable Processing-Near-Memory for 1M-Token LLM Inference

CXL-Enabled KV-Cache Management Beyond GPU Limits

llm-inference kv-cache processing-near-memory cxl memory-management hardware-acceleration long-context

TraCT: Disaggregated LLM Serving with CXL Shared Memory KV Cache at Rack-Scale

提出基于 CXL 共享内存的机架级 KV Cache 系统 TraCT，消除 RDMA 网络跳数，实现 GPU-CXL 直接 DMA 传输，TTFT 降低 9.8x，吞吐量提升 1.6x

llm-serving disaggregated-inference kv-cache cxl shared-memory distributed-inference system-design

HybridGen: Efficient LLM Generative Inference via CPU-GPU Hybrid Computing

提出 CPU-GPU 混合注意力框架 HybridGen，通过注意力 logit 并行化、反馈调度器和语义感知 KV Cache 映射，实现长上下文 LLM 推理的高效协同计算

llm-inference kv-cache cpu-gpu-hybrid memory-management cxl attention-parallelism long-context

Predictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU Inference

通过架构感知大小调整、六层内存层次和贝叶斯重用预测，实现 KV Cache 的预测性多层内存管理

kv-cache memory-management gpu-inference multi-tier-memory bayesian-prediction attention-architecture mla cxl distributed-inference