Blog Tags GitHub

flashattention

3 posts tagged with "flashattention"

Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

训练无关动态稀疏注意力：通过查询依赖高斯校准阈值、在线 Softmax 内联稀疏化和零阶泰勒代理分数复用，在不修改权重的情况下为视频生成 DiT 提供 2.0×–5.1× 端到端加速

sparse-attention video-generation diffusion-transformer training-free online-softmax flashattention gpu-kernel inference-acceleration block-sparse approximation-correction

PRR: Predict, Reuse, and Repair

Accelerating Dynamic Sparse Attention for Long-Context LLM Decoding

long-context-llm inference-acceleration sparse-attention speculative-computation cuda-kernel flashattention kv-cache

PRR: Predict, Reuse, and Repair

Accelerating Dynamic Sparse Attention for Long-Context LLM Decoding via Speculative Execution and Incremental Repair

long-context-llm sparse-attention kv-cache speculative-decoding cuda-kernel flashattention inference-acceleration dynamic-sparse-attention