inference-acceleration

6 posts tagged with "inference-acceleration"

August 9, 2026

Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

训练无关动态稀疏注意力：通过查询依赖高斯校准阈值、在线 Softmax 内联稀疏化和零阶泰勒代理分数复用，在不修改权重的情况下为视频生成 DiT 提供 2.0×–5.1× 端到端加速

sparse-attention video-generation diffusion-transformer training-free online-softmax flashattention gpu-kernel inference-acceleration block-sparse approximation-correction

July 23, 2026

FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models

Training-free parallel decoding framework for block-wise diffusion LLMs using gated wavefront execution and heterogeneous wavefront packing

diffusion-llm inference-acceleration wavefront-parallel kv-cache self-correcting training-free block-wise-diffusion dlnference

July 23, 2026

PRR: Predict, Reuse, and Repair

Accelerating Dynamic Sparse Attention for Long-Context LLM Decoding

long-context-llm inference-acceleration sparse-attention speculative-computation cuda-kernel flashattention kv-cache

July 23, 2026

PRR: Predict, Reuse, and Repair

Accelerating Dynamic Sparse Attention for Long-Context LLM Decoding via Speculative Execution and Incremental Repair

long-context-llm sparse-attention kv-cache speculative-decoding cuda-kernel flashattention inference-acceleration dynamic-sparse-attention

July 23, 2026

Sol Video Inference Engine

Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation

video-diffusion inference-acceleration agent-framework quantization sparse-attention kernel-fusion token-pruning cache

July 23, 2026

SpecLA: Efficient Speculative Decoding for Linear-Attention Models

A speculative decoding runtime for stateful linear-attention models that verifies chains and trees with topology-aware kernels, stores compact factors to recover accepted states, and uses confidence pruning plus a target-aligned EAGLE-style drafter.

speculative-decoding linear-attention gdn recurrent-state gpu-kernels inference-acceleration triton