ESC

Type to search articles...

No articles found.

↑ ↓ Navigate ↵ Open
Esc Close
Blog Tags GitHub
All tags

batching

1 post tagged with "batching"

August 5, 2026

Efficiency and Cost Alignment in Batched LLM Serving via Resource-Fair Scheduling

Resource-Fair Scheduling 将 LLM 推理中的 batching 外部性形式化为资源公平问题,提出 LJF 和 ISJL 两种公平调度算法,并建立利润分解理论将吞吐量与线性定价下的运营成本对齐

llm-inference scheduling batching resource-fairness kv-cache competitive-ratio cost-alignment profit-analysis

Navigation

  • Work

Resources

  • Lexington Themes.

Socials

  • @Mike_Andreuzza
© 2025 MicroStudio. All rights reserved.

MicroStudio is not affiliated with Stripe, Breeew, Astro, or Tailwind Labs, nor is it endorsed or sponsored by them.