ESC

Type to search articles...

No articles found.

↑ ↓ Navigate ↵ Open
Esc Close
Blog Tags GitHub
All tags

LLM Architecture

1 post tagged with "LLM Architecture"

January 12, 2026

Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

DeepSeek提出的Engram模块,将条件记忆作为与MoE条件计算互补的新稀疏轴,通过O(1) N-gram查找实现静态知识检索,揭示U型缩放定律

LLM Architecture Conditional Memory Mixture-of-Experts N-gram Embedding Scaling Law Sparse Models Knowledge Retrieval DeepSeek

Navigation

  • Work

Resources

  • Lexington Themes.

Socials

  • @Mike_Andreuzza
© 2025 MicroStudio. All rights reserved.

MicroStudio is not affiliated with Stripe, Breeew, Astro, or Tailwind Labs, nor is it endorsed or sponsored by them.