Blog Tags GitHub

Scaling Law

2 posts tagged with "Scaling Law"

January 12, 2026

Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

DeepSeek提出的Engram模块，将条件记忆作为与MoE条件计算互补的新稀疏轴，通过O(1) N-gram查找实现静态知识检索，揭示U型缩放定律

LLM Architecture Conditional Memory Mixture-of-Experts N-gram Embedding Scaling Law Sparse Models Knowledge Retrieval DeepSeek

November 7, 2025

LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence

首个统一的大规模结构化数据模型(LDM)，通过上下文条件掩码建模实现分类、回归、缺失值填补、数据生成等多任务的单模型泛化

Tabular Foundation Model Large Structured-Data Model In-Context Learning Masked Modeling Structural Causal Models Scaling Law Classification Regression Missing Value Imputation Data Generation