Yan Xu
  • Home
  • Blogs
  • About

On this page

  • Research notes on foundation models and intelligent systems
  • Blogs
  • Writing standard
Categories
All (3)
Diffusion (1)
DPO (1)
From Scratch (1)
GRPO (1)
LLM (1)
MoE (1)
Post-training (1)
Pre-training (1)
RLHF (1)
Systems (1)
Transformer (1)
VLM (1)

Yan Xu

Technical essays on foundation models, multimodal generation, post-training, and reinforcement learning.

Research notes on foundation models and intelligent systems

I study modern AI systems by tracing their history, deriving the mathematics, implementing the core algorithms, and testing them with controlled ablations.

The first series contains three long-form technical essays. Each essay is maintained as a living document rather than split into shallow daily posts.

Blogs

Writing standard

Every substantial article should contain four things: derivation, executable code, controlled ablation, and an honest failure analysis. Claims about closed models are labeled as official, third-party estimate, or unknown.

About Yan Xu · 18-day roadmap · Experiment notes

Inside a Modern LLM: From Tokens to KV Cache

LLM
Transformer
Systems
From Scratch

A bottom-up guide to decoder-only language models, with derivations, PyTorch implementations, ablations, and systems measurements.

Sep 12, 2026

How Foundation Models Are Built and Extended Beyond Text

Pre-training
MoE
VLM
Diffusion

Data, scaling, MoE, efficient adaptation, multimodality, diffusion, prompting, and evaluation.

Sep 19, 2026

Post-Training from First Principles: SFT, RLHF, DPO and GRPO

Post-training
RLHF
DPO
GRPO

A derivation-first, implementation-driven map of modern post-training.

Sep 26, 2026
No matching items

© 2026 Yan Xu

 

Built with Quarto · Hosted on GitHub Pages