Overview
Connect embeddings, attention, transformers, and sampling to understand a small language model.
Building from First Principles
Building a Small Language Model
Training a small language model explains Transformer mechanics without proving that we understand the capabilities of modern LLMs.
