Skip to content
English

Switch theme

Transformers & LLM Principles

Scaling Laws and Emergence

How loss falls with parameters, data and compute, and what Chinchilla changed.

Advanced 15 min For: Researchers / Developers ✎ In progress

✎ This lesson is still being written. Below is the planned outline; it is not indexed by search engines yet.

What this lesson will cover

  1. Kaplan et al. power laws
  2. Compute-optimal training (Chinchilla)
  3. Emergent abilities and the debate
  4. Test-time compute scaling

Related AI news

Links go to the original publishers.

Part of these paths

Data updated: Learn AI curriculum · Lesson news(UTC+8)