Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// ⚙ Fine-tuning & PEFT

QLoRA

Fine-tunes LoRA on a 4-bit quantized base, fitting big models on one GPU.

2023 Intermediate core

Original paper ↓ What to learn first →

IN PLAIN WORDS

Introduces NF4, double quantization and paged optimizers, fitting 65B fine-tuning on one 48GB GPU with near-16-bit quality.

Used in: Hobbyist and small-team fine-tuning (Unsloth, Axolotl)

TIMELINE · prerequisites → this → what builds on it

2021 LoRA (Low-Ran…2022 LLM.int8() & …2023 QLoRA

01Original paper

QLoRA: Efficient Finetuning of Quantized LLMs

Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, et al. · 2023

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Learn first

QLoRA

Then you can learn

  • Nothing in the atlas builds on it yet

Related:GPTQ

LoRA (Low-Rank …LLM.int8() & Ou…GPTQ QLoRA

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

Reference code

Official docs

04Where the course teaches it

U50 Instruction Tuning & PEFT SFT, synthetic data, LoRA/QLoRA/DoRA, adapters and model merging. 10 h8 algorithms3 paperslesson ready

On learning paths:Post-training & Reasoning Models

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)