// ⚙ Fine-tuning & PEFT
Self-Instruct
The model generates its own instruction data for fine-tuning.
Self-Instruct 合成指令 2022 Foundational core
IN PLAIN WORDS
Starting from a few seed tasks, the model writes new instructions and answers, which are filtered and used for tuning. Stanford Alpaca used it cheaply, starting the synthetic-data era.
Used in: Alpaca, synthetic data pipelines
01Original paper
Self-Instruct: Aligning Language Models with Self-Generated Instructions
Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, et al. · 2022
arXiv ↗ ✓ Verified · arXiv API
02Where it sits
Learn the left column first; the right column builds on this one.
Learn first
Then you can learn
- Nothing in the atlas builds on it yet
Related:Knowledge DistillationSTaR (Self-Taught Reasoner)
Left: prerequisites · right: builds on this · dashed: related. Full map →
03Learning resources
Official docs, explainers, courses and reference code. All links checked.
Explainers
04Where the course teaches it
On learning paths:Post-training & Reasoning Models
For AI / data
- Verification: verified, checked 2026-10-21.
- JSON: /api/learn/algorithms.json (id:
self-instruct)