arXiv 2610.05966 · cs.CL · 2026-10-05
HuatuoGPT-3: RL-Only Domain Adaptation from Base Models
Junying Chen, Xinyuan Xie, Ziniu Li, Wenyuan Gu, Jianquan Li, Xiang Wan, Guangjun Yu, Ruoyu Sun 等 10 人
Chinese University of Hong Kong, Shenzhen
在最新榜 #263 本站收录于 2026-10-26
一句话要点
HuatuoGPT-3 探索只用强化学习做领域适配：指出混合策略 RL 的「梯度饥饿」和「教师分布锚定」两种失败模式，提出单阶段策略优化 OnePO，把教师输出当作临时引导。
HuatuoGPT-3 explores RL-only domain adaptation from base models, identifies two failure modes of mixed-policy RL (Gradient Starvation and Teacher-Distribution Anchoring), and proposes One-stage Policy Optimization (OnePO), which treats teacher outputs as transient guidance.
阅读 arXiv 原文 PDF Hugging Face 讨论 代码仓库
主题与学科
同主题：大语言模型
- Jeva: System One Models from First Principles ▲371
- Post-Training Leaves Behavioral Shadows on Unrelated Decisions ▲273
- OmniEdu: Open Foundation Models for Learning and Teaching ▲240
- PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking ▲163
- MemT-1.0: Towards Memory-Native Evolution ▲143
同主题：强化学习
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents 2026-09-30 · ▲642
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation 2026-09-29 · ▲511
- Player-1: Learning to Play from Synthetic Experience 2026-10-14 · ▲347
- Scaling Properties of Same-Family On-Policy Distillation 2026-09-26 · ▲327
- DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models 2026-10-08 · ▲325
数据说明
元数据来自 arXiv API（已核实）；点赞来自 Hugging Face 每日论文；引用来自 Semantic Scholar。最近刷新 2026-10-26。
要点由本站根据摘要自写，不转载摘要原文，请阅读原文。