// Train & fine-tune
OpenRLHFv0.11.2
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Open source Maintained For developers
IN ONE PARAGRAPH
OpenRLHF is an Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL).
Good for: Developers and teams who want to train & fine-tune.
01How to start
- 1Read the official quick-start (link above).
- 2Install or sign up as the official guide describes.
- 3Try it on a small example before wiring it into a project.
02Alternatives & comparison
Compare side by side → LlamaFactory Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) ★ 76k Megatron-LM Ongoing research training transformer models at scale ★ 18k unsloth Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. ★ 78k peft 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. ★ 22k litgpt 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. ★ 14k