// Training & fine-tuning
Train & fine-tune
Pre-training, fine-tuning, RL and distributed training tools.
54 tools54 open sourcechecked 2026-10-22Compare side by side →
How to choose · start with these three
54 / 54 items
PyTorch 2.14.1 ★ 105k Tensors and Dynamic neural networks in Python with strong GPU acceleration Open source SDK transformers v5.19.0 ★ 168k 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. Open source SDK unsloth v0.1.902-beta ★ 78k Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Open source SDK DataFlow ★ 8.3k Easy data preparation with LLM-based operators and pipelines. Open source Python tensorflow v2.21.0 ★ 201k An Open Source Machine Learning Framework for Everyone Open source SDK LlamaFactory v0.9.5 ★ 76k Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) Open source CLIAPI keras v3.12.4 ★ 64k Deep Learning for humans Open source SDK nanoGPT ★ 64k The simplest, fastest repository for training/finetuning medium-sized GPTs. Open source CLI nanochat 0.1.2 ★ 59k The best ChatGPT that $100 can buy. Open source CLI DeepSpeed v0.19.8 ★ 43k DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. Open source SDK jax jax-v0.11.2 ★ 36k Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more Open source SDK pytorch-lightning 2.6.6 ★ 31k Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes. Open source SDK label-studio 1.23.2 ★ 28k Label Studio is a multi-type data labeling and annotation tool with standardized output format Open source API open-r1 ★ 26k Fully open reproduction of DeepSeek-R1 Open source CLI verl v0.9.1 ★ 24k verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework Open source SDK datasets 5.1.0 ★ 22k 🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools Open source SDK peft v0.21.2 ★ 22k 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Open source SDK triton v3.8.0 ★ 20k Development repository for the Triton language and compiler Open source SDK trl v1.15.0 ★ 20k Train transformer language models with reinforcement learning. Open source SDKCLI Speech v3.0.0 ★ 19k A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech) Open source SDK Megatron-LM core_v0.19.2 ★ 18k Ongoing research training transformer models at scale Open source SDK ms-swift v4.5.3 ★ 16k Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025). Open source CLI dvc 3.67.1 ★ 16k 🦉 Data Versioning and ML Experiments Open source CLI open_clip v3.3.0 ★ 14k An open source implementation of CLIP. Open source SDK litgpt v0.5.13 ★ 14k 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. Open source CLI axolotl v0.20.0 ★ 13k Go ahead and axolotl questions Open source CLI cleanlab v2.9.0 ★ 12k Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels. Open source SDK tokenizers v0.23.3 ★ 11k 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production Open source SDK ART v0.5.19 ★ 11k Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more! Open source SDK OpenRLHF v0.11.2 ★ 10k An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL) Open source CLI accelerate v1.15.0 ★ 9.9k 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support Open source SDKCLI slime v0.4.0 ★ 8.7k slime is an LLM post-training framework for RL Scaling. Open source CLI bitsandbytes 0.50.2 ★ 8.5k Accessible large language models via k-bit quantization for PyTorch. Open source SDK gpt-neox v2.0 ★ 7.5k An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries Open source CLI flax v0.12.10 ★ 7.3k Flax is a neural network library for JAX that is designed for flexibility. Open source SDK Liger-Kernel v0.8.4 ★ 6.7k Efficient Triton Kernels for LLM Training Open source SDK torchtitan 5250 ★ 5.8k A PyTorch native platform for training generative AI models Open source CLI torchtune v0.6.1 ★ 5.8k PyTorch native post-training library Open source CLI alignment-handbook v0.3.0 ★ 5.7k Robust recipes to align language models with human and AI preferences Open source CLI composer v0.32.1 ★ 5.5k Supercharge Your Model Training Open source SDK xtuner v0.2.0 ★ 5.2k A Next-Generation Training Engine Built for Ultra-Large MoE Models Open source CLI argilla v2.8.0 ★ 5.1k Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets Open source API verifiers v0.3.1 ★ 4.7k Our library for RL environments + evals Open source SDK llm-foundry v0.22.0 ★ 4.5k LLM training code for Databricks foundation models Open source CLI huggingface_hub v2.2.0 ★ 4.0k The official CLI and Python client for the Hugging Face Hub. Open source SDKCLI safetensors v0.8.0 ★ 3.9k Simple, safe way to store and distribute tensors Open source SDK open-instruct runs%2Fmiles-qwen35-2b-rl ★ 3.9k AllenAI's post-training codebase Open source CLI distilabel 1.5.3 ★ 3.4k Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers. Open source SDK datatrove v0.10.1 ★ 3.4k Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks. Open source SDK nanotron v0.5 ★ 2.8k Minimalistic large language model 3D-parallelism training Open source SDK trainer v1.9.4 ★ 2.2k Distributed AI Model Training and LLM Fine-Tuning on Kubernetes Open source API prime-rl v0.9.0 ★ 2.2k Agentic RL Training at Scale Open source CLI Curator v1.4.0 ★ 1.8k Scalable data pre processing and curation toolkit for LLMs Open source SDK Olmo-core v3.0.0 ★ 1.7k PyTorch building blocks for the OLMo ecosystem Open source SDK
About this data
- Default order is “recommended”: editorial picks first, then by popularity; general-purpose developer software and archived projects are listed last.
- Data checked 2026-10-22. Official links only. JSON API