// Train & fine-tune
bitsandbytes0.50.2
Accessible large language models via k-bit quantization for PyTorch.
Open source Maintained For developers
IN ONE PARAGRAPH
bitsandbytes is accessible large language models via k-bit quantization for PyTorch.
Good for: Developers and teams who want to train & fine-tune.
01How to start
- 1Read the official quick-start (link above).
- 2Install from the official package registry:
pip install bitsandbytes - 3Try it on a small example before wiring it into a project.
02Alternatives & comparison
Compare side by side → transformers 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. ★ 168k LlamaFactory Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) ★ 76k datasets 🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools ★ 22k trainer Distributed AI Model Training and LLM Fine-Tuning on Kubernetes ★ 2.2k keras Deep Learning for humans ★ 64k