Lightning-AI/litgpt
🏗️ FrameworkLightning-AI
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
LitGPT provides a unified interface for working with state-of-the-art LLMs including Llama 3, Mistral, Falcon, and more. It leverages PyTorch Lightning for efficient training and inference, supports quantization (e.g., 4-bit), and includes recipes for pretraining from scratch, finetuning with LoRA/QLoRA, and deployment with vLLM or Hugging Face. The project emphasizes performance, with optimizations like Flash Attention and FSDP.
💡Highlights
- ├─20+ LLMs supported
- ├─Pretrain, finetune, deploy recipes
- └─Optimized for scale & performance
🎯For
- ├─ML engineers
- ├─AI researchers
- └─LLM practitioners