github-actions[bot]
74 lines
2.8 KiB
Markdown
74 lines
2.8 KiB
Markdown
# LTX-2 Trainer
|
|
|
|
This package provides tools and scripts for training and fine-tuning
|
|
Lightricks' **LTX-2** audio-video generation model. It supports LoRA training, full
|
|
fine-tuning, and a flexible conditioning framework covering text-to-video, text-to-audio, image-to-video,
|
|
video extension, audio extension, video inpainting, audio inpainting, video outpainting, IC-LoRA for video, audio, and joint
|
|
audio-video references, audio-to-video, and video-to-audio.
|
|
|
|
---
|
|
|
|
## 📖 Documentation
|
|
|
|
All detailed guides and technical documentation are in the [docs](./docs/) directory:
|
|
|
|
- [⚡ Quick Start Guide](docs/quick-start.md)
|
|
- [🎬 Dataset Preparation](docs/dataset-preparation.md)
|
|
- [🛠️ Training Modes](docs/training-modes.md)
|
|
- [⚙️ Configuration Reference](docs/configuration-reference.md)
|
|
- [🚀 Training Guide](docs/training-guide.md)
|
|
- [🧪 Inference Guide](../ltx-pipelines/README.md)
|
|
- [🔧 Utility Scripts](docs/utility-scripts.md)
|
|
- [🧩 Custom Training Strategies](docs/custom-training-strategies.md)
|
|
- [📚 LTX-Core Documentation](../ltx-core/README.md)
|
|
- [🛡️ Troubleshooting Guide](docs/troubleshooting.md)
|
|
|
|
### 🤖 Agent-Assisted Training
|
|
|
|
Use the [`train-model`](../../.claude/skills/train-model/SKILL.md) repository skill for an end-to-end guided run:
|
|
it probes your data and hardware, chooses the matching training mode, prepares/preprocesses the dataset, launches
|
|
training, and monitors the job while using the docs above as the source of truth.
|
|
|
|
---
|
|
|
|
## 🔧 Requirements
|
|
|
|
- **LTX-2 Model Checkpoint** - Local `.safetensors` file
|
|
- **Gemma Text Encoder** - Local Gemma model directory (required for LTX-2)
|
|
- **Linux with CUDA** - CUDA 13+ recommended for optimal performance
|
|
- **Nvidia GPU with 80GB+ VRAM** - Recommended for the standard config. For GPUs with 32GB VRAM (e.g., RTX 5090),
|
|
use the [low VRAM config](configs/t2v_lora_low_vram.yaml) which enables INT8 quantization and other
|
|
memory optimizations
|
|
|
|
---
|
|
|
|
## 🤝 Contributing
|
|
|
|
We welcome contributions from the community! Here's how you can help:
|
|
|
|
- **Share Your Work**: If you've trained interesting LoRAs or achieved cool results, please share them with the
|
|
community.
|
|
- **Report Issues**: Found a bug or have a suggestion? Open an issue on GitHub.
|
|
- **Submit PRs**: Help improve the codebase with bug fixes or general improvements.
|
|
- **Feature Requests**: Have ideas for new features? Let us know through GitHub issues.
|
|
|
|
---
|
|
|
|
## 💬 Join the Community
|
|
|
|
Have questions, want to share your results, or need real-time help?
|
|
|
|
Join our [community Discord server](https://discord.gg/ltxplatform) to connect with other users and the development
|
|
team!
|
|
|
|
- Get troubleshooting help
|
|
- Share your training results and workflows
|
|
- Collaborate on new ideas and features
|
|
- Stay up to date with announcements and updates
|
|
|
|
We look forward to seeing you there!
|
|
|
|
---
|
|
|
|
Happy training! 🎉
|