LTX-2/packages/ltx-pipelines/docs/pipeline-selection.md

Pipeline Selection Guide

Quick Decision Tree

Do you have an existing video to modify?
├─ YES → Use RetakePipeline (regenerate a specific time region)
│
Do you have an audio file to drive generation?
├─ YES → Use A2VidPipelineTwoStage (audio-to-video)
│
Do you need HDR output (linear float frames for EXR / tonemapping)?
├─ YES → Use HDRICLoraPipeline (video-to-video with LogC3 inverse decode)
│
Do you need to condition on existing images/videos?
├─ YES → Do you have reference videos for video-to-video?
│  ├─ YES → Use ICLoraPipeline
│  └─ NO → Do you have multiple keyframe images to interpolate?
│     ├─ YES → Use KeyframeInterpolationPipeline
│     └─ NO → Use TI2VidTwoStagesPipeline (image conditioning only)
│
└─ NO → Text-to-video only
   ├─ Do you need best quality?
   │  └─ YES → Use TI2VidTwoStagesPipeline (recommended for production)
   │
   └─ Do you need fastest inference?
      └─ YES → Use DistilledPipeline (with 8 predefined sigmas)

Note: TI2VidOneStagePipeline is primarily for educational purposes. For best quality, use two-stage pipelines (TI2VidTwoStagesPipeline, TI2VidTwoStagesHQPipeline, ICLoraPipeline, KeyframeInterpolationPipeline, A2VidPipelineTwoStage, or DistilledPipeline). For editing existing videos, use RetakePipeline.

Features Comparison

Pipeline	Stages	Multimodal Guidance	Upsampling	Conditioning	Best For
TI2VidTwoStagesPipeline	2	✅	✅	Image	Production quality (recommended)
TI2VidTwoStagesHQPipeline	2	✅	✅	Image	Same as above, res_2s sampler (higher quality)
TI2VidOneStagePipeline	1	✅	❌	Image	Educational, prototyping
DistilledPipeline	2	❌	✅	Image	Fastest inference (8 sigmas)
ICLoraPipeline	2	✅	✅	Image + Video	Video-to-video transformations
KeyframeInterpolationPipeline	2	✅	✅	Keyframes	Animation, interpolation
A2VidPipelineTwoStage	2	✅	✅	Audio + Image	Audio-driven video generation
RetakePipeline	1	✅	❌	Source Video	Regenerating a time region of a video
HDRICLoraPipeline	2	❌	✅	Video	HDR video-to-video (linear float output for EXR)
LipDubPipeline	2	✅	✅	Video + Audio	Lip dubbing with audio ref conditioning
T2AOneStagePipeline	1	Audio only	❌	None (text)	Text-to-audio (audio-only output, no video)

See Available Pipelines for a full description of each.