Skip to content

feat: add ltx2.3 support#1463

Merged
leejet merged 20 commits into
masterfrom
ltx2.3
May 17, 2026
Merged

feat: add ltx2.3 support#1463
leejet merged 20 commits into
masterfrom
ltx2.3

Conversation

@leejet
Copy link
Copy Markdown
Owner

@leejet leejet commented Apr 27, 2026

LTX-2.3 dev T2V

.\bin\Release\sd-cli.exe -M vid_gen --diffusion-model  ..\..\ComfyUI\models\diffusion_models\ltx-2.3-22b-dev-UD-Q4_K_M.gguf --vae ..\..\ComfyUI\models\vae\ltx-2.3-22b-dev_video_vae.safetensors --audio-vae ..\..\ComfyUI\models\vae\ltx-2.3-22b-dev_audio_vae.safetensors --llm ..\..\ComfyUI\models\text_encoders\gemma-3-12b-it-qat-UD-Q4_K_XL.gguf --embeddings-connectors ..\..\ComfyUI\models\text_encoders\ltx-2.3-22b-dev_embeddings_connectors.safetensors  -p "a lovely cat" --cfg-scale 6.0 --sampling-method euler -v -n "worst quality, low quality, blurry, distorted, artifacts" -W 1280 -H 720 --diffusion-fa --offload-to-cpu --video-frames 33 --fps 24 -o t2v.webm
t2v.webm

LTX-2.3 dev I2V

.\bin\Release\sd-cli.exe -M vid_gen --diffusion-model  ..\..\ComfyUI\models\diffusion_models\ltx-2.3-22b-dev-UD-Q4_K_M.gguf --vae ..\..\ComfyUI\models\vae\ltx-2.3-22b-dev_video_vae.safetensors --audio-vae ..\..\ComfyUI\models\vae\ltx-2.3-22b-dev_audio_vae.safetensors --llm ..\..\ComfyUI\models\text_encoders\gemma-3-12b-it-qat-UD-Q4_K_XL.gguf --embeddings-connectors ..\..\ComfyUI\models\text_encoders\ltx-2.3-22b-dev_embeddings_connectors.safetensors  -p "a lovely cat" --cfg-scale 6.0 --sampling-method euler -v  -W 1280 -H 720 --diffusion-fa --offload-to-cpu --video-frames 33 -i ..\assets\ernie_image\turbo_example.png -o i2v.webm
i2v.webm

@Green-Sky
Copy link
Copy Markdown
Contributor

Finally, temporal tiling 🥳

pwilkin added a commit to pwilkin/stable-diffusion.cpp that referenced this pull request May 1, 2026
@Green-Sky
Copy link
Copy Markdown
Contributor

Green-Sky commented May 8, 2026

Looks like @stduhpf 's https://huggingface.co/stduhpf/google-gemma-3-12b-it-qat-q4_0-gguf-small would be ideal here.


@leejet your example command contains both --diffusion-fa and --fa (:

@juntaosun
Copy link
Copy Markdown

Does it support LoRa loading?

@stduhpf
Copy link
Copy Markdown
Contributor

stduhpf commented May 11, 2026

Does it support LoRa loading?

Of course it does.

@stduhpf
Copy link
Copy Markdown
Contributor

stduhpf commented May 11, 2026

Audio decoding is messed up (seems to be sped up with high pitch and repeats twice). Other than that it works nicely so far. Great job as always @leejet !

edit: I believe the audio issue might just be because of the arrangement of stereo samples in the webm file (planar vs interleaved)

@stduhpf

This comment was marked as resolved.

@LostRuins LostRuins mentioned this pull request May 17, 2026
@LostRuins
Copy link
Copy Markdown
Contributor

LostRuins commented May 17, 2026

Very nice to see this is being worked on, LTX 2.3 is highly anticipated!

Tangentially, not sure if you've seen this (likely vibecoded) ltx.cpp implementation https://github.com/audiohacking/ltx.cpp which is also ggml based, probably not too helpful but might be a useful reference, seeing as they also use the same comfyui ggufs.

@leejet leejet changed the title wip: add ltx2.3 support feat: add ltx2.3 support May 17, 2026
@leejet
Copy link
Copy Markdown
Owner Author

leejet commented May 17, 2026

Very nice to see this is being worked on, LTX 2.3 is highly anticipated!

Tangentially, not sure if you've seen this (likely vibecoded) ltx.cpp implementation https://github.com/audiohacking/ltx.cpp which is also ggml based, probably not too helpful but might be a useful reference, seeing as they also use the same comfyui ggufs.

I hadn’t looked at this project before, but it seems that this is not a complete implementation. The documentation says that ltx2.3 uses T5-XXL, which I don’t quite understand.

@leejet leejet merged commit 67dda3f into master May 17, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants