Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
115 commits
Select commit Hold shift + click to select a range
d53f848
add transformer pipeline first version
leffff Oct 4, 2025
7db6093
updates
leffff Oct 6, 2025
a0cf07f
fix 5sec generation
leffff Oct 9, 2025
0bd738f
Merge branch 'huggingface:main' into main
leffff Oct 9, 2025
c8f3a36
rewrite Kandinsky5T2VPipeline to diffusers style
leffff Oct 10, 2025
86b6c2b
Merge branch 'huggingface:main' into main
leffff Oct 10, 2025
723d149
add multiprompt support
leffff Oct 10, 2025
22e14bd
remove prints in pipeline
leffff Oct 10, 2025
70fa62b
add nabla attention
leffff Oct 12, 2025
07e11b2
Merge branch 'huggingface:main' into main
leffff Oct 12, 2025
45240a7
Wrap Transformer in Diffusers style
leffff Oct 13, 2025
43bd1e8
fix license
leffff Oct 13, 2025
f35c279
Merge branch 'huggingface:main' into main
leffff Oct 13, 2025
149fd53
fix prompt type
leffff Oct 13, 2025
e3a3e9d
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 13, 2025
7af80e9
add gradient checkpointing and peft support
leffff Oct 14, 2025
04efb19
add usage example
leffff Oct 14, 2025
4aa22f3
Merge branch 'main' into main
leffff Oct 14, 2025
235f0d5
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 14, 2025
88a8eea
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 14, 2025
f52f3b4
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 14, 2025
0190e55
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 14, 2025
d62dffc
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 14, 2025
7084106
remove unused imports
leffff Oct 14, 2025
d5dcd94
Merge branch 'huggingface:main' into main
leffff Oct 15, 2025
b615d5c
add 10 second models support
leffff Oct 15, 2025
6a0233e
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 15, 2025
588c12a
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 16, 2025
327ab84
remove no_grad and simplified prompt paddings
leffff Oct 16, 2025
9b06afb
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 16, 2025
8fd22c0
merge
leffff Oct 16, 2025
28458d0
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 16, 2025
e7b91ed
merge suggestions
leffff Oct 16, 2025
cd3cc61
moved template to __init__
leffff Oct 16, 2025
4450265
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 16, 2025
b9a3be2
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 16, 2025
78a23b9
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 16, 2025
56b90b1
moved sdps inside processor
leffff Oct 16, 2025
600e9d6
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 16, 2025
31a1474
remove oneline function
leffff Oct 16, 2025
894aa98
remove reset_dtype methods
leffff Oct 16, 2025
c8be081
Transformer: move all methods to forward
leffff Oct 16, 2025
3ffdf7f
separated prompt encoding
leffff Oct 16, 2025
b0e1b86
Merge branch 'main' into main
leffff Oct 16, 2025
9f52335
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 16, 2025
cc46e2d
refactoring
leffff Oct 16, 2025
573b966
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 16, 2025
9672c6b
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 16, 2025
1e597cb
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 16, 2025
900feba
refactoring acording to https://github.com/huggingface/diffusers/comm…
leffff Oct 17, 2025
3839f5e
Merge branch 'main' into main
yiyixuxu Oct 17, 2025
226bbf8
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
9504fb0
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
f0eca08
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
cc74c1e
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
cb915d7
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
9aa3c2e
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
feac8f0
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
d3b9597
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
693b9aa
Update src/diffusers/models/transformers/transformer_kandinsky.py
leffff Oct 17, 2025
e2ed6ec
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
2925447
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
b02ad82
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
dc67c2b
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
d0fc426
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
222ba4c
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
3a49505
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
1e12017
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
5a30079
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
0d96ecf
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
aadafc1
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
54cf03c
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
22c503f
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
211d3dd
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
70cfb9e
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
6e83133
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
7ad87f3
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
bf229af
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
06afd9b
Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
leffff Oct 17, 2025
e1a635e
fixed
leffff Oct 17, 2025
e4856e5
Merge branch 'main' into main
leffff Oct 17, 2025
1bf19f0
style +copies
yiyixuxu Oct 18, 2025
1746f6d
Update src/diffusers/models/transformers/transformer_kandinsky.py
yiyixuxu Oct 18, 2025
5bb1657
more
yiyixuxu Oct 18, 2025
a26300f
Apply suggestions from code review
yiyixuxu Oct 18, 2025
ecbe522
add lora loader doc
yiyixuxu Oct 18, 2025
11200b4
Merge branch 'huggingface:main' into main
leffff Oct 20, 2025
b35445c
add compiled Nabla Attention
leffff Oct 21, 2025
51b078c
Merge branch 'huggingface:main' into main
leffff Oct 21, 2025
4ed2f53
Merge branch 'main' into main
sayakpaul Oct 22, 2025
54e7757
all needed changes for 10 sec models are added!
leffff Oct 22, 2025
939f7d0
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 22, 2025
91133e0
Merge branch 'huggingface:main' into main
leffff Oct 22, 2025
25f2e9c
add docs
leffff Oct 23, 2025
e45c036
Merge branch 'huggingface:main' into main
leffff Oct 23, 2025
3bbc232
Apply style fixes
github-actions[bot] Oct 23, 2025
e181f13
Merge branch 'huggingface:main' into main
leffff Oct 24, 2025
dd6bf39
update docs
leffff Oct 24, 2025
add757b
Merge branch 'main' into main
yiyixuxu Oct 24, 2025
5fb528b
add kandinsky5 to toctree
leffff Oct 24, 2025
c9c1190
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Oct 24, 2025
47dd246
Merge branch 'huggingface:main' into main
leffff Oct 27, 2025
d2a206e
add tests
leffff Oct 27, 2025
56c4238
fix tests
leffff Oct 27, 2025
dec0317
Apply style fixes
github-actions[bot] Oct 27, 2025
7959832
Merge branch 'main' into main
yiyixuxu Oct 27, 2025
0e1b7f6
Merge branch 'main' into main
leffff Oct 27, 2025
19a790d
update tests
yiyixuxu Oct 28, 2025
861f787
Merge branch 'main' of github.com:leffff/diffusers into HEAD
yiyixuxu Oct 28, 2025
72468ed
minor docs refactoring
leffff Nov 3, 2025
ff0f7af
Merge branch 'main' into main
leffff Nov 3, 2025
6fe9c64
refactor Kandinsky 5.0 Vide docs
leffff Nov 3, 2025
762daa9
Merge branch 'main' of https://github.com/leffff/diffusers
leffff Nov 3, 2025
6802d87
Update docs/source/en/_toctree.yml
yiyixuxu Nov 4, 2025
2432810
Merge branch 'main' into main
yiyixuxu Nov 4, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/source/en/_toctree.yml
Original file line number Diff line number Diff line change
Expand Up @@ -529,8 +529,6 @@
title: Kandinsky 2.2
- local: api/pipelines/kandinsky3
title: Kandinsky 3
- local: api/pipelines/kandinsky5
title: Kandinsky 5
- local: api/pipelines/kolors
title: Kolors
- local: api/pipelines/latent_consistency_models
Expand Down Expand Up @@ -656,6 +654,8 @@
title: Text2Video-Zero
- local: api/pipelines/wan
title: Wan
- local: api/pipelines/kandinsky5_video
title: Kandinsky 5.0 Video
title: Video
title: Pipelines
- sections:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,9 @@ an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express o
specific language governing permissions and limitations under the License.
-->

# Kandinsky 5.0
# Kandinsky 5.0 Video

Kandinsky 5.0 is created by the Kandinsky team: Alexey Letunovskiy, Maria Kovaleva, Ivan Kirillov, Lev Novitskiy, Denis Koposov, Dmitrii Mikhailov, Anna Averchenkova, Andrey Shutkin, Julia Agafonova, Olga Kim, Anastasiia Kargapoltseva, Nikita Kiselev, Anna Dmitrienko, Anastasia Maltseva, Kirill Chernyshev, Ilia Vasiliev, Viacheslav Vasilev, Vladimir Polovnikov, Yury Kolabushin, Alexander Belykh, Mikhail Mamaev, Anastasia Aliaskina, Tatiana Nikulina, Polina Gavrilova, Vladimir Arkhipkin, Vladimir Korviakov, Nikolai Gerasimenko, Denis Parkhomenko, Denis Dimitrov
Kandinsky 5.0 Video is created by the Kandinsky team: Alexey Letunovskiy, Maria Kovaleva, Ivan Kirillov, Lev Novitskiy, Denis Koposov, Dmitrii Mikhailov, Anna Averchenkova, Andrey Shutkin, Julia Agafonova, Olga Kim, Anastasiia Kargapoltseva, Nikita Kiselev, Anna Dmitrienko, Anastasia Maltseva, Kirill Chernyshev, Ilia Vasiliev, Viacheslav Vasilev, Vladimir Polovnikov, Yury Kolabushin, Alexander Belykh, Mikhail Mamaev, Anastasia Aliaskina, Tatiana Nikulina, Polina Gavrilova, Vladimir Arkhipkin, Vladimir Korviakov, Nikolai Gerasimenko, Denis Parkhomenko, Denis Dimitrov


Kandinsky 5.0 is a family of diffusion models for Video & Image generation. Kandinsky 5.0 T2V Lite is a lightweight video generation model (2B parameters) that ranks #1 among open-source models in its class. It outperforms larger models and offers the best understanding of Russian concepts in the open-source ecosystem.
Expand Down Expand Up @@ -92,7 +92,7 @@ pipe = pipe.to("cuda")

pipe.transformer.set_attention_backend(
"flex"
) # <--- Set attention backend to Flex
) # <--- Sett attention bakend to Flex
pipe.transformer.compile(
mode="max-autotune-no-cudagraphs",
dynamic=True
Expand All @@ -115,7 +115,7 @@ export_to_video(output, "output.mp4", fps=24, quality=9)
```

### Diffusion Distilled model
**⚠️ Warning!** all nocfg and diffusion distilled models should be inferred without CFG (```guidance_scale=1.0```):
**⚠️ Warning!** all nocfg and diffusion distilled models should be infered wothout CFG (```guidance_scale=1.0```):

```python
model_id = "ai-forever/Kandinsky-5.0-T2V-Lite-distilled16steps-5s-Diffusers"
Expand Down