Pusa: Thousands Timesteps Video Diffusion Model (ICLR 2026)

🔥🔥🔥🚀 New: Wan2.2 Support & LightX2V Acceleration🚀🔥🔥🔥

MoE DiT Architecture: Now supporting Wan2.2 models with separate high-noise and low-noise DiT models for enhanced quality
⚡ LightX2V Integration: Achieve 4-step inference with lightning-fast generation while maintaining quality
Unified Framework: Compatible with both Wan2.1 and Wan2.2 architectures We are excited to release Pusa V1.0, a groundbreaking paradigm that leverages vectorized timestep adaptation (VTA) to enable fine-grained temporal control within a unified video diffusion framework. By finetuning the SOTA Wan-T2V-14B model with VTA, Pusa V1.0 achieves unprecedented efficiency, surpassing Wan-I2V on Vbench-I2V with only $500 of training cost and 4k data.

✨ Highlights

ComfyUI, supported by Kijai, thanks a lot!
WAN2.2-14B-Rapid-AllInOne, big salute to Phr00t!

Showcases

Various tasks in one model, all in 4 steps with LightX2V

Text-to-Video, Image-to-Video, Start-End Frames, Video Completion, Video Extension, Video Transition, and more.... Below are some showcases for Pusa-Wan2.2-V1. Please refer to Pusa V1.0 README for detailed info.

Example 1: Image-to-Video in 4 Steps

noise: 0.2, high_lora_alpha 1.5 WAN22_.1.MP4	noise: 0.3, high_lora_alpha 1.4 WAN22_.2.MP4
noise: 0.2, high_lora_alpha 1.5 WAN22_.3.MP4	noise: 0.2, high_lora_alpha 1.5 WAN22_.4.MP4

Example 2: Video Extension in 4 Steps

noise: [0.0, 0.3, 0.5, 0.7], high_lora_alpha 1.5

WAN22_.4.MP4

noise: [0.2, 0.4, 0.4, 0.4], high_lora_alpha 1.4

WA3A8D.1.MP4

Example 3: Start-End Frames in 4 Steps

noise: [0.2, 0.5], high_lora_alpha 1.5

WAA302.1.MP4

noise: [0.0, 0.4], high_lora_alpha 1.5

WADE0B.1.MP4

Example 4: Text-to-Video with in 4 Steps

wan22_T2V_video_custom_lora_20250901_190350_cfg_1.0_steps_4_lightx2v.mp4

News

🔥🔥🔥 2026.01: Pusa was accepted at ICLR 2026 🎉

🔥🔥🔥 2025.09: Pusa-Wan2.2 & LightX2V Acceleration Support Released!

🏗️ MoE DiT Support: Added support for Wan2.2 models with separate high-noise and low-noise DiT architecture
⚡ LightX2V Integration: Lightning-fast 4-step inference with maintained quality (great speed improvement)
🎯 New Model: Released Pusa-Wan2.2-V1 with enhanced capabilities
📚 Updated Scripts: All inference scripts now support --lightx2v acceleration flag
⚙️ Parameter Guidelines: Added optimized settings for both standard and accelerated inference

🔥🔥🔥 2025.07: Pusa V1.0 (Pusa-Wan) Code, Technical Report, and Dataset, all released!!! Check our project page and paper for more info.

🔥🔥🔥 2025.04: Pusa V0.5 (Pusa-Mochi) released.

🔥🔥🔥 2024.10: FVDM paper released, initially introducing the vectorized tiemstep paradigm.

Overview

Pusa (pu: 'sA:, from "Thousand-Hand Guanyin" in Chinese) introduces a paradigm shift in video diffusion modeling through frame-level noise control with vectorized timesteps, departing from conventional scalar timestep approaches. This shift was first presented in our FVDM paper.

Pusa V1.0 is based on the SOTA Wan-T2V-14B model and enhances it with our unique vectorized timestep adaptations (VTA), a non-destructive adaptation that fully preserves the capabilities of the base model. With the new Wan2.2 support, Pusa now leverages MoE DiT architecture for improved quality and efficiency.

The codebase has been integrated into the PusaV1 directory, based on DiffSynth-Studio.

Pusa V1.0 not only sets a new standard for image-to-video generation but also unlocks many other zero-shot multi-task capabilities such as start-end frames and video extension, all without task-specific training while preserving the base model's T2V capabilities.

For detailed usage and examples for Pusa V1.0, please see the Pusa V1.0 README.

Pusa V0.5 leverages this architecture, and it is based on Mochi1-Preview. We are open-sourcing this work to foster community collaboration, enhance methodologies, and expand capabilities.

✨ Key Features

Comprehensive Multi-task Support:
- Text-to-Video
- Image-to-Video
- Start-End Frames
- Video completion/transitions
- Video Extension
- And more...
Unprecedented Efficiency:
- Surpasses Wan-I2V-14B with ≤ 1/200 of the training cost ($500 vs. ≥ $100,000)
- Trained on a dataset ≤ 1/2500 of the size (4K vs. ≥ 10M samples)
- Achieves a VBench-I2V score of 87.32% (vs. 86.86% for Wan-I2V-14B)
- ⚡ Speed Improvement with LightX2V acceleration (4 steps vs. 10 or more steps)
Advanced Architecture Options:
- Wan2.1 Models: Single DiT architecture for standard inference
- Wan2.2 Models: MoE DiT architecture (high-noise + low-noise) for enhanced quality
- LightX2V Acceleration: Compatible with both architectures for ultra-fast generation
Complete Open-Source Release:
- Full codebase and training/inference scripts
- LoRA model weights and dataset for Pusa V1.0
- Pusa-Wan2.2-V1 model weights
- Detailed architecture specifications
- Comprehensive training methodology

🔍 Unique Architecture

Novel Diffusion Paradigm: Implements frame-level noise control with vectorized timesteps, originally introduced in the FVDM paper, enabling unprecedented flexibility and scalability.
MoE DiT Support: Wan2.2 models feature separate high-noise and low-noise DiT components, allowing for better noise handling and improved generation quality.
Lightning Acceleration: LightX2V integration provides 4-step inference with maintained quality, dramatically reducing generation time.
Non-destructive Modification: Our adaptations to the base model preserve its original Text-to-Video generation capabilities. After this adaptation, we only need a slight fine-tuning.
Universal Applicability: The methodology can be readily applied to other leading video diffusion models including Hunyuan Video, Wan2.1, and others. Collaborations enthusiastically welcomed!

Pusa V1.0 (Based on Wan)

Pusa V1.0 leverages the powerful Wan-Video models and enhances them with our custom LoRA models and training scripts. Now featuring both Wan2.1 and Wan2.2 architecture support with LightX2V acceleration capabilities.

Model Options:

Wan2.1 Models: Traditional single DiT architecture (Original Pusa V1.0)
Wan2.2 Models: Advanced MoE DiT architecture (Pusa-Wan2.2-V1)

Key Features:

⚡ LightX2V Acceleration: 4-step inference for both model types
🏗️ MoE DiT Architecture: Enhanced quality with separate high/low noise models (Wan2.2)
🎯 Optimized Parameters: cfg_scale=1 for LightX2V, cfg_scale=3 for standard inference
📈 Performance: great speed improvement with maintained generation quality

For detailed instructions on installation, model preparation, usage examples, and training, please refer to the Pusa V1.0 README.

Pusa V0.5 (Based on Mochi)

Click to expand for Pusa V0.5 details

Installation

You may install using uv:

git clone https://github.com/genmoai/models
cd models 
pip install uv
uv venv .venv
source .venv/bin/activate
uv pip install setuptools
uv pip install -e . --no-build-isolation

If you want to install flash attention, you can use:

uv pip install -e .[flash] --no-build-isolation

Download Weights

Option 1: Use the Hugging Face CLI:

pip install huggingface_hub
huggingface-cli download RaphaelLiu/Pusa-V0.5 --local-dir <path_to_downloaded_directory>

Option 2: Download directly from Hugging Face to your local machine.

Usage

Image-to-Video Generation

python ./demos/cli_test_ti2v_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "Your_prompt_here" \
  --image_dir "/path/to/input/image.jpg" \
  --cond_position 0 \
  --num_steps 30 \
  --noise_multiplier 0

Note: We suggest you try different con_position here, and you may also modify the level of noise added to the condition image. You'd be likely to get some surprises.

Take ./demos/example.jpg as an example and run with 4 GPUs:

CUDA_VISIBLE_DEVICES=0,1,2,3 python ./demos/cli_test_ti2v_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "The camera remains still, the man is surfing on a wave with his surfboard." \
  --image_dir "./demos/example.jpg" \
  --cond_position 0 \
  --num_steps 30 \
  --noise_multiplier 0.4

You can get this result:

You may refer to the baselines' results from the VideoGen-Eval benchmark for comparison:

Processing A Group of Images

python ./demos/cli_test_ti2v_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --image_dir "/path/to/image/directory" \
  --prompt_dir "/path/to/prompt/directory" \
  --cond_position 1 \
  --num_steps 30

For group processing, each image should have a corresponding text file with the same name in the prompt directory.

Using the Provided Shell Script

We also provide a shell script for convenience:

# Edit cli_test_ti2v_release.sh to set your paths
# Then run:
bash ./demos/cli_test_ti2v_release.sh

Multi-frame Condition

Pusa supports generating videos from multiple keyframes (2 or more) placed at specific positions in the sequence. This is useful for both start-end frame generation and multi-keyframe interpolation.

Start & End Frame Generation

python ./demos/cli_test_multi_frames_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway." \
  --multi_cond '{"0": ["./demos/example3.jpg", 0.3], "20": ["./demos/example5.jpg", 0.7]}' \
  --num_steps 30

The multi_cond parameter specifies frame condition positions and their corresponding image paths and noise multipliers. In this example, the first frame (position 0) uses ./demos/example3.jpg with noise multiplier 0.3, and frame 20 uses ./demos/example5.jpg with noise multiplier 0.5.

Alternatively, use the provided shell script:

# Edit parameters in cli_test_multi_frames_release.sh first
bash ./demos/cli_test_multi_frames_release.sh

Multi-keyframe Interpolation

To generate videos with more than two keyframes (e.g., start, middle, and end):

python ./demos/cli_test_multi_frames_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway." \
  --multi_cond '{"0": ["./demos/example3.jpg", 0.3], "13": ["./demos/example4.jpg", 0.7], "27": ["./demos/example5.jpg", 0.7]}' \
  --num_steps 30

Video Transition

Create smooth transitions between two videos:

python ./demos/cli_test_transition_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "A fluffy Cockapoo, perched atop a vibrant pink flamingo jumps into a crystal-clear pool." \
  --video_start_dir "./demos/example1.mp4" \
  --video_end_dir "./demos/example2.mp4" \
  --cond_position_start "[0]" \
  --cond_position_end "[-3,-2,-1]" \
  --noise_multiplier "[0.3,0.8,0.8,0.8]" \
  --num_steps 30

Parameters:

cond_position_start: Frame indices from the start video to use as conditioning
cond_position_end: Frame indices from the end video to use as conditioning
noise_multiplier: Noise level multipliers for each conditioning frame

Alternatively, use the provided shell script:

# Edit parameters in cli_test_transition_release.sh first
bash ./demos/cli_test_transition_release.sh

Video Extension

Extend existing videos with generated content:

python ./demos/cli_test_extension_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "A cinematic shot captures a fluffy Cockapoo, perched atop a vibrant pink flamingo float, in a sun-drenched Los Angeles swimming pool. The crystal-clear water sparkles under the bright California sun, reflecting the playful scene." \
  --video_dir "./demos/example1.mp4" \
  --cond_position "[0,1,2,3]" \
  --noise_multiplier "[0.1,0.2,0.3,0.4]" \
  --num_steps 30

Parameters:

cond_position: Frame indices from the input video to use as conditioning
noise_multiplier: Noise level multipliers for each conditioning frame

Alternatively, use the provided shell script:

# Edit parameters in cli_test_v2v_release.sh first
bash ./demos/cli_test_v2v_release.sh

Text-to-Video Generation

python ./demos/cli_test_ti2v_release.py \
  --model_dir "/path/to/Pusa-V0.5" \
  --dit_path "/path/to/Pusa-V0.5/pusa_v0_dit.safetensors" \
  --prompt "A man is playing basketball" \
  --num_steps 30

Training

For Pusa V1.0, please find the training details in the Pusa V1.0 README.

For Pusa V0.5, you can find our training code and details here, which also supports training for the original Mochi model.

Limitations

Pusa currently has several known limitations:

Video generation quality is dependent on the base model (e.g., Wan-T2V-14B for V1.0).
We anticipate significant quality improvements when applying our methodology to more advanced models.
Sim2real gap between conditioning frames and generated frames, like color shifting in image-to-video task.
We welcome community contributions to enhance model performance and extend its capabilities.

Currently Available

✅ Model weights for Pusa V1.0 and V0.5
✅ Model weights for Pusa-Wan2.2-V1 with MoE DiT architecture
✅ LightX2V acceleration support for both Wan2.1 and Wan2.2
✅ Inference code for Text-to-Video generation
✅ Inference code for Image-to-Video generation
✅ Inference scripts for start & end frames, multi-frames, video transition, video extension
✅ Training code and details
✅ Model full fine-tuning guide (for Pusa V0.5)
✅ Training datasets
✅ Technical Report for Pusa V1.0

TODO List

🔄 Release more advanced versions with SOTA models
🔄 More capabilities like long video generation
🔄 Enhanced LightX2V integration for even faster inference
🔄 ....

Changelog

v1.0.1 (September 1, 2025)

Added Wan2.2 MoE DiT architecture support
Integrated LightX2V acceleration for 4-step inference
Released Pusa-Wan2.2-V1 model weights
Added wan22_* inference scripts with MoE LoRA support
Updated all wan_* scripts with --lightx2v acceleration flag
Added comprehensive parameter guidelines for accelerated inference
Enhanced documentation with Wan2.2 usage examples

v1.0 (July 15, 2025)

Released Pusa V1.0, based on the Wan-Video models.
Released Technical Report, V1.0 model weights and dataset.
Integrated codebase as /PusaV1.
Added new examples and training scripts for Pusa V1.0 in PusaV1/.
Updated documentation for the V1.0 release.

v0.5 (June 3, 2025)

Released inference scripts for Start&End Frames Generation, Multi-Frames Generation, Video Transition, and Video Extension.

v0.5 (April 10, 2025)

Released our training codes and details here
Support multi-nodes/single-node full finetuning code for both Pusa and Mochi
Released our training dataset dataset

Related Work

FVDM: Introduces the groundbreaking frame-level noise control with vectorized timestep approach that inspired Pusa.
Wan-Video: The foundation model for Pusa V1.0.
LightX2V: Lightning-fast inference acceleration integrated into Pusa for 4-step generation.
Mochi: The foundation model for Pusa V0.5, recognized as a leading open-source video generation system on the Artificial Analysis Leaderboard.

BibTeX

If you use this work in your project, please cite the following references.

@article{liu2025pusa,
  title={PUSA V1. 0: Surpassing Wan-I2V with $500 Training Cost by Vectorized Timestep Adaptation},
  author={Liu, Yaofang and Ren, Yumeng and Artola, Aitor and Hu, Yuxuan and Cun, Xiaodong and Zhao, Xiaotong and Zhao, Alan and Chan, Raymond H and Zhang, Suiyun and Liu, Rui and others},
  journal={arXiv preprint arXiv:2507.16116},
  year={2025}
}

@misc{Liu2025pusa,
  title={Pusa: Thousands Timesteps Video Diffusion Model},
  author={Yaofang Liu and Rui Liu},
  year={2025},
  url={https://github.com/Yaofang-Liu/Pusa-VidGen},
}

@article{liu2024redefining,
  title={Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach},
  author={Liu, Yaofang and Ren, Yumeng and Cun, Xiaodong and Artola, Aitor and Liu, Yang and Zeng, Tieyong and Chan, Raymond H and Morel, Jean-michel},
  journal={arXiv preprint arXiv:2410.03160},
  year={2024}
}

Name		Name	Last commit message	Last commit date
PusaV1		PusaV1
assets		assets
demos		demos
scripts		scripts
src/genmo		src/genmo
LICENSE		LICENSE
README.md		README.md
pyproject.toml		pyproject.toml
pyrightconfig.json		pyrightconfig.json
requirements.txt		requirements.txt
uv.lock		uv.lock

Latest commit

History

Folders and files

Repository files navigation

Pusa: Thousands Timesteps Video Diffusion Model (ICLR 2026)

🔥🔥🔥🚀 New: Wan2.2 Support & LightX2V Acceleration🚀🔥🔥🔥

✨ Highlights

Showcases

Various tasks in one model, all in 4 steps with LightX2V

News

🔥🔥🔥 2026.01: Pusa was accepted at ICLR 2026 🎉

🔥🔥🔥 2025.09: Pusa-Wan2.2 & LightX2V Acceleration Support Released!

🔥🔥🔥 2025.07: Pusa V1.0 (Pusa-Wan) Code, Technical Report, and Dataset, all released!!! Check our project page and paper for more info.

🔥🔥🔥 2025.04: Pusa V0.5 (Pusa-Mochi) released.

🔥🔥🔥 2024.10: FVDM paper released, initially introducing the vectorized tiemstep paradigm.

Table of Contents

Overview

✨ Key Features

🔍 Unique Architecture

Pusa V1.0 (Based on Wan)

Pusa V0.5 (Based on Mochi)

Installation

Download Weights

Usage

Image-to-Video Generation

Processing A Group of Images

Using the Provided Shell Script

Multi-frame Condition

Start & End Frame Generation

Multi-keyframe Interpolation

Video Transition

Video Extension

Text-to-Video Generation

Training

Limitations

Currently Available

TODO List

Changelog

Related Work

BibTeX

About

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

Packages

Used by

Contributors

Languages