How to make image to video using it

[madan-netone]

How to make image to video using it

[ielh1]

See examples in README files in Diffusion (https://github.com/NVIDIA/Cosmos/tree/main/cosmos1/models/diffusion) and Autoregressive (https://github.com/NVIDIA/Cosmos/tree/main/cosmos1/models/autoregressive)

Example taking an image:

PYTHONPATH=$(pwd) python cosmos1/models/diffusion/inference/video2world.py \
    --checkpoint_dir checkpoints \
    --diffusion_transformer_dir Cosmos-1.0-Diffusion-7B-Video2World \
    --input_image_or_video_path cosmos1/models/diffusion/assets/v1p0/video2world_input0.jpg \
    --num_input_frames 1 \
    --video_save_name Cosmos-1.0-Diffusion-7B-Video2World_memory_efficient \
    --offload_tokenizer \
    --offload_diffusion_transformer \
    --offload_text_encoder_model \
    --offload_prompt_upsampler \
    --offload_guardrail_models