[don't merge] open-sora test pipeline

[patil-suraj]

What does this PR do?

A test implementation for open-sora.

pip install git+https://github.com/huggingface/diffusers.git@st-dit

import torch

from diffusers import OpenSoraPipeline
from diffusers.utils import export_to_gif

pipe = OpenSoraPipeline.from_pretrained("diffusers/open-sora-pipe-test", torch_dtype=torch.float16)
pipe.enable_model_cpu_offload()

prompt = "A serene underwater scene featuring a sea turtle swimming through a coral reef. The turtle, with its greenish-brown shell, is the main focus of the video, swimming gracefully towards the right side of the frame. The coral reef, teeming with life, is visible in the background, providing a vibrant and colorful backdrop to the turtle's journey. Several small fish, darting around the turtle, add a sense of movement and dynamism to the scene."

frames = pipe(prompt, decode_chunk_size=4, num_inference_steps=50, guidance_scale=5.0).frames[0]
export_to_gif(frames, "gen.gif", fps=8)

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[sayakpaul]

Which ckpt_path is this one?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[huanngzh]

Hi, is Open-Sora v1.2 supported?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.