Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-implementation err on ffs experiment #36

Closed
dummy702 opened this issue Feb 27, 2024 · 2 comments
Closed

Re-implementation err on ffs experiment #36

dummy702 opened this issue Feb 27, 2024 · 2 comments
Labels
automatic-closing automatic-stale question Further information is requested

Comments

@dummy702
Copy link

Good job, but I have some questions on ffs ckpt inference experiment.
1)I set "ckpt" in ffs.sh to the folder related to https://huggingface.co/maxin-cn/Latte/blob/main/ffs.pt", set "pretrained_model_path" to the folder related to https://huggingface.co/maxin-cn/Latte/tree/main/vae.
But the performance of video generation is bad. Is there anything wrong with my process?

sample.mp4

2)Besides, I edit the code in sample.py. If I keep the code "samples = vae.decode(samples / 0.18215).sample", I will get "Segmentation fault". Therefore, I replace the code with the following. Is there anything wrong with my process?
截屏2024-02-27 下午5 14 47

@maxin-cn
Copy link
Collaborator

maxin-cn commented Feb 27, 2024

Good job, but I have some questions on ffs ckpt inference experiment. 1)I set "ckpt" in ffs.sh to the folder related to https://huggingface.co/maxin-cn/Latte/blob/main/ffs.pt", set "pretrained_model_path" to the folder related to https://huggingface.co/maxin-cn/Latte/tree/main/vae. But the performance of video generation is bad. Is there anything wrong with my process?

sample.mp4
2)Besides, I edit the code in sample.py. If I keep the code "samples = vae.decode(samples / 0.18215).sample", I will get "Segmentation fault". Therefore, I replace the code with the following. Is there anything wrong with my process? 截屏2024-02-27 下午5 14 47

I just tested my code and didn't find anything unusual. For the second question, perhaps you could reinstall your environment? Thanks for your interest.

sample.mp4

@maxin-cn maxin-cn added the question Further information is requested label Jul 20, 2024
Copy link

github-actions bot commented Aug 4, 2024

Hi There! 👋

This issue has been marked as stale due to inactivity for 14 days.

We would like to inquire if you still have the same problem or if it has been resolved.

If you need further assistance, please feel free to respond to this comment within the next 7 days. Otherwise, the issue will be automatically closed.

We appreciate your understanding and would like to express our gratitude for your contribution to Latte. Thank you for your support. 🙏

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automatic-closing automatic-stale question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants