Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Would it be possible to generate 720p or at least 480p videos? #39

Open
EfraynRS opened this issue Jun 14, 2024 · 3 comments
Open

Would it be possible to generate 720p or at least 480p videos? #39

EfraynRS opened this issue Jun 14, 2024 · 3 comments

Comments

@EfraynRS
Copy link

Forgive my clumsiness, I guess it's something that's still developing. It's an amazing tool, but if it could generate slightly larger images it could be used beyond the demo.
I also see that the brightness/tone/contrast in the video changes slightly with respect to the original images.

@user-vm
Copy link

user-vm commented Jun 17, 2024

I have been able to gen 512x512 well enough using half precision. You can try changing the input sizes in scripts/run.sh, but I wouldn't expect it to work well at more than 512x512 since the currently released weights were not trained on larger videos. Plus the VRAM requirements will go up. I tried genning at lower resolution than 512x320 and weird things started appearing in the videos.
If you want to AI upscale the output, I'd recommend one of the realesrgan anime variants.
If you're referring to the flickering, you can probably fix that in Da Vinci Resolve or maybe with these ComfyUI nodes if you use ToonCrafter in ComfyUI.

@EfraynRS
Copy link
Author

I have been able to gen 512x512 well enough using half precision. You can try changing the input sizes in scripts/run.sh, but I wouldn't expect it to work well at more than 512x512 since the currently released weights were not trained on larger videos. Plus the VRAM requirements will go up. I tried genning at lower resolution than 512x320 and weird things started appearing in the videos. If you want to AI upscale the output, I'd recommend one of the realesrgan anime variants. If you're referring to the flickering, you can probably fix that in Da Vinci Resolve or maybe with these ComfyUI nodes if you use ToonCrafter in ComfyUI.

Thank you very much for answering! 512p is great in comparison!! If you could explain to me how I enter the value in "scripts/run.sh",
I actually have no idea about programming or how github works, they just gave me the link directly to the ToonKrafter tool and it was easy to understand that I only had to upload the two key images, but otherwise I don't understand how the website works (I didn't even know how or where to leave this comment). Could you give me a direct link to the site where the code is to change the resolution value? I would greatly appreciate your patience. ^^

@Kiteretsu77
Copy link

you can try to use some super resolution tools.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants