Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Output video not compleat the talking #12

Closed
ShmuelRonen opened this issue Aug 7, 2023 · 12 comments
Closed

Output video not compleat the talking #12

ShmuelRonen opened this issue Aug 7, 2023 · 12 comments
Labels
bug Something isn't working

Comments

@ShmuelRonen
Copy link

Hello...
Thanks for your adaptation of Wav2LIp for Automatic1111 !!

I encountered such a problem. Creating the low resolution video was successful. But the HD process stopped after 279 frames as if the movie was finished.

Processing frame: 265 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 266 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.62it/s]
Processing frame: 267 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 268 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 269 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.64it/s]
Processing frame: 270 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.66it/s]
Processing frame: 271 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 272 of 1133 -- 44s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.66it/s]
Processing frame: 273 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 274 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.63it/s]
Processing frame: 275 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 276 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.64it/s]
Processing frame: 277 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 278 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 279 of 1133 -- 43s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 280 of 1133 -- 43s/it]
[INFO] Create Video output!
[INFO] Extract Audio from input!
[INFO] Add Audio to Video!
[INFO] Done! file save in output/video_output.mp4

result_voice.mp4
output_video.mp4
@ShmuelRonen
Copy link
Author

I have now tried again and got the same results:

Processing frame: 275 of 1133 -- 42s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 276 of 1133 -- 41s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.62it/s]
Processing frame: 277 of 1133 -- 42s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.63it/s]
Processing frame: 278 of 1133 -- 42s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.62it/s]
Processing frame: 279 of 1133 -- 42s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 2.65it/s]
Processing frame: 280 of 1133 -- 42s/it]
[INFO] Create Video output!
[INFO] Extract Audio from input!
[INFO] Add Audio to Video!
[INFO] Done! file save in output/video_output.mp4

@ShmuelRonen
Copy link
Author

This is the video source:

loop_gARLIKA.mp4

@numz
Copy link
Owner

numz commented Aug 7, 2023

Hi,
i'll try to quickly fix it.

Sorry about that..

Edit: If you need to quick fix without wait my fix, you can use a video editor and repeat 5 times your original video and use it as input in wav2lip uhq ... i know it's not what you expect but i don't have access to my pc right now...

@ShmuelRonen
Copy link
Author

Hi, i'll try to quickly fix it.

Sorry about that..

Edit: If you need to quick fix without wait my fix, you can use a video editor and repeat 5 times your original video and use it as input in wav2lip uhq ... i know it's not what you expect but i don't have access to my pc right now...

Thanks!

@ShmuelRonen
Copy link
Author

Hi, i'll try to quickly fix it.

Sorry about that..

Edit: If you need to quick fix without wait my fix, you can use a video editor and repeat 5 times your original video and use it as input in wav2lip uhq ... i know it's not what you expect but i don't have access to my pc right now...

Wav2lip has a problem with source video files that are over 30 seconds long. So I prefer to wait for you to fix the problem. Because using video source files longer than 30 seconds created problems for me.

@ShmuelRonen
Copy link
Author

Are you there?

@numz
Copy link
Owner

numz commented Aug 12, 2023

Hi,
@ShmuelRonen Apologies for the delay, I was on holiday.
I've made the necessary fix. Please update the sd-wav2lip-uhq and let me know how it goes. :)

@numz
Copy link
Owner

numz commented Aug 14, 2023

I think it's Ok, I close this issue, let me know if you think I have to reopen

Regards

@numz numz closed this as completed Aug 14, 2023
@ShmuelRonen
Copy link
Author

Thanks!!! I check it today and it's OK now.
The process is very slow compared to the wav2lip GFPGAN that I use for my productions.

@numz
Copy link
Owner

numz commented Aug 14, 2023

ok cool,

I see your facebook, i have let you a comment on your last video for know if you used sd-wav2lip-uhq or an other tool :)

Let me know :)

regards

@ShmuelRonen
Copy link
Author

From my test GFPGAN is almost 2 times faster in processing the resolution increase.

@numz
Copy link
Owner

numz commented Aug 14, 2023

I don't say it in README.md but I use the default enhancer which is CodeFormer, but in Automatic1111=>Settings=>Face Restoration you can choose between CodeFormer and GFPGAN, if you can, let's test and tell me if you found any difference :), I'll test too

Regards

@numz numz added the bug Something isn't working label Aug 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants