Is there a way to do batch inference?

[SoulflareRC]

I'm trying to do inference in batch by padding each sentence to the max length(pad by 0), but it turns out that the model did fine on the text part, but generated noises for the padded part. Is there a proper way to do this?

[sushant-samespace]

Even I am looking for a solution to this. Were you able to find anything ?

[piyushsinghpasi]

I created batched inference script since I had to run things on scale. Feel free to use it:
https://github.com/piyushsinghpasi/VITS-Batched-Inference

[BB-Beta]

I created batched inference script since I had to run things on scale. Feel free to use it: https://github.com/piyushsinghpasi/VITS-Batched-Inference

thanks，I have the same problem and solved by your solution