You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First of all, many thanks for this handy utility package! My use-case is to detect the largest batchsize possible for translation during inference, which is rather low. I see that the batchsize decrease factor is fixed at 2:
First of all, many thanks for this handy utility package! My use-case is to detect the largest batchsize possible for translation during inference, which is rather low. I see that the batchsize decrease factor is fixed at 2:
For my use-case, this quite an aggressive decrease factor. Might it be possible to make this variable? So that it can be used in such a way:
I'm happy to help, so if you would like me to make a PR, please let me know.
The text was updated successfully, but these errors were encountered: