We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The __len__ method of Iterator (defined here) returns a wrong result for dynamic batching (i.e. if batch_size_fn is not None).
__len__
Iterator
For example if we set batch_size_fn to
batch_size_fn
lambda x, n, b: b + len(x.text)
there might be more or fewer batches in the dataset than the __len__ outputs.
The text was updated successfully, but these errors were encountered:
Successfully merging a pull request may close this issue.
The
__len__
method ofIterator
(defined here) returns a wrong result for dynamic batching (i.e. if batch_size_fn is not None).For example if we set
batch_size_fn
tothere might be more or fewer batches in the dataset than the
__len__
outputs.The text was updated successfully, but these errors were encountered: