Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rare class and batch size #15

Open
kermitt2 opened this issue Nov 4, 2018 · 0 comments
Open

Rare class and batch size #15

kermitt2 opened this issue Nov 4, 2018 · 0 comments

Comments

@kermitt2
Copy link
Owner

kermitt2 commented Nov 4, 2018

For ELMo, which is using reduced batch size because of memory constrains, it might be necessary to review how the batch are created to ensure that rare classes are well represented in each batch, with automatic over-sampling techniques for instance.

See issue #7 (although ontonotes work finally fine without sampling, we could have more extremely unbalanced training data)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant