Skip to content
This repository has been archived by the owner on Nov 22, 2022. It is now read-only.

Add Probabilistic Sampling of batches #474

Closed

Conversation

kartikayk
Copy link
Contributor

Summary: Adding a ProbabilisticBatchSampler which is able to sample batches using specified probabilities for the iterators and an optional epoch size. This is needed for training cross-lingual LMs.

Differential Revision: D14929861

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Apr 14, 2019
kartikayk added a commit to kartikayk/pytext that referenced this pull request Apr 15, 2019
Summary:
Pull Request resolved: facebookresearch#474

Adding a ProbabilisticBatchSampler which is able to sample batches using specified probabilities for the iterators and an optional epoch size. This is needed for training cross-lingual LMs.

Differential Revision: D14929861

fbshipit-source-id: 8584f995e56d11dbb1f910f72bb6f6a87d019d44
kartikayk added a commit to kartikayk/pytext that referenced this pull request Apr 16, 2019
Summary:
Pull Request resolved: facebookresearch#474

Adding a ProbabilisticBatchSampler which is able to sample batches using specified probabilities for the iterators and an optional epoch size. This is needed for training cross-lingual LMs.

Differential Revision: D14929861

fbshipit-source-id: 8c75eae936e5294ce0ce09a82d216d130cdbe9c4
kartikayk added a commit to kartikayk/pytext that referenced this pull request Apr 16, 2019
Summary:
Pull Request resolved: facebookresearch#474

Adding a ProbabilisticBatchSampler which is able to sample batches using specified probabilities for the iterators and an optional epoch size. This is needed for training cross-lingual LMs.

Differential Revision: D14929861

fbshipit-source-id: 5df4e351f38f248b039731a6da1b1f11d6695267
Summary:
Pull Request resolved: facebookresearch#474

Adding a ProbabilisticBatchSampler which is able to sample batches using specified probabilities for the iterators and an optional epoch size. This is needed for training cross-lingual LMs.

Differential Revision: D14929861

fbshipit-source-id: a27ec990f96ad2e05a06612311fa315d0755c0a3
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 31fcd83.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants