This repository has been archived by the owner on Nov 22, 2022. It is now read-only.
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add a new PyText get_num_examples_from_batch function in model (#1319)
Summary: Pull Request resolved: #1319 Usually in PyText dataloader, each row (sentence) is read as an example, i.e. create List[sentences], and the number of examples in the batch is simply len(List[data]). This is not correct for language model: in LM, each word is considered as an example. Reviewed By: kmalik22 Differential Revision: D21032297 fbshipit-source-id: f04d98b1f1a1ef1a5e50c57c825633f484e1c725
- Loading branch information