Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DL4J: BertIterator - add inference method #8415

Closed
AlexDBlack opened this issue Nov 18, 2019 · 0 comments · Fixed by KonduitAI/deeplearning4j#71
Closed

DL4J: BertIterator - add inference method #8415

AlexDBlack opened this issue Nov 18, 2019 · 0 comments · Fixed by KonduitAI/deeplearning4j#71
Labels
Milestone

Comments

@AlexDBlack
Copy link
Contributor

@AlexDBlack AlexDBlack commented Nov 18, 2019

i.e., add a "sentence to features" method - sentence in, INDArrays for features + mask if appropriate, out.

It should just be a subset of the next method
https://github.com/eclipse/deeplearning4j/blob/master/deeplearning4j/deeplearning4j-nlp-parent/deeplearning4j-nlp/src/main/java/org/deeplearning4j/iterator/BertIterator.java#L180-L235

cc @eraly

@AlexDBlack AlexDBlack added this to the 1.0.0-beta6 milestone Nov 18, 2019
AlexDBlack added a commit to KonduitAI/deeplearning4j that referenced this issue Nov 22, 2019
* Convenience method for inference with BERT iterator

Signed-off-by: eraly <susan.eraly@gmail.com>

* Included preprocessing

Signed-off-by: eraly <susan.eraly@gmail.com>

* Copyright + example

Signed-off-by: eraly <susan.eraly@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.