[SPARKNLP-890] ONNX E5 MPnet example #13958
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
maziyarpanahi
approved these changes
Sep 7, 2023
maziyarpanahi
changed the base branch from
master
to
release/511-release-candidate
maziyarpanahi
merged commit 637f007
into
JohnSnowLabs:release/511-release-candidate
1 check passed
maziyarpanahi
added a commit
that referenced
this pull request
Sep 11, 2023
…date * [SPARKNLP-906] Fix reading suffix (#13945) * Sparknlp 888 Add ONNX support to MPNet embeddings (#13955) * adding onxx support to mpnet * remove name in test * updating default name for mpnet models in scala and python * updating default model name * Adding ONNX Support to ALBERT Token and Sequence Classification and Question Answering annotators (#13956) * SPARKNLP-891 Adding ONNX support for AlbertQuestionAnswering SPARKNLP-892 Adding ONNX support for AlbertSequenceClassification SPARKNLP-893 Adding ONNX support for AlbertTokenClassification * SPARKNLP-891 Adding ONNX support for AlbertQuestionAnswering SPARKNLP-892 Adding ONNX support for AlbertSequenceClassification SPARKNLP-893 Adding ONNX support for AlbertTokenClassification * SPARKNLP-884 Enabling getVectors method to get word vectors as spark dataframe (#13957) * [SPARKNLP-890] ONNX E5 MPnet example (#13958) * Bump version to 5.1.1 * [SPARKNLP-891] [SPARKNLP-892] [SPARKNLP-893] Adding docs for ONNX support in AlbertXXX * Fix misspelling [skip test] * Fixing onnx saving path bug (#13959) * fixing onnx write issue on windows * fixing indentation * fixing formatting * fixing formatting * final formatting fix * Fix onnx saving bug --------- Co-authored-by: Devin Ha <t.ha@tu-berlin.de> Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr> --------- Co-authored-by: Devin Ha <33089471+DevinTDHa@users.noreply.github.com> Co-authored-by: ahmedlone127 <ahmedlone127@gmail.com> Co-authored-by: Danilo Burbano <37355249+danilojsl@users.noreply.github.com> Co-authored-by: Danilo Burbano <danilo@johnsnowlabs.com> Co-authored-by: Devin Ha <t.ha@tu-berlin.de>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR adds notebooks how to import onnx models from transformers to Spark NLP.
The import of MPNet will be available from Spark NLP 5.1.1.
How Has This Been Tested?
Ran and exported from Google Colab.