Adjust code to squad inferencing #367
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
brandenchan
approved these changes
May 14, 2020
brandenchan
added a commit
that referenced
this pull request
May 27, 2020
) * WIP: Messily adding NQ support * WIP: NQ example * WIP: NQ data tokenized (very messy) * WIP: need to work on process_answers * WIP: Samples created * WIP: Data can be featurized * WIP: IDs featurized * WIP: NQ training can run * WIP: Working on downsampling is_impossible * WIP: Processor can downsample is_impossible * WIP: dealing with multi head inf aggregation * WIP: first attempt at merge() * WIP: Fixing merge fn * WIP: fixing merge * WIP: implement Span and DocumentPred classes * WIP: Fixing SQuAD * WIP: Fixes for SQuAD * WIP: NQ and Squad seem to run through * Code cleanup and commenting * Set better default * Refactor formatted_preds() * Fix some tests not all * Addresses reviewer's comments * Addresses more of reviewer's comments * Fix input dict conversion * Remove rest_api_schema * All tests pass * Remove class method from child Class * nq test implemented * add test data for nq * Adjust code to squad inferencing (#367) * Flatten prediction lists in adaptiive model * Add squad question id to output dict in inference mode * Fix qa id issue, adjust tests * Add nq output to nq inferencing * Allows download of sample dataset * Add html tag tokens to vocab * Add downsampling before dataprocessing * Add loading of trained model to example script * Add classification field to test Co-authored-by: Timo Moeller <timo.moeller@deepset.ai>
Timoeller
added a commit
that referenced
this pull request
Dec 23, 2020
* Flatten prediction lists in adaptiive model * Add squad question id to output dict in inference mode Former-commit-id: b4c0fdb
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.