Multiple improvements to results extraction #5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* downgrade elasticsearch-dsl version due to compatibility issues * make elastic connection setup optional * make CRF loading optional * disable multiprocessing in tokenization to avoid forking in celery workers
* add evidences for all datasets and metrics found in taxonomy * refactor evidence finding to EvidenceFinder * fix manual evidences for semantic segmentation metrics
Remove stop words from automatically generated evidences.
* plus some fixes
added 19 commits
February 17, 2020 17:35
* compute probabilities for each axis (tasks, datasets and metrics) independently * fix metric score extraction and conversion
* add abstract context * add table contexts consinsting of paragraphs referencing a given table * count evidences with repetitions * stop adding abbreviations as datasets evidences * fix passing paper context as string * add confidence to non-filtered linking metrics to analyze results * add threshold_map to make it easier to choose stable regions
Add a proposal with the best task, dataset and metric being choosen independently.
Chrome DOM dumping was introduced as a cleaning method when htlatex was used for LaTeX to html conversion. latexml gives much better results and html5lib is 3 times faster than running chrome image.
Due to previous mismatch between version of elastic search instance (6.7.1) and elasticsearch-dsl version (7.0.0) and the fact that saving a document in non-existent index creates an index inferred from the document, there's a mismatch between mapping type name. This commit makes it possible to downgrade elasticsearch-dsl to version compatible with elastic search 6.7.1 without a need for recreating the indexes.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.