This repository has been archived by the owner on Aug 18, 2021. It is now read-only.
Indexing improvements #248
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- changed from version 2.0.0 to 2.0.1
- Changed esAlias to status from repos - Added the use of IndexOptimizer, AliasSwapper, and IndexCleaner - Status report is now in its own index.
- Status document is now in its own index - status - Added init function. This makes the code similar to that of the other indexers. - Added logger to constructor.
seanstar12
pushed a commit
to seanstar12/code-gov-api
that referenced
this pull request
Aug 27, 2019
Reduction in test coverage is being accepted. The harvesting code is to be extracted in the next couple of sprints. the testing of that code will be done in version 2 of [code-gov-harvester](https://github.com/gsa/code-gov-harvester). * Changed index mapping version for repos index - changed from version 2.0.0 to 2.0.1 * Refactor indexReport function - Changed esAlias to status from repos - Added the use of IndexOptimizer, AliasSwapper, and IndexCleaner - Status report is now in its own index. * Status enpoint now searches the status index * Add more robust index functionality - Status document is now in its own index - status - Added init function. This makes the code similar to that of the other indexers. - Added logger to constructor. * Made callback in init function optional * Most recent data from harvester * Added bunyan to npm scripts * Added index.mapping.total_fields.limit to settings for status index
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Improvements to our indexing flow and separation or repos and status indexes.
Explain the motivation for making this change. What existing problem does the pull request solve?
Help future proof the harvesting process against Elasticsearch updates.
Test plan (required)
Demonstrate the code is solid. Example: The exact commands you ran and their output, screenshots / videos if the pull request changes UI.