REFACTOR: Changed Data Model for storing data in Database #4
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Owner
ishaan812
commented
Jul 26, 2023
ishaan812
commented
- Added Fields to the Schema
- Added Sha hash as unique id to store the field
- Added Connection to ElasticSearch - Added 2 API's - /ping and /passive - Keyword Search using /passive - Added Storing to DB capability when using /search
-added error handling for passivesearch api endpoint
- Changed ElasticSearch Search type to Simple Query String
-Made Active Search make better use of downtimes (Rate Limits or Validation Downtime)
-Fixed errors with parrallel processing
- Added RootQuery as an optional query param for activesearch which basically takes out the prompt builder and takes a raw query to look for in Github API. - Added Python SeedScript
- Added other fields like LastUpdated, ETAG, URL, LastModified to Schema. - Added SHA hash as the unique parameter to not allow duplicates in the database
|
Dont delete branch if merging |
- Changed console.log to console.info / console.error
-Added PUT /database endpoint for updating the database - Changed name of the endpoints - Commented Database Trace Logs
- Fixed GetFileContents - Added Global variables for EsClient and Octokit for easy access and clean code - Better logs
- Update API Refactored
- Better API Naming - Fixed Update API
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.