Updates to Schema, Tests, Workers, Documentation #1848
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Biki Das <bikid475@gmail.com>
```
2022-04-14 17:10:28,581,581ms [PID: 984587] workers.pull_request_worker.50471 [DEBUG] Extracting data from source in pr model. ERROR: invalid literal for int() with base 10: '909941810.0'
Traceback (most recent call last):
File "/bigdisk/augur-vmware/workers/pull_request_worker/pull_request_worker.py", line 554, in pk_source_increment_insert
prs_insert = [
File "/bigdisk/augur-vmware/workers/pull_request_worker/pull_request_worker.py", line 558, in <listcomp>
'pr_src_id': int(str(pr['id']).encode(encoding='UTF-8').decode(encoding='UTF-8')),#1-22-2022 inconsistent casting; sometimes int, sometimes float in bulk_insert
ValueError: invalid literal for int() with base 10: '909941810.0'
2022-04-14 17:10:28,581,581ms [PID: 984587] workers.pull_request_worker.50471 [INFO] 0 insertions are needed and 0 updates are needed for pull_requests
2022-04-14 17:10:28,581,581ms [PID: 984587] workers.pull_request_worker.50471 [INFO] Preparing to enrich data.
2022-04-14 19:07:07,129,129ms [PID: 984587] workers.pull_request_worker.50471 [DEBUG] Extracting data from source in pr model. ERROR: 'cntrb_id'
Traceback (most recent call last):
File "/bigdisk/augur-vmware/workers/pull_request_worker/pull_request_worker.py", line 554, in pk_source_increment_insert
prs_insert = [
File "/bigdisk/augur-vmware/workers/pull_request_worker/pull_request_worker.py", line 572, in <listcomp>
int(pr['cntrb_id']) ## cast as an int because of an otherwise inexplicable error.
KeyError: 'cntrb_id'
2022-04-14 19:07:07,130,130ms [PID: 984587] workers.pull_request_worker.50471 [INFO] 0 insertions are needed and 0 updates are needed for pull_requests
2022-04-14 19:07:07,130,130ms [PID: 984587] workers.pull_request_worker.50471 [INFO] Preparing to enrich data.
```
Added literal syntax to create the data structure
Update quick-start.rst
removed unecessary schema build scripts.
augur_new_contributors preserves all the prior data used in the visualization API, but removes repo_id parameter. The materialized view performs 89 times faster, @andrewbrain
Signed-off-by: Sean Goggins <outdoors@acm.org>
… the worker. This reverts commit 335e279.
sgoggins
added
installation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Updates tested and functional.