Merged
Conversation
Adds initial application structure
Adds test requirements. Tweaks mappings and transformers.
Adds coveragerc file
Updates files to correct linting errors.
Fixes linting
Adds tests and fixtures
Removes old pycache files.
Removes iso639, implements pycountry, updates requirements, and updates dependency actions.
Accidentally passed online_pending along in transformation.
Removes unnecessary logic
Fixes linting and ignores boolean at start of line warning in tox (this is a modern accepted practice).
Fixes transformer and test to actually use schemas (whoops).
Updates mappings and transformers to adhere strictly to old Pisces mappings as close as possible. Remove any normalization from transformers.
Implements functionality to get environment from ssm
Adds tests to cover more statements in transformers.
Updates test mappings. Removes old comment
Adds license and readme.
Tweaks transformer comments
Updates mapping tests to not call the environment import each function.
Cleans up deploy and gitignore and updates test_requirements
Fixes typo Co-authored-by: Hannah Sistrunk <hsistrunk@rockarch.org>
Fixes directory name of GitHub action workflows
Fixes sns client to make it not require AWS during CI.
Updates the transformers and associated tests to change the sns message format. Hopefully matches up with what the index expects.
Rework to read variables from ssm.
Updates the mappings.py file to remove some unnecessary `to_list` arguments. Makes some of the mappings helper function match old pisces functions better, and updates tests
Removes commented out code
Update to pass linting
Covers standalone helper functions
…/data_transform into refactor-pisces
Extends simplenamespace and uses it in tests
Use regular dicts for RecursiveNamespace
…space Extends simplenamespace
Refactor pisces
Sets SNS ROLE ARN as an env variable.
Updates transformer test suite to handle sns role as an environment variable.
Sns arn update
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overhaul to refactor Pisces as a lambda app for data_pipeline inclusion.