Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DPTOOLS-1805] Register to Pypi #2

Merged
merged 1 commit into from
Feb 14, 2019
Merged

[DPTOOLS-1805] Register to Pypi #2

merged 1 commit into from
Feb 14, 2019

Conversation

jinhyukchang
Copy link
Contributor

No description provided.

@jinhyukchang jinhyukchang merged commit 50cd555 into master Feb 14, 2019
@feng-tao feng-tao deleted the jinchang-pypi branch May 2, 2019 05:35
PabTorre pushed a commit to PabTorre/amundsendatabuilder that referenced this pull request May 29, 2020
* Migrate docker files, new auth doc, and examples + change somne references in thge installation doc

* Following tips from github IR resolution
ccarterlandis referenced this pull request in Gusto/amundsendatabuilder_contrib Aug 7, 2020
* wip demo data load

* wip ardoc

* gusto demo data loader with redshift and ardoc extractors

* move ardoc requirements to extras

* remove csv load data files until that portion is ready for primetime

* revert sample csv changes

* Add logging around table data being imported (#2)

* Add logging around table data being imported

* Follow loglevel convention

* remove address filter. point to edw

* get a clean run of ardoc/redshift. allow regex transformer to access nested/array attributes

* add tests for ardoc and redshift extractors. make args for gusto script

* extractor docs

* revert update-only neo4j publish option

* additional % to avoid escape sqlalchemy interpolation

Co-authored-by: Matthew Flood <54334980+mfloodgdp@users.noreply.github.com>
ccarterlandis referenced this pull request in Gusto/amundsendatabuilder_contrib Aug 7, 2020
* wip demo data load

* wip ardoc

* gusto demo data loader with redshift and ardoc extractors

* move ardoc requirements to extras

* remove csv load data files until that portion is ready for primetime

* revert sample csv changes

* Add logging around table data being imported (#2)

* Add logging around table data being imported

* Follow loglevel convention

* remove address filter. point to edw

* get a clean run of ardoc/redshift. allow regex transformer to access nested/array attributes

* extract table usage from redash and send to csv files

* seed column usage + user data for demo

* add tests for ardoc and redshift extractors. make args for gusto script

* extractor docs

* initial pass at using a job+transformer to convert redash query text

* create AggregateTask to allow for changing granularity on transform

* remove commented section

* revert update-only neo4j publish option

* additional % to avoid escape sqlalchemy interpolation

* implement AggregateTask + unit tests

Co-authored-by: Matthew Flood <54334980+mfloodgdp@users.noreply.github.com>
ccarterlandis referenced this pull request in Gusto/amundsendatabuilder_contrib Aug 7, 2020
* wip demo data load

* wip ardoc

* gusto demo data loader with redshift and ardoc extractors

* move ardoc requirements to extras

* remove csv load data files until that portion is ready for primetime

* revert sample csv changes

* Add logging around table data being imported (#2)

* Add logging around table data being imported

* Follow loglevel convention

* remove address filter. point to edw

* get a clean run of ardoc/redshift. allow regex transformer to access nested/array attributes

* add tests for ardoc and redshift extractors. make args for gusto script

* extractor docs

* revert update-only neo4j publish option

* additional % to avoid escape sqlalchemy interpolation

* Use sqlalchemy text to avoid problems with parameterless queries

* Tag 'sensitive' columns
Support tagging in general

* Tag tables containing 'senstive' columns as sensitive, for demo purposes.
Done in a separate commit so it's easy to revert if needed.

* Explicitly specify tag type

* change ardoc sensitive tag to badge so it will show in UI

Co-authored-by: Alex Levene <37639249+alevene@users.noreply.github.com>
Co-authored-by: Matthew Flood <54334980+mfloodgdp@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants