Skip to content

Conversation

@jaidisido
Copy link
Contributor

Feature or Bugfix

  • Feature
  • Refactoring

Detail

  • Add recommendation and get APIs
  • Add tests
  • Refactor some methods in _utils

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@jaidisido jaidisido changed the title Add recommendation and get APIs (feat): Add recommendation and get APIs Dec 14, 2022
@jaidisido jaidisido requested a review from kukushking December 14, 2022 15:46
@jaidisido jaidisido self-assigned this Dec 14, 2022
Copy link
Contributor

@kukushking kukushking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@jaidisido jaidisido merged commit f4670ea into feat/glue-data-quality Dec 14, 2022
@jaidisido jaidisido deleted the feat/glue-data-quality-recommendation branch December 14, 2022 17:25
kukushking added a commit that referenced this pull request Dec 15, 2022
* Add data quality module.

* Remove copy-paste

* Refactor - create package, move ruleset evaluation utils to _utils

* [skip ci] Add data_quality.evaluate_ruleset(), result processing TBC

* [skip ci] Docstrings

* [skip ci] Return normalized evaluation results

* [skip ci] Add examples in docstrings && fix typing

* [skip ci] Minor - newlines

* [skip ci] Add Glue DQ IAM role to test infra

* [skip ci] Handle multiple rulesets && add client token

* [skip ci] Add update_ruleset

* [skip ci] Add pushdownPredicate test case

* [skip ci] Minor - add  to final statuses

* (feat): Add recommendation and get APIs (#1866)

* Add recommendation and get APIs

* Minor - revert conftest change

* Handle edge case in regex

* Add missing permission to data quality IAM role

* Add Glue Data Quality tutorial.

* [skip ci] Set number of workers to 2 to minimize charges

* Add more unit tests to increase coverage

Co-authored-by: jaidisido <jaidisido@gmail.com>
Co-authored-by: Leon Luttenberger <luttenberger.leon@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants