Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENHANCEMENT] CLI global options and checkpoint functionality for v3 api #2497

Merged
merged 7,179 commits into from Mar 4, 2021

Conversation

anthonyburdi
Copy link
Member

Here are the items contained in this PR:

  • Added --v2-api/--v3-api flag
  • Added --config
  • Deprecated suite demo datasource profile
  • All Checkpoint verbs for both api versions
  • Usage stats schema and events updated
  • Tests for all of the above

anthonyburdi and others added 30 commits February 16, 2021 18:13
#2418)

* Modifying getting started content to use CSV and update to work with new Checkpoints
…checkpoints-02_15_2021_1

CLI Checkpoints List functionality.
…checkpoints-02_15_2021_1

CLI Checkpoints List functionality.
Co-authored-by: Taylor Miller <Aylr@users.noreply.github.com>
The name of the data source can't be present for the method to work

Co-authored-by: Eugene Mandel <eugene.mandel@gmail.com>
Copy link
Contributor

@alexsherstinsky alexsherstinsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alexsherstinsky
Copy link
Contributor

@anthonyburdi Please DO NOT MERGE until PR https://github.com/great-expectations/great_expectations/pull/2499 is approved and merged into the present working branch. Thank you! /cc @Aylr @roblim

Copy link
Member

@roblim roblim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is AWESOME! Didn't do a code review deep dive - mostly exercised the new Checkpoint functionality for --v3-api and that worked great using the tmp_cli_uat repo. Just had a few minor comments, which might be just from my newb understanding of the new CLI architecture changes.

Regarding "Deprecated suite demo datasource profile", just confirming that this is just for --v3-api - got confused for a minute since CLI defaults to --v2-api for now.

datasources paired with one or more Expectation Suites each.
"""
pass
directory: str = toolkit.parse_cli_config_file_location(
config_file_location=ctx.obj.config_file_location
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oooo - state! Neat!

"project",
"store",
"suite",
"validation_operator",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't validation_operator be nixed here? Otherwise, we should add it to the general CLI help since it doesn't appear there (and it still works - list, run)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Aylr will have more detail here and please correct me if I'm wrong, but basically we still need validation_operator here to make sure that the old API can still access it, and we also need a stub validation_operator.py file with just validation_operator = None in it so it is found when click is looking for available commands. As for versioning the help text - I know @Aylr was working on that as well, I think we just haven't found a great solution there yet.

@anthonyburdi
Copy link
Member Author

This is AWESOME! Didn't do a code review deep dive - mostly exercised the new Checkpoint functionality for --v3-api and that worked great using the tmp_cli_uat repo. Just had a few minor comments, which might be just from my newb understanding of the new CLI architecture changes.

Regarding "Deprecated suite demo datasource profile", just confirming that this is just for --v3-api - got confused for a minute since CLI defaults to --v2-api for now.

Thank you for your comment and for reviewing!! Correct! suite demo and datasource profile are only deprecated / removed for --v3-api and have not changed for --v2-api (which is the default).

alexsherstinsky and others added 2 commits March 4, 2021 16:38
* Checkpoints fixes.

* Typo.

* Fix name of a test method to match its purpose.

* Fixing Checkpoint runtime parameter processing and updating corresponding tests.

* Fixing Checkpoint runtime parameter processing and updating corresponding tests.
@Aylr Aylr merged commit 1b2a809 into develop Mar 4, 2021
@Aylr Aylr deleted the cli_develop_for_merge_with_oss_develop branch March 4, 2021 22:05
peterdhansen pushed a commit to peterdhansen/great_expectations that referenced this pull request Mar 8, 2021
…api (great-expectations#2497)

- Added `--v2-api/--v3-api flag`
- Added `--config` as global option
- Deprecated `suite demo` `datasource profile`
- All Checkpoint verbs for both api versions
- Usage stats schema and events updated
- Tests for all of the above
peterdhansen pushed a commit to peterdhansen/great_expectations that referenced this pull request Mar 29, 2021
…api (great-expectations#2497)

- Added `--v2-api/--v3-api flag`
- Added `--config` as global option
- Deprecated `suite demo` `datasource profile`
- All Checkpoint verbs for both api versions
- Usage stats schema and events updated
- Tests for all of the above
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants