-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEATURE] Provide ability for DataAssistant to return its effective underlying BaseRuleBasedProfiler configuration #5359
Conversation
…4/GREAT-999/alexsherstinsky/rule_based_profiler/data_assistant/data_assistant_result/move_getting_expectation_suite_to_expectation_suite_class-2022_06_15-170
…/alexsherstinsky/rule_based_profiler/remove_json_serialize_directive_and_add_raw_parameter_builder_computation_results_to_json_serialized_results-2022_06_15-170
…/alexsherstinsky/rule_based_profiler/remove_json_serialize_directive_and_add_raw_parameter_builder_computation_results_to_json_serialized_results-2022_06_15-170
…/alexsherstinsky/rule_based_profiler/remove_json_serialize_directive_and_add_raw_parameter_builder_computation_results_to_json_serialized_results-2022_06_15-170
…ror-changelog' into maintenance/GREAT-467/GREAT-464/GREAT-999/alexsherstinsky/rule_based_profiler/remove_json_serialize_directive_and_add_raw_parameter_builder_computation_results_to_json_serialized_results-2022_06_15-170
…ky/rule_based_profiler/remove_json_serialize_directive_and_add_raw_parameter_builder_computation_results_to_json_serialized_results-2022_06_15-170' into pre_pr-prototype/maintenance/GREAT-467/GREAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…exsherstinsky/rule_based_profiler/enable_numeric_metric_range_multibatch_parameter_builder_to_use_evaluation_dependencies-2022_06_16-171
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…rule_based_profiler/enable_numeric_metric_range_multibatch_parameter_builder_to_use_evaluation_dependencies-2022_06_16-171' into pre_pr-prototype/maintenance/GREAT-467/GREAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…/maintenance/GREAT-467/GREAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…lder throughout the codebase.
…lder throughout the codebase.
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…/maintenance/GREAT-467/GREAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…EAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
…/maintenance/GREAT-467/GREAT-464/GREAT-1000/alexsherstinsky/rule_based_profiler/data_assistant/onboarding_data_assistant/performance_improvements-2022_06_15-171
✅ Deploy Preview for niobium-lead-7998 ready!
To edit notification comments on pull requests, go to your Netlify site settings. |
👇 Click on the image for a new way to code review
Legend |
rules: name/(configuration-dictionary) to modify using "runtime_environment" | ||
kwargs: additional/override directives supplied at runtime | ||
batch_request: Explicit batch_request used to supply data at runtime | ||
kwargs: additional/override directives supplied at runtime (using "runtime_environment") | ||
"kwargs" directives structure: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very helpful to include this. Thank you Alex
CARDINALITY_LIMIT_MODE = "cardinality_limit_mode" | ||
MAX_UNIQUE_VALUES = "max_unique_values" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure if I missed this, but I was wondering if these values were actually used in this PR.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@Shinnnyshinshin this is for runtime_environment
(the kwargs
into DataAssistant.run()
. Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved, with one question :)
…based_profiler/data_assistant/provide_ability_to_obtain_defined_effective_underlying_rule_based_profiler_configuration-2022_06_21-178
…-context-logict-abstract * develop: [MAINTENANCE] Move `_apply_global_config_overrides()` to AbstractDataContext (#5285) chore: update linter thresholds (#5367) [MAINTENANCE] Reduce output amount in Jupyter notebooks when displaying DataAssistantResult (#5362) [RELEASE] 0.15.11 (#5361) chore: update gh action (#5363) [MAINTENANCE] Include only essential public methods in DataAssistantResult class (and its descendants) (#5360) [FEATURE] Provide ability for DataAssistant to return its effective underlying BaseRuleBasedProfiler configuration (#5359) [FEATURE] Update `add_datasource` to leverage the `DatasourceStore` (#5334)
Scope
By returning
JSON
configuration of its underlying Rule-Based Profiler by aDataAssistant
, it becomes possible to introspect thisJSON
structure and determineruntime-environment
overrides programmatically.Usage Example:
By default ,
JSON
-formatted structure is returned. Other available formats are as perConfigOutputModes
ingreat_expectations/core/config_peer.py
.Please annotate your PR title to describe what the PR does, then give a brief bulleted description of your PR below. PR titles should begin with [BUGFIX], [FEATURE], [DOCS], or [MAINTENANCE]. If a new feature introduces breaking changes for the Great Expectations API or configuration files, please also add [BREAKING]. You can read about the tags in our contributor checklist.
Changes proposed in this pull request:
After submitting your PR, CI checks will run and @cla-bot will check for your CLA signature.
For a PR with nontrivial changes, we review with both design-centric and code-centric lenses.
In a design review, we aim to ensure that the PR is consistent with our relationship to the open source community, with our software architecture and abstractions, and with our users' needs and expectations. That review often starts well before a PR, for example in github issues or slack, so please link to relevant conversations in notes below to help reviewers understand and approve your PR more quickly (e.g.
closes #123
).Previous Design Review notes:
Definition of Done
Please delete options that are not relevant.
Thank you for submitting!