Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] DataAssistantResult Includes Underlying Profiler Execution Time #4854

Conversation

alexsherstinsky
Copy link
Contributor

@alexsherstinsky alexsherstinsky commented Apr 13, 2022

Scope

  • Update the measure_execution_time utility (developed a significant time ago) to call back with results (not just print).
  • Use @measure_execution_time on running profiler for DataAsset classes.
  • Include assertion on DataAssistantResult.execution_time in test of VolumeDataAssistant subclass.

Please annotate your PR title to describe what the PR does, then give a brief bulleted description of your PR below. PR titles should begin with [BUGFIX], [FEATURE], [DOCS], or [MAINTENANCE]. If a new feature introduces breaking changes for the Great Expectations API or configuration files, please also add [BREAKING]. You can read about the tags in our contributor checklist.

Changes proposed in this pull request:

  • JIRA: GREAT-735/GREAT-783

After submitting your PR, CI checks will run and @ge-cla-bot will check for your CLA signature.

For a PR with nontrivial changes, we review with both design-centric and code-centric lenses.

In a design review, we aim to ensure that the PR is consistent with our relationship to the open source community, with our software architecture and abstractions, and with our users' needs and expectations. That review often starts well before a PR, for example in github issues or slack, so please link to relevant conversations in notes below to help reviewers understand and approve your PR more quickly (e.g. closes #123).

Previous Design Review notes:

Definition of Done

Please delete options that are not relevant.

  • My code follows the Great Expectations style guide
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have added unit tests where applicable and made sure that new and existing tests are passing.
  • I have run any local integration tests and made sure that nothing is broken.

Thank you for submitting!

@netlify
Copy link

netlify bot commented Apr 13, 2022

Deploy Preview for niobium-lead-7998 ready!

Name Link
🔨 Latest commit c7b9cb5
🔍 Latest deploy log https://app.netlify.com/sites/niobium-lead-7998/deploys/625646fd20cb510009e3cd29
😎 Deploy Preview https://deploy-preview-4854--niobium-lead-7998.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

Copy link
Contributor

@Shinnnyshinshin Shinnnyshinshin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you sir!

Alex Sherstinsky added 5 commits April 12, 2022 18:52
…ky/rule_based_profiler/data_assistant_result_should_include_profiler_run_duration-2022_04_12-90
@alexsherstinsky alexsherstinsky merged commit 094ebbf into develop Apr 13, 2022
@alexsherstinsky alexsherstinsky deleted the feature/GREAT-735/GREAT-783/alexsherstinsky/rule_based_profiler/data_assistant_result_should_include_profiler_run_duration-2022_04_12-90 branch April 13, 2022 04:33
Shinnnyshinshin pushed a commit that referenced this pull request Apr 13, 2022
…_expectations into develop

* 'develop' of https://github.com/great-expectations/great_expectations:
  [FEATURE] DataAssistantResult Includes Underlying Profiler Execution Time (#4854)
  [MAINTENANCE] Refactor `Datasource` tests that work with `RuntimeDataConnector` by backend.  (#4853)
  [MAINTENANCE] Update testing and documentation for `oneshot` estimation method (#4852)
  Use engine.dialect.name instead of dialect.name (#4476)
  Fix bug in unexpected count metric for empty tables (#4618)
  [FEATURE] Add Support for Returning Parameters and Metrics as DataAssistantResult class (#4848)
  [DOCS] Add example to expectation docstring (#4341)
  - Adds redirect for legacy doc that was overlooked in the original redirects list (closes DEVREL-1866) (#4846)
Shinnnyshinshin pushed a commit that referenced this pull request Apr 13, 2022
…connector-assets-added

* develop:
  [FEATURE] DataAssistantResult Includes Underlying Profiler Execution Time (#4854)
  [MAINTENANCE] Refactor `Datasource` tests that work with `RuntimeDataConnector` by backend.  (#4853)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants