Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MAINTENANCE] Instrument validation workflows #9889

Merged
merged 10 commits into from
May 8, 2024

Conversation

cdkini
Copy link
Member

@cdkini cdkini commented May 7, 2024

Add analytics to checkpoint and validation definition factories (parity with existing suite factory).

  • Description of PR changes above includes a link to an existing GitHub issue
  • PR title is prefixed with one of: [BUGFIX], [FEATURE], [DOCS], [MAINTENANCE], [CONTRIB]
  • Code is linted - run invoke lint (uses ruff format + ruff check)
  • Appropriate tests and docs have been updated

For more information about contributing, see Contribute.

After you submit your PR, keep the page open and monitor the statuses of the various checks made by our continuous integration process at the bottom of the page. Please fix any issues that come up and reach out on Slack if you need help. Thanks for contributing!

@cdkini cdkini self-assigned this May 7, 2024
Copy link

netlify bot commented May 7, 2024

Deploy Preview for niobium-lead-7998 ready!

Name Link
🔨 Latest commit 166d19f
🔍 Latest deploy log https://app.netlify.com/sites/niobium-lead-7998/deploys/663b76f2cd44440008f2a87d
😎 Deploy Preview https://deploy-preview-9889.docs.greatexpectations.io
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

codecov bot commented May 7, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.96%. Comparing base (f0fa7a9) to head (166d19f).

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #9889      +/-   ##
===========================================
+ Coverage    77.94%   77.96%   +0.02%     
===========================================
  Files          493      493              
  Lines        42432    42479      +47     
===========================================
+ Hits         33073    33120      +47     
  Misses        9359     9359              
Flag Coverage Δ
3.10 64.36% <100.00%> (+0.03%) ⬆️
3.10 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds ?
3.10 aws_deps ?
3.10 big ?
3.10 databricks ?
3.10 filesystem ?
3.10 mssql ?
3.10 mysql ?
3.10 postgresql ?
3.10 snowflake ?
3.10 spark ?
3.10 trino ?
3.11 64.36% <100.00%> (+0.03%) ⬆️
3.11 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds 54.12% <78.00%> (+0.02%) ⬆️
3.11 aws_deps 45.03% <68.00%> (+0.03%) ⬆️
3.11 big 55.99% <74.00%> (+0.02%) ⬆️
3.11 databricks 46.22% <78.00%> (+0.03%) ⬆️
3.11 filesystem 60.96% <98.00%> (+0.04%) ⬆️
3.11 mssql 49.00% <68.00%> (+0.02%) ⬆️
3.11 mysql 49.06% <68.00%> (+0.02%) ⬆️
3.11 postgresql 52.90% <78.00%> (+0.03%) ⬆️
3.11 snowflake 46.82% <78.00%> (+0.04%) ⬆️
3.11 spark 57.50% <78.00%> (+0.02%) ⬆️
3.11 trino 50.98% <78.00%> (+0.03%) ⬆️
3.8 64.39% <100.00%> (+0.03%) ⬆️
3.8 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds 54.13% <78.00%> (+0.02%) ⬆️
3.8 aws_deps 45.04% <68.00%> (+0.03%) ⬆️
3.8 big 56.00% <74.00%> (+0.02%) ⬆️
3.8 databricks 46.23% <78.00%> (+0.03%) ⬆️
3.8 filesystem ?
3.8 mssql 48.98% <68.00%> (+0.02%) ⬆️
3.8 mysql 49.04% <68.00%> (+0.02%) ⬆️
3.8 postgresql 52.89% <78.00%> (+0.03%) ⬆️
3.8 snowflake 46.84% <78.00%> (+0.03%) ⬆️
3.8 spark 57.46% <78.00%> (+0.02%) ⬆️
3.8 trino 50.97% <78.00%> (+0.03%) ⬆️
3.9 64.38% <100.00%> (+0.03%) ⬆️
3.9 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds ?
3.9 aws_deps ?
3.9 big ?
3.9 databricks ?
3.9 filesystem ?
3.9 mssql ?
3.9 mysql ?
3.9 postgresql ?
3.9 spark ?
3.9 trino ?
cloud 0.00% <0.00%> (ø)
docs-basic 49.05% <68.00%> (+0.02%) ⬆️
docs-creds-needed 50.48% <68.00%> (+0.02%) ⬆️
docs-spark 48.56% <68.00%> (+0.02%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Comment on lines 48 to 54
obj = self._get(key=key)

submit_event(
event=CheckpointCreatedEvent(
checkpoint_id=obj.id,
)
)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This currently round trips so the actual object is different - a subtle difference from other stores (that might directly add the ID to the input object)

Copy link
Contributor

@billdirks billdirks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have to run out the door. I've looked through the non-test files and they look good. I had a small naming comment. I'll finish the review tomorrow.

great_expectations/core/factory/checkpoint_factory.py Outdated Show resolved Hide resolved
@cdkini cdkini added this pull request to the merge queue May 8, 2024
Merged via the queue into develop with commit 67fc9cc May 8, 2024
68 checks passed
@cdkini cdkini deleted the m/v1-196/validation_workflows_instrumentation branch May 8, 2024 17:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants