Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MAINTENANCE] Remove URN support #9886

Merged
merged 7 commits into from
May 7, 2024
Merged

Conversation

tyler-hoffman
Copy link
Contributor

@tyler-hoffman tyler-hoffman commented May 6, 2024

Overview

This removes anything urn-related, which trickled down into deleting a couple more methods that weren't obvious from their names / that they were urn-related.

Summary of non-obvious methods that were deleted (Please double check me!)

  • suite.get_suite_parameter_dependencies: returned a dict built from configuration.get_suite_parameter_dependencies
  • configuration.get_suite_parameter_dependencies : called find_suite_parameter_dependencies on all eval params, but then we only used urns from it
  • find_suite_parameter_dependencies: only used by ^
  • store_suite_parameters : only used by tests
    _compile_suite_parameter_dependencies: used results of suite.get_suite_parameter_dependencies , which was just urn logic
  • metric_store.get_bind_params: all keys were by urn
  • Description of PR changes above includes a link to an existing GitHub issue
  • PR title is prefixed with one of: [BUGFIX], [FEATURE], [DOCS], [MAINTENANCE], [CONTRIB]
  • Code is linted - run invoke lint (uses ruff format + ruff check)
  • Appropriate tests and docs have been updated

For more information about contributing, see Contribute.

After you submit your PR, keep the page open and monitor the statuses of the various checks made by our continuous integration process at the bottom of the page. Please fix any issues that come up and reach out on Slack if you need help. Thanks for contributing!

Copy link

netlify bot commented May 6, 2024

Deploy Preview for niobium-lead-7998 canceled.

Name Link
🔨 Latest commit 59aa037
🔍 Latest deploy log https://app.netlify.com/sites/niobium-lead-7998/deploys/663942e7f6701a0008e20a29

Copy link

codecov bot commented May 6, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.77%. Comparing base (db080d4) to head (59aa037).

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #9886      +/-   ##
===========================================
- Coverage    77.99%   77.77%   -0.23%     
===========================================
  Files          495      494       -1     
  Lines        42539    42399     -140     
===========================================
- Hits         33178    32974     -204     
- Misses        9361     9425      +64     
Flag Coverage Δ
3.10 64.23% <80.00%> (+0.01%) ⬆️
3.10 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds ?
3.10 aws_deps ?
3.10 big ?
3.10 databricks ?
3.10 filesystem ?
3.10 mssql ?
3.10 mysql ?
3.10 postgresql ?
3.10 snowflake ?
3.10 trino ?
3.11 64.23% <80.00%> (+0.01%) ⬆️
3.11 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds 53.98% <40.00%> (+0.12%) ⬆️
3.11 aws_deps 44.88% <40.00%> (+0.09%) ⬆️
3.11 big 55.85% <80.00%> (+0.11%) ⬆️
3.11 databricks 46.06% <40.00%> (+0.09%) ⬆️
3.11 filesystem 60.80% <60.00%> (-0.36%) ⬇️
3.11 mssql 48.86% <60.00%> (+0.09%) ⬆️
3.11 mysql 48.92% <60.00%> (+0.09%) ⬆️
3.11 postgresql 52.76% <60.00%> (+0.01%) ⬆️
3.11 snowflake 46.66% <40.00%> (+0.09%) ⬆️
3.11 spark 57.27% <80.00%> (+0.10%) ⬆️
3.11 trino 50.84% <60.00%> (+0.09%) ⬆️
3.8 64.25% <80.00%> (+0.01%) ⬆️
3.8 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds 53.99% <40.00%> (+0.12%) ⬆️
3.8 aws_deps 44.89% <40.00%> (+0.09%) ⬆️
3.8 big 55.86% <80.00%> (+0.11%) ⬆️
3.8 databricks 46.07% <40.00%> (+0.09%) ⬆️
3.8 filesystem 60.82% <60.00%> (-0.36%) ⬇️
3.8 mssql 48.84% <60.00%> (+0.09%) ⬆️
3.8 mysql 48.90% <60.00%> (+0.09%) ⬆️
3.8 postgresql 52.74% <60.00%> (+0.01%) ⬆️
3.8 snowflake 46.68% <40.00%> (+0.09%) ⬆️
3.8 spark 57.23% <80.00%> (+0.10%) ⬆️
3.8 trino 50.82% <60.00%> (+0.09%) ⬆️
3.9 64.24% <80.00%> (+0.01%) ⬆️
3.9 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds ?
3.9 aws_deps ?
3.9 big ?
3.9 databricks ?
3.9 filesystem ?
3.9 mssql ?
3.9 mysql ?
3.9 postgresql ?
3.9 snowflake ?
3.9 spark ?
3.9 trino ?
cloud 0.00% <0.00%> (ø)
docs-basic 48.90% <40.00%> (-0.20%) ⬇️
docs-creds-needed 50.34% <40.00%> (+0.11%) ⬆️
docs-spark 48.42% <40.00%> (+0.10%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@tyler-hoffman tyler-hoffman requested a review from cdkini May 6, 2024 21:30
@@ -413,30 +325,9 @@ def parse_suite_parameter( # noqa: C901, PLR0912, PLR0915

elif len(parse_results) == 0 or parse_results[0] != "Parse Failure":
# we have a stack to evaluate and there was no parse failure.
# iterate through values and look for URNs pointing to a store:
for i, ob in enumerate(EXPR.exprStack):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a for/else statement? Just confirming - is that intended or do we have a mis-indentation?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks to me like this was not and is now not a for/else loop. So pretty sure this is as intended, and no change in behavior other than not doing url stuff. The else block looks to be matched in terms of logic with the elif, and also I'd expect to see a break in an for/else, otherwise the else isn't doing anything special. Going to merge, but if any of that rings false to you, LMK and I'll revert!

@tyler-hoffman tyler-hoffman added this pull request to the merge queue May 7, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks May 7, 2024
@tyler-hoffman tyler-hoffman added this pull request to the merge queue May 7, 2024
Merged via the queue into develop with commit 86a5862 May 7, 2024
68 checks passed
@tyler-hoffman tyler-hoffman deleted the m/v1-60/remove-urn-support branch May 7, 2024 01:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants