Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unpin dask/distributed for development #1319

Merged
merged 39 commits into from
Apr 15, 2024

Conversation

charlesbluca
Copy link
Collaborator

No description provided.

@codecov-commenter
Copy link

codecov-commenter commented Mar 19, 2024

Codecov Report

Attention: Patch coverage is 63.33333% with 11 lines in your changes are missing coverage. Please review.

Project coverage is 79.01%. Comparing base (7600f60) to head (207803b).

Files Patch % Lines
dask_sql/physical/rel/logical/table_scan.py 16.66% 4 Missing and 1 partial ⚠️
dask_sql/context.py 62.50% 1 Missing and 2 partials ⚠️
dask_sql/physical/utils/filter.py 0.00% 2 Missing ⚠️
dask_sql/physical/rel/logical/filter.py 0.00% 0 Missing and 1 partial ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1319      +/-   ##
==========================================
- Coverage   85.47%   79.01%   -6.47%     
==========================================
  Files          77       77              
  Lines        4242     4237       -5     
  Branches      790      792       +2     
==========================================
- Hits         3626     3348     -278     
- Misses        448      742     +294     
+ Partials      168      147      -21     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@jdye64 jdye64 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine @charlesbluca I say we merge it.

@@ -61,4 +63,4 @@ conda config --show-sources
conda list --show-channel-urls

rapids-logger "Python py.test for dask-sql"
py.test $WORKSPACE -n 4 -v -m gpu --runqueries --rungpu --junitxml="$WORKSPACE/junit-dask-sql.xml" --cov-config="$WORKSPACE/.coveragerc" --cov=dask_sql --cov-report=xml:"$WORKSPACE/dask-sql-coverage.xml" --cov-report term
py.test $WORKSPACE -n $PARALLEL_LEVEL -v -m gpu --runqueries --rungpu --junitxml="$WORKSPACE/junit-dask-sql.xml" --cov-config="$WORKSPACE/.coveragerc" --cov=dask_sql --cov-report=xml:"$WORKSPACE/dask-sql-coverage.xml" --cov-report term
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, good change.

Cargo.toml Outdated
@@ -6,7 +6,7 @@ description = "Bindings for DataFusion used by Dask-SQL"
readme = "README.md"
license = "Apache-2.0"
edition = "2021"
rust-version = "1.72"
rust-version = "1.73"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All for bumping! Just for my own knowledge was this a requirement or just doing it because it has been awhile? Either way is fine and this blocks nothing just want to know.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I actually just did this to try and triage some issues we've been seeing in the aarch64 builds around hash mismatches?

https://github.com/dask-contrib/dask-sql/actions/runs/8437291358/job/23106757782

The errors in that run seemed to imply that there was something wrong with the rust 1.72 packages, but actually it turns out that this seems to be an issue with newer versions of conda-build (and/or boa), looks like 9f32482 unblocked the builds

@charlesbluca charlesbluca enabled auto-merge (squash) April 10, 2024 20:46
@charlesbluca charlesbluca merged commit 0540813 into dask-contrib:main Apr 15, 2024
36 checks passed
Copy link
Contributor

@jakirkham jakirkham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Charles! 🙏

@@ -76,7 +76,7 @@ jobs:
channel-priority: strict
- name: Install dependencies
run: |
mamba install -c conda-forge boa conda-verify
mamba install -c conda-forge "boa<0.17" "conda-build<24.1" conda-verify
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be interested to know what issue this constraint was addressing

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We were getting some errors on the aarch64 builds in particular around hash mismatches:

conda.CondaMultiError: Conda detected a mismatch between the expected content and downloaded content

https://github.com/dask-contrib/dask-sql/actions/runs/8637144317/job/23678689751

I've been wanting to put some time down to get a simple reproducer together but haven't yet 😕 though if you're interested I could open a PR pinning to the boa/conda-build versions used in the run above to reproduce the failures in CI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants