Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-16458: [CI][Python] Run dask S3 tests on nightly integration #13071

Closed
wants to merge 1 commit into from

Conversation

raulcd
Copy link
Member

@raulcd raulcd commented May 5, 2022

This PR adds coverage for running dask parquet tests that use S3 filesystem.

@github-actions
Copy link

github-actions bot commented May 5, 2022

@raulcd
Copy link
Member Author

raulcd commented May 5, 2022

@github-actions crossbow submit test-conda-python-3.9-dask-latest test-conda-python-3.9-dask-master

@github-actions
Copy link

github-actions bot commented May 5, 2022

Revision: d13a8ac

Submitted crossbow builds: ursacomputing/crossbow @ actions-2018

Task Status
test-conda-python-3.9-dask-latest Github Actions
test-conda-python-3.9-dask-master Github Actions

@raulcd
Copy link
Member Author

raulcd commented May 5, 2022

@jorisvandenbossche I think this is ready for review, the dask integration tests are passing now with the S3 tests enabled (it was the moto[server] dependency required instead of moto)

@jorisvandenbossche
Copy link
Member

Ah, good catch, thanks!

@ursabot
Copy link

ursabot commented May 9, 2022

Benchmark runs are scheduled for baseline = 9e9b2fe and contender = 860ce72. 860ce72 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.16% ⬆️0.0%] test-mac-arm
[Finished ⬇️0.36% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.91% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 860ce72c ec2-t3-xlarge-us-east-2
[Finished] 860ce72c test-mac-arm
[Finished] 860ce72c ursa-i9-9960x
[Finished] 860ce72c ursa-thinkcentre-m75q
[Finished] 9e9b2fec ec2-t3-xlarge-us-east-2
[Finished] 9e9b2fec test-mac-arm
[Finished] 9e9b2fec ursa-i9-9960x
[Finished] 9e9b2fec ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants