-
Notifications
You must be signed in to change notification settings - Fork 564
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI: Speeding up conda solver time by removing pymapd and pinning some packages #2193
CI: Speeding up conda solver time by removing pymapd and pinning some packages #2193
Conversation
let’s remove pymapd entirely for now this broke a lot of things |
Removed the dependency here, so we can see the change in the solver speed in the CI for now. I guess we need to disable the backend from the tests too. Anything else? |
…rinting requirements file
@jreback this solves the main issue with the conda solver being too slow. The remaining errors are the ones caused by not having enough space in disk. And seems like the If we can get this merged, that would be very helpful. So, I can finish the disk space problems without conda being too slow. Thanks! |
thanks @datapythonista IIRC @xmnlab has some patches for the image size. though maybe we just want to split the testing in 2 |
I'm testing on splitting the builds in two in #2194, and seems quite simple. Will re-run now that PR with this fixed, and see how it looks. I think just two are missing if we go for the splitting approach:
|
xref #2181
Running
conda env create --name ibis-dev --file ci/requirements-3.7-dev.yml
is currently taking 36 minutes (for the conda solver). This causes the builds to reach the 1 hour limit and fail (the docs, benchmarks and conda build builds).Pinning
pymapd
reduces the time to to 20 minutes (from the 36). We still need a better solution (20 minutes for the solver is crazy), but at least this should fix the CI in an easy way for now.