-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run on Lithops AWS #7
Conversation
@@ -2,7 +2,7 @@ channels: | |||
- conda-forge | |||
dependencies: | |||
|
|||
- python >=3.9 | |||
- python >=3.9,<=3.11 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Lithops doesn't run on 3.12 yet.
|
||
cubed.visualize( | ||
*(result[var].data for var in ("anom_u", "anom_v", "uv")), | ||
filename=tmp_path / f"quadratic_means_xarray_{t_length}-unoptimized", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Writes to pytest's temp directory
Wait 66 seconds for |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great!
Xarray is pinned due to namedarray changes
I can go and look into this
That's right. This is running on AWS though - I have noticed that GCP can be several times slower (I dont know why), but still a lot faster than when you first ran the benchmarks. |
Thanks! |
I had to install the following packages (Xarray is pinned due to namedarray changes):
pip install pytest-xdist filelock 'xarray==2023.10.0' cubed_xarray lithops rich pydot s3fs
Then I could run some tests on Lithops:
Note that Pytest
-s
option enables the Cubed's Rich progress bars, which is helpful when running a computation interactively.