Skip to content

Pangeo ML Ecosystem blog post #625

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Apr 3, 2024

Conversation

weiji14
Copy link
Member

@weiji14 weiji14 commented Nov 2, 2023

Based on my recent FOSS4G SotM Oceania 2023 talk (slides at https://hackmd.io/@weiji14/foss4g2023oceania).

Preview at https://xarray-dev-git-fork-weiji14-pangeo-ml-ecosystem-2023-xarray.vercel.app/blog/pangeo-ml-ecosystem-2023

TODO:

  • Initial draft
  • Expand on high-level Pangeo ML libraries
  • Write a summary
  • Add funding sources

Initial draft with an overview, description of the Pangeo Machine Learning stack, where to learn more, acknowledgements and appendix.
Copy link

vercel bot commented Nov 2, 2023

@weiji14 is attempting to deploy a commit to the xarray Team on Vercel.

A member of the Team first needs to authorize it.

Copy link
Member Author

@weiji14 weiji14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Putting this draft out first, but will probably publish after @negin513's cupy-xarray blog post is published (#614). Happy to chat about it during the Pangeo ML Working Group meeting next Tuesday if folks are around!

Add sentence about SpatioTemporal Asset Catalogs in the cloud-native geospatial file formats subsection, and some minor edits.
Copy link

vercel bot commented Nov 2, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
xarray-dev ✅ Ready (Inspect) Visit Preview 💬 Add feedback Apr 3, 2024 5:55pm

Finish writing about cupy-xarray/kvikIO, xbatcher and zen3geo, plus a summary. Also added the zen3geo Pangeo ML Working Group presentation to the further reading Appendix section.
@weiji14
Copy link
Member Author

weiji14 commented Nov 14, 2023

Could someone authorize the Vercel preview please 🙏 Also, this blog post is ready for proofreading!

@andersy005
Copy link
Member

Could someone authorize the Vercel preview please 🙏 Also, this blog post is ready for proofreading!

Done!

@weiji14 weiji14 marked this pull request as ready for review December 13, 2023 01:41
@weiji14
Copy link
Member Author

weiji14 commented Jan 17, 2024

Updated post date to 2024. Anyone free to review this blog post?

@TomNicholas
Copy link
Member

I wonder if @jhamman 's upcoming talk at AMS on "A New Cloud Optimized Dataloader for Modern ML Applications" will mean adding something new to this post...

@weiji14
Copy link
Member Author

weiji14 commented Jan 18, 2024

I wonder if @jhamman 's upcoming talk at AMS on "A New Cloud Optimized Dataloader for Modern ML Applications" will mean adding something new to this post...

Yeah, it's a fast changing space 😆 Are they working on something behind the scenes? I've only seen ArrayLake come out of EarthMover last year, but haven't been following too closely. I've also seen other data loading libraries come out recently like mlx-data, plus others, and am excited to see how this pans out.

Copy link
Member

@maxrjones maxrjones left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for writing this @weiji14! Excited to publish it

@dcherian dcherian changed the title Pangeo ML Ecosystem 2023 blog post Pangeo ML Ecosystem 2024 blog post Apr 2, 2024
@weiji14
Copy link
Member Author

weiji14 commented Apr 2, 2024

Cool, thanks @maxrjones for adding the funding sources, and @dcherian for pushing the changes and linking to the Earthmover blog post!

@andersy005, can you please trigger the preview build, and if that looks ok, we can merge this PR this week?

@weiji14 weiji14 changed the title Pangeo ML Ecosystem 2024 blog post Pangeo ML Ecosystem blog post Apr 2, 2024
@andersy005 andersy005 merged commit 83e7b78 into xarray-contrib:main Apr 3, 2024
@weiji14 weiji14 deleted the pangeo-ml-ecosystem-2023 branch April 3, 2024 18:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants