Publish to conda

[MrPowers]

delta-rs is currently uploaded to PyPi, so users can pip install deltalake.

Lots of Python data projects are also uploaded to Conda, which is more popular in the data community. Here's how to install deltalake in a Conda environment file:

name: mr-delta-rs
channels:
  - conda-forge
  - defaults
dependencies:
  - python=3.9
  - pandas
  - pip
  - pip:
    - deltalake==0.5.8

It's possible, but it'd be nice if this was also uploaded to conda-forge. Thoughts?

[houqp]

Yes, this would be a good thing to have. We could perform the release using github action too.

[craustin]

Created a forge-side request here: conda-forge/staged-recipes#21102

[MrPowers]

@craustin - awesome, so exciting! Anything you need from our end to help you move this forward? Or will conda-forge take it from here?

[kukushking]

Hi folks, this is precisely our case -- AWS SDK for pandas added support for deltalake in the latest release and we are publishing both to pypi and conda. Would be great to have this

aws/aws-sdk-pandas#873
#870

[mlguruz]

Hi guys - just curious where we're on publishing to conda?
Our org uses conda/mamba (not pip) for pkg management so would be great to have it on conda.

[craustin]

I started a conda-forge PR here:
https://github.com/conda-forge/staged-recipes/pull/22162/checks

It's currently failing on some deprecation errors, looks like:

error: use of deprecated type alias object_store::prefix::PrefixObjectStore: Use PrefixStore

I haven't had a chance to look into those yet. Maybe just need to ignore them...?

[roeap]

I haven't had a chance to look into those yet. Maybe just need to ignore them...?

I think we already updated this on main. Not sure how the conda builds work, but I guess with the next release this should be fixed. Then the conda build would pick it up?

[craustin]

Yes, I think that's right. Once deltalake v0.9.0+ is published to pip, the conda-forge recipe build should succeed then.

[nkarpov]

also just FYI once this is passing you need to be quite persistent to get it in 😬 ... it took me many bumps before it was addressed when publishing delta-spark (conda-forge/staged-recipes#21556)

[CTCC1]

Glad to find out that this is now resolved! conda-forge/staged-recipes#23386

[roeap]

That's excellent news! Will close this then ...