[ENH - Add back support for using private pypi repository

[ClaytonAstrom]

Describe the bug

Including pip options (such as --index-url, #294 ) don't seem to pass validation as described by the conda-lock dependency. While they suggest to add it to the global poetry config, it looks like their vendored version of poetry isn't compatible with how poetry handles that now - conda/conda-lock#393 (comment)

Expected behavior

The pip arguments such as --index-url should pass to pip without issue

How to Reproduce the problem?

• Create an environment.yaml with a pip section
• In the pip section, include --index-url
• Build the environment

Output

conda-lock throws, it tries to validate --index-url as a package itself

Versions and dependencies used.

No response

Anything else?

No response

[pavithraes]

Thanks for opening this, @ClaytonAstrom!

Just noting, I couldn't reproduce this on a quick test on the Quansight Nebari instance (which I believe runs v0.4.14) - but this needs another attempt to reproduce against the latest release and main, and/or investigation

[ClaytonAstrom]

Thanks @pavithraes ! Perhaps I was mistaken - do you mind trying the pip list in the CondaStore.pypi_default_packages setting? I had thought this was occurring for any yaml, but it may just be that my setting was applying it

CondaStore.pypi_default_packages = [ '--index-url private.pypi.url', 'pip-package']

[ClaytonAstrom]

Ah it may have been introduced in 0.4.15 - https://github.com/conda-incubator/conda-store/blob/v0.4.15/conda-store-server/conda_store_server/build.py#L272

[costrouc]

@ClaytonAstrom yes this was a move towards an explicit:

• conda-lock -f environment.yaml (generates conda-lock.yml)
• download all packages
• conda-lock install conda-lock.yml

Where before this we used conda/mamba which explicitely called pip. This is indeed a regression to how we handle pypi and we rely on conda-lock for this feature. See related issue conda/conda-lock#135.

@ClaytonAstrom this is definitely a feature that we want to support but conda-lock allows us cross platform lockfile and a more explicit solve. We will need to upstream a feature to conda-lock to start supporting this feature again.

[pavithraes]

Thanks for the context, @costrouc!

I'll (1) mark this as need documentation in the short-term, and (2) change this from a bug to a feature request so that we don't lose track of it. :)