Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate using conda yaml file for setting up environment #585

Closed
laurejt opened this issue Feb 8, 2024 · 1 comment
Closed

Investigate using conda yaml file for setting up environment #585

laurejt opened this issue Feb 8, 2024 · 1 comment
Assignees
Labels

Comments

@laurejt
Copy link
Contributor

laurejt commented Feb 8, 2024

No description provided.

@laurejt laurejt added the chore label Feb 8, 2024
@laurejt laurejt self-assigned this Feb 8, 2024
@laurejt
Copy link
Contributor Author

laurejt commented Apr 8, 2024

TLDR: Conda's current yaml support for environment management is not a good fit for the current workflow (i.e., multiple requirements files for different situations).

Conda environments can be created, updated, and shared via yaml files. However, this generally only works with a single yaml file. There are generally two kinds of issues when using multiple files:

  1. Updates lose track of pinned dependencies. Although the conda env update -f [env.yml] command can update the current environment according to a yaml file, pinned dependencies can be updated. The third-party tool conda-merge might be able to help, but it further complicates the workflow and may still not produce a working environment (see the second issue).

  2. Conda and pip don't always play nice. The interactivity / interoperability of pip within conda environments has changed over the years, but the results are still mixed (see: [1], [2]. Generally, once packages have been installed using pip, it shouldn't be updated further using conda.

Anecdotally, I've generally had a great experience using yml files for conda environment creation/management. However, this only works when there's a single file, not multiple.

@laurejt laurejt closed this as completed Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant