Skip to content

Conversation

@aerorahul
Copy link
Contributor

@aerorahul aerorahul commented Jun 1, 2021

This PR:

  • adds ability to build python virtual environments and load them as modules. This is a desired functionality for users of applications that require different combinations of python packages.
  • This functionality is currently being exercised in JEDI related projects such as EWOK, JEDI-GDAS HofX applications.
  • This functionality can be leveraged for other applications requiring python virtual environments e.g. JEDI-SOCA, MetPlus, etc.

To load a python virtual env. is the same as loading any other library or utility. Loading the module will place the user in the python virtual env. (akin to source venv/bin/activate). Unloading deactivate's the virtual environment.

Also in this PR,

  • the yaml files have been moved to stack/ from config/
  • virtual environment requirements.txt files will be placed under pyvenv/
  • Updates to README.md on how to add a virtual environment and correct paths for JEDI dependencies

aerorahul added 4 commits June 1, 2021 11:25
Change-Id: Icea70f75d4a9a06d8d977a99f2941512751849a9
…EADME.md.

Change-Id: I7bf4c8cf071843fca90e1e024402ca3290fa6b0d
Change-Id: I1676b228b20ad3988ab296edd553b8f4755939d1
Change-Id: I52fa546da9847b1d28c44a4f1ba4c350079575e1
@aerorahul aerorahul requested a review from kgerheiser June 1, 2021 21:04
@aerorahul
Copy link
Contributor Author

@kgerheiser
Can I please get a review on this?

@kgerheiser
Copy link
Contributor

Are the JEDI repositories private? I tried building r2d2, but it asks for a Github password.

@aerorahul
Copy link
Contributor Author

Yes. They are private at the moment and hence the build is turned OFF.

@aerorahul aerorahul merged commit 5511475 into develop Jun 2, 2021
@aerorahul aerorahul deleted the feature/pyvenv branch June 2, 2021 17:30
@aerorahul
Copy link
Contributor Author

thanks @kgerheiser

@edwardhartnett
Copy link
Contributor

We are going to move from hpc-stack to spack for distributing our libraries. How will this capability be transitioned?

@aerorahul
Copy link
Contributor Author

That is for you to figure out.

@climbfuji
Copy link
Contributor

We are going to move from hpc-stack to spack for distributing our libraries. How will this capability be transitioned?

I am surprised to hear that the decision to move to spack was already made, but maybe I misunderstood the discussion yesterday. I think it is a good approach, but it needs more testing (we have roadmap for it) and it's not set in stone yet. Whatever we agree on, there'll be a lot of things that need to be transitioned (by someone).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants