Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create HTCondor submit container #17

Closed
acjbrouwer opened this issue May 26, 2023 · 2 comments
Closed

Create HTCondor submit container #17

acjbrouwer opened this issue May 26, 2023 · 2 comments
Assignees

Comments

@acjbrouwer
Copy link
Contributor

Create a container that provides as a service submission of Condor_run_R bundles to the Limpopo cluster. Notification and passing of input data and output data is TBD. Options:

  • Message broker.
  • Shared volume.
  • Message broker for notification, shared volume for data.

When a shared volume is used, it is probably expedient to have one instance of this container per connection.
When purely via a message broker, this can be a K8s-namespace-wide service.

@acjbrouwer acjbrouwer self-assigned this May 26, 2023
@acjbrouwer
Copy link
Contributor Author

acjbrouwer commented Dec 1, 2023

Might be able to get away with instead instantiating interactive scientific stack containers that can submit from a co-installed HTCondor (see #18).

@acjbrouwer
Copy link
Contributor Author

acjbrouwer commented Mar 29, 2024

Set up automation for not just building a submit container but also an execution point container and a Central Manager container together with a pool bootstrap container. These are all built off the same base image. The base image is based on Ubuntu (22.04 currently) and pulls in HTCondor (23.04 currently) and additional packages, notably SupervisorD as an init system, and Git to pull in configuration.

The bootstrap container serves to generate the pool signing key and default token (for IDTOKENS authentication) provided to pods (container instances) via a Kuberenetes secret.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant