Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement container-based job goal #162

Closed
ddgenome opened this issue Jun 3, 2019 · 0 comments

Comments

@ddgenome
Copy link
Member

commented Jun 3, 2019

Allow SDM to specify goals as containers, i.e., data.

@ddgenome ddgenome added the enhancement label Jun 3, 2019

@ddgenome ddgenome self-assigned this Jun 3, 2019

ddgenome added a commit that referenced this issue Jun 7, 2019

Add container goal INPROGRESS
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.

Add CacheEntry interface and do some minor clean up to caching
interface.

Closes #162

CURRENT STATUS: Docker scheduler implemented.

ddgenome added a commit that referenced this issue Jun 18, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Add tests for some scheduler and
environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 19, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Add tests for some scheduler and
environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 20, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Add tests for some scheduler and
environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 20, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 20, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 20, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

cdupuis pushed a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

cdupuis pushed a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

cdupuis pushed a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

cdupuis pushed a commit that referenced this issue Jun 21, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

ddgenome added a commit that referenced this issue Jun 24, 2019

Add container goal
Add container goal definition and working schedulers for Kubernetes
jobs and Docker CLI.  Use first container as goal container, which
means it is the only one waited on and its status sets the goal
status.  Will throw error if no containers defined.  It will do its
best to make the goal and fulfillment names unique.

Co-opt KubernetesGoalScheduler for k8s container goal implementation,
extracting some of its functionality into functions that can be used
to define the init container.  Collect logs from k8s into goal
progress log, adding a delay because log delivery from the k8s API can
occur after the container terminates.  Add tests for some scheduler
and environment variable functionality.

Add CacheEntry interface and do some minor clean up to caching
interface.  Correct goal caching restore interface to only require
options it uses.  Clean up cache tests.

Properly handle project directory and cache use by copying its
contents to a location usable by container, mounting that location in
the container, setting the working directory in the first container to
that location, and copying the contents back after the containers
exit.

Closes #162

@cdupuis cdupuis closed this in #166 Jun 24, 2019

cdupuis pushed a commit that referenced this issue Jun 24, 2019

Changelog: #162 to added
[atomist:generated]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.