Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Splitting the project into layers #34

Closed
Zarquan opened this issue Jan 7, 2020 · 2 comments
Closed

Splitting the project into layers #34

Zarquan opened this issue Jan 7, 2020 · 2 comments

Comments

@Zarquan
Copy link
Collaborator

Zarquan commented Jan 7, 2020

I think we need to split this project into three separate GitHub projects to reflect the different layers in the system. Hopefully this will make it easier to manage the source code, issues and testing for each of the layers.

  1. Deploy Kubernetes into an empty OpenStack project space.
  2. Deploy Spark and Zeppelin into an empty Kubernetes cluster.
  3. Develop a set of Spark and Zeppelin tools for analysing the Gaia data.
  • Each layer is deployable and testable as a separate component in its own right.
  • Each layer has a separate GitHub repo, including code base, issues, and CI testing process.

This way we can be working on development versions of the Kubernetes and Spark layers, while at the same time using the current release versions of them as a stable platform to develop the Spark and Zeppelin analysis tools.

This has implications for issue #33. Each layer would have its own CI integration, using the other layers as components to build the CI test environment.

@Zarquan
Copy link
Collaborator Author

Zarquan commented May 1, 2020

Based on what we have learned so far, (1) and (2) are now probably merged into a single 'infrastructure' layer, but (3) is still a separate layer.

@Zarquan
Copy link
Collaborator Author

Zarquan commented Sep 8, 2020

This is no longer an issue.

@Zarquan Zarquan closed this as completed Sep 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant