Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deploy ERDDAP through Caprover #169

Open
11 of 15 tasks
JessyBarrette opened this issue Dec 13, 2023 · 4 comments · May be fixed by #166
Open
11 of 15 tasks

Deploy ERDDAP through Caprover #169

JessyBarrette opened this issue Dec 13, 2023 · 4 comments · May be fixed by #166
Assignees
@JessyBarrette @steviewanders

Comments

@JessyBarrette
Copy link
Collaborator

JessyBarrette commented Dec 13, 2023 •
edited

Caprover can be use to make our erddap deployments easier to maintain and tracks.

Caprover can be helpful to sort the env variables, deployments from Github and analysing the server and docker container health.

In order to permit an easy deployment of erddap via carover, the following are needed:

Github Actions

  • add action to redeploy erddap on changes to specific items within the repository.
    • init.d/
    • erddap/content/*
  • update dataset.xml within the container without restarting the whole container
  • It would great to minimize as much as possible the interaction with caprover to centralize the different caprover inputs which includes:
    • environment variables
    • Persistent Directories
  • Maintain uptime-kuma management via a github action

Monitoring

Deployments

  • the erddap-dataset should still permit to run locally this erddap instance for datasets development
  • ideally two deployments should be maintained simultaneously to present the main and development branches
  • mount data drive erddap associated on server
    • main datasets
    • development datasets
    • algae explorer data
    • seaspan tug boat data
@JessyBarrette JessyBarrette self-assigned this Dec 13, 2023
@JessyBarrette JessyBarrette linked a pull request Dec 13, 2023 that will close this issue
Caprover-deploy #166
Draft
@JessyBarrette
Copy link
Collaborator Author

A test uptime-kuma dashboard was generated at https://uptime-kuma.server.hakai.app/status/hakai-erddap-dev-server-hak4i-org for the main branch of this erddap repo.

@steviewanders
Copy link

steviewanders commented Dec 15, 2023 •
edited

@fostermh @n-a-t-e purely FYI in case you were not aware.

We are slowly working on moving ERDDAP dev to be purely container based (mounting data from EFS and s3) and hosting it via Docker Swarm in CapRover.

http://hakai-erddap-dev.server.hak4i.org/

When we get it to a phase of it being ready we will ask you for some peer review.

@steviewanders
Copy link

steviewanders commented Mar 22, 2024 •
edited

A reminder to check if SWAP is useful for ERDDAP and it's memory problems

@JessyBarrette
Copy link
Collaborator Author

All the datasets are now made available via:
https://development.erddap.hakai.app/erddap

Current time is 2024-03-26T21:00:00+00:00
Startup was at  2024-03-26T19:45:44+00:00
Last major LoadDatasets started 11m 51s ago and finished after 5 seconds.
Currently, no dataset is loading.
nGridDatasets  = 2
nTableDatasets = 41
nTotalDatasets = 43
n Datasets Failed To Load (in the last major LoadDatasets) = 1
    HakaiChlorophyllSampleResearch, (end)
Unique users (since startup)                            n = 0
Response Failed    Time (since last major LoadDatasets) n =        0
Response Failed    Time (since last Daily Report)       n =        0
Response Failed    Time (since startup)                 n =        0
Response Succeeded Time (since last major LoadDatasets) n =       74,  median ~=        1 ms
Response Succeeded Time (since last Daily Report)       n =      426,  median ~=        1 ms
Response Succeeded Time (since startup)                 n =      444,  median ~=        1 ms
TaskThread has finished 0 out of 0 tasks.  Currently, no task is running.
TaskThread Failed    Time (since last Daily Report)     n =        0
TaskThread Failed    Time (since startup)               n =        0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JessyBarrette JessyBarrette

@steviewanders steviewanders

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Caprover-deploy HakaiInstitute/hakai-datasets
2 participants
@JessyBarrette @steviewanders