erddap-config

Content dir for docker-erddap incl setup.xml & dataset.xml

workflow

1. modify dataset files in /datasets/ dir
2. run erddap-datasets-xml-builder to generate datasets.xml (TODO: see #33)
3. pull new datasets.xml onto erddap server (if using docker a docker-compose restart is not needed)
   • NOTE: As of 2023-03 IMaRS's ERDDAP server (a docker container on dune) does this automatically every 30min.¹
   • NOTE: Changes beyond just datasets.xml edits may require the docker container be restarted or rebuilt.

Adding a new DataSet Checklist:

NOTE: ${HOSTNAME} is the name of the dockerhost system. ${USERNAME} is your username (must have docker permissions).

1. create a file in this repo /datasets/{dataset_name}/README.md where {dataset_name} is the name you have chosen for your dataset; try to follow the patterns of existing dataset names in /datasets/.
2. create a file /datasets/{dataset_name}/dataset.xml:
   1. connect to docker host:
      • ssh ${USERNAME}@${HOSTNAME}
      • for user alice accessing the 2023 IMaRS ERDDAP hypervisor this is : alice@dune.marine.usf.edu
   2. use tool to auto-generate dataset xml:
      • docker exec -it erddap bash -c "cd webapps/erddap/WEB-INF/ && bash GenerateDatasetsXml.sh -verbose"
   3. copy the xml into your new /datasets/{dataset_name}/dataset.xml file
   4. modify the xml
      1. change the name in the xml to match your chosen dataset_name
3. see the workflow section above to finish applying the changes

checking for errors on the ERDDAP server

1. look at {erddap_server_url/status.html to see a list of datasets that are failing
2. search the /erddapData/logs/log.txt for errors related to your dataset
3. run DasDds to find errors
   • docker exec -it erddap bash -c "cd webapps/erddap/WEB-INF/ && bash DasDds.sh -verbose"
4. once DasDds has no errors, you may need to restart the ERDDAP container to update volumes:
   • docker-compose restart
   • in some cases resetting the volumes is needed too:
     • docker-compose down --rmi all --volumes && docker-compose up -d
5. watch ${HOSTNAME}/erddap/status.hml for LoadDatasets to finish & that all is well.

additional links

• setup.xml spec
• datasets.xml spec
• example content directory
• updates to ERDDAP code
• IOOS "Gold Standard" Example configs

---

Footnotes

1. the crontab entry on dune that does this: */30 * * * * cd /root/docker_volumes/erddap-config ; /usr/bin/git checkout dune && /usr/bin/git pull && /usr/bin/git rebase origin/master && /usr/bin/git push -f origin dune ↩