Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataset Submission: HakaiCTDProvisional #7

Closed
12 tasks done
JessyBarrette opened this issue Feb 4, 2021 · 10 comments
Closed
12 tasks done

Dataset Submission: HakaiCTDProvisional #7

JessyBarrette opened this issue Feb 4, 2021 · 10 comments
Assignees
Labels
Format Minor Revisions Data format is mostly compatible but small changes are needed. Submission

Comments

@JessyBarrette
Copy link
Collaborator

JessyBarrette commented Feb 4, 2021

Hakai Dataset Submission

Below are listed all the different steps related to the initial submission of a dataset.

A more detailed written and visual description of every step is available respectively
here and here.

Submission steps

Initial Submission (Data Administrator)

  • Original Data Submission
  • CIOOS Metadata Form completed

ERDDAP Dataset Creation (Data Integrator)

  • Dataset Transformation (Format label)
    • 🟢 Format Compatible
    • 🟡 Format Minor Revisions
    • 🟠 Format Major Revisions
    • 🔴 Format Incompatible/Missing Information
  • Near Real-time Data Integration
  • QARTOD Integration
  • ERDDAP Integration
  • ERDDAP Dataset Documentation
  • ERDDAP Test Locally
  • Add Dataset to Development Branch

Dataset Review (Data Administrator)

* ERDDAP dev

  • Dataset Development Branch Revision (Reviewer Label)
    • 🟢 Reviewer Approved
    • 🟡 Reviewer Minor Revisions
    • 🟠 Reviewer Major Revisions

Dataset Completion (Data Integrator)

  • Merge Development Dataset to Production Branch
  • COMPLETED
@JessyBarrette JessyBarrette self-assigned this Feb 4, 2021
@JessyBarrette JessyBarrette added the Format Minor Revisions Data format is mostly compatible but small changes are needed. label Feb 4, 2021
@JessyBarrette
Copy link
Collaborator Author

JessyBarrette commented Feb 24, 2021

@raytula @jenjax2 @trollpete CIOOS Metadata form first draft for the CTD provisional dataset is now available here:
https://cioos-siooc.github.io/metadata-entry-form/#/en/pacific/tV5qE0aUgaOjSVmgPgiZ6MyHuSy1/-MMHJ4k2EEwxkbXkrjxa

Based on Nate's comment's you won't be able to modify it but let me know we can change a lot of things.
The CTD Research Dataset would likley have a very similar form with minor changes to it.

@JessyBarrette
Copy link
Collaborator Author

@jenjax2 @raytula @trollpete A first draft of the Hakai Water Properties Procedure manual is now available here:
https://docs.google.com/document/d/1C3oXnIvVgFEaoxNfHfArjNHYbHiIIbs325_R5nVnMLQ/edit?usp=sharing

@raytula
Copy link
Contributor

raytula commented Mar 3, 2021

@raytula @jenjax2 @trollpete CIOOS Metadata form first draft for the CTD provisional dataset is now available here:
https://cioos-siooc.github.io/metadata-entry-form/#/en/pacific/tV5qE0aUgaOjSVmgPgiZ6MyHuSy1/-MMHJ4k2EEwxkbXkrjxa

Based on Nate's comment's you won't be able to modify it but let me know we can change a lot of things.
The CTD Research Dataset would likley have a very similar form with minor changes to it.

I like it

@raytula
Copy link
Contributor

raytula commented Mar 3, 2021

@jenjax2 @raytula @trollpete A first draft of the Hakai Water Properties Procedure manual is now available here:
https://docs.google.com/document/d/1C3oXnIvVgFEaoxNfHfArjNHYbHiIIbs325_R5nVnMLQ/edit?usp=sharing

I like this too

@JessyBarrette
Copy link
Collaborator Author

@raytula @jenjax2 The provisional CTD Profile dataset is now available on Goose ERDDAP
https://goose.hakai.org/erddap/tabledap/HakaiWaterPropertiesInstrumentProfileProvisional.html

We temporarily moved away from the database, the dataset is as of now served by generated netcdf files. All this will be move to the Hakai database once ready.

@JessyBarrette
Copy link
Collaborator Author

FYI it takes about 3h to run the tests on all the data. this include download the data and run tests, it should likely be much faster once done on the server side

@JessyBarrette
Copy link
Collaborator Author

CIOOS Metadata record, and ERDDAP datasets are now available on the productions sites

@raytula
Copy link
Contributor

raytula commented Apr 1, 2021

Great. Thanks!

@JessyBarrette
Copy link
Collaborator Author

This dataset is now available online. We can close that issue!

1 similar comment
@JessyBarrette
Copy link
Collaborator Author

This dataset is now available online. We can close that issue!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Format Minor Revisions Data format is mostly compatible but small changes are needed. Submission
Projects
None yet
Development

No branches or pull requests

2 participants