Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Folder hierarchy for Dataset Files #71

Closed
vchendrix opened this issue Jan 5, 2017 · 0 comments
Closed

Folder hierarchy for Dataset Files #71

vchendrix opened this issue Jan 5, 2017 · 0 comments
Assignees
@vchendrix
Labels
enhancement
Milestone
M4 Release 1.0.0

Comments

@vchendrix
Copy link
Contributor

The uploaded dataset files should reside in a folder structure. This will make it more manageable for backing up to HPSS and navigating.

  • dataset_id
    • version
      • archive file(s) - the archive file could have been uploaded more than once. The old copies are kept around.
@vchendrix vchendrix added this to the M3 - Archive Storage Backend milestone Jan 5, 2017
@vchendrix vchendrix self-assigned this Jan 5, 2017
@vchendrix vchendrix mentioned this issue Jan 6, 2017
Closed
@vchendrix vchendrix modified the milestones: M4 Release 1.0, M3 - Archive Storage Backend Jan 10, 2017
vchendrix added a commit that referenced this issue Apr 12, 2017
@vchendrix
Data Versioning Support with folder hierarchy for dataset files
1b86023 
    Resolves #70: Created an internal id called 'ngt_id'.  ngt_id and
    version fields are unique together.  If a dataset is created without
    an ngt_id then the next available id is used.

    Resolves #71: created a folder hierarchy that groups by ngt_id by
    hundreds then by tens. The directory structure unter that is
    {data_set_id}/{version}/{data_set_id}_{version}.zip
       - 0000
         - 0000
         -  0010
          ...
       - 0100
         - 0100
         - 0110
         ...
       - 0200...
vchendrix added a commit that referenced this issue Apr 14, 2017
@vchendrix
Data Versioning Support with folder hierarchy for dataset files
17cf054 
    Resolves #70: Created an internal id called 'ngt_id'.  ngt_id and
    version fields are unique together.  If a dataset is created without
    an ngt_id then the next available id is used.

    Resolves #71: created a folder hierarchy that groups by ngt_id by
    hundreds then by tens. The directory structure unter that is
    {data_set_id}/{version}/{data_set_id}_{version}.zip
       - 0000
         - 0000
         -  0010
          ...
       - 0100
         - 0100
         - 0110
         ...
       - 0200...
vchendrix added a commit that referenced this issue Apr 15, 2017
@vchendrix
Data Versioning Support with folder hierarchy for dataset files
d909cdf 
    Resolves #70: Created an internal id called 'ngt_id'.  ngt_id and
    version fields are unique together.  If a dataset is created without
    an ngt_id then the next available id is used.

    Resolves #71: created a folder hierarchy that groups by ngt_id by
    hundreds then by tens. The directory structure unter that is
    {data_set_id}/{version}/{data_set_id}_{version}.zip
       - 0000
         - 0000
         -  0010
          ...
       - 0100
         - 0100
         - 0110
         ...
       - 0200...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vchendrix vchendrix

Labels
enhancement
Projects
None yet
Milestone
M4 Release 1.0.0
Development

No branches or pull requests
1 participant
@vchendrix