Add gsutil example script for syncing data to target bucket #3
Labels
Comments
d33bs
added
documentation
d33bs
added a commit
to d33bs/gc-cloud-storage-bucket
that referenced
this issue
Sep 19, 2023
* add multi-threaded option for gsutil * add docs for gsutil options
d33bs
added a commit
that referenced
this issue
Sep 19, 2023
* Initial commit * Add gsutil script and Assay.Works specifics (#1) * changes for assayworks project specifics * update shell script with bucket name * detemplatize; gsutil instructions * assay works docs context; simplify source dir * Move to .bat file and add Terraform role for bucket permissions (#2) * changes for assayworks project specifics * update shell script with bucket name * detemplatize; gsutil instructions * assay works docs context; simplify source dir * bucket.get svc-acct role binding * move gsutil work from .sh to .bat file Co-Authored-By: Faisal Alquaddoomi <faisal.alquaddoomi@cuanschutz.edu> * linting; remove shellcheck * rename gsutil file, remove .sh file * remove shellcheck Co-authored-by: Faisal Alquaddoomi <faisal.alquaddoomi@cuanschutz.edu> * Add multi-threading option for gsutil command (#3) * add multi-threaded option for gsutil * add docs for gsutil options * Adds documentation for Way Lab rclone usage (#4) * add way lab docs; reorganize utilities dir also add new repo diagram to increase role-based context understanding * linting change * Add Terraform state management resources and documentation (#5) * update existing tf to new location * add prep dir with state mgmt bucket * add hashicorp dir ignores * versions and lock file * rename to state-management dir * additional tf ignore * add state management instructions * state management bucket naming * single tf bucket var name * update lockfile * pre-commit image source image pin * tf backend comment * simplify state mgmt language Co-Authored-By: Faisal Alquaddoomi <faisal.alquaddoomi@cuanschutz.edu> * use specific version of dagger gh-action --------- Co-authored-by: Faisal Alquaddoomi <faisal.alquaddoomi@cuanschutz.edu> * Merge updates from 'gc-durbinlab-bucket/main' * rename and move files for template * update pre-commit deps * docs lint * ignore root terraform dir for pre-commit md lint * remove locks * data provider and receiver docs updates * poetry project updates * tf image updaet * image linting docs update * update readme for accurate role descriptions * generic bucket name replacements * update terraform provider versions + docs * Apply suggestions from code review Co-authored-by: Faisal Alquaddoomi <falquaddoomi@gmail.com> * add note about service account credential location * ignore the tf created svc account credential file --------- Co-authored-by: Faisal Alquaddoomi <faisal.alquaddoomi@cuanschutz.edu> Co-authored-by: Faisal Alquaddoomi <falquaddoomi@gmail.com>
|
This was added via the merge of #9 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This issue outlines the need for an example script to be used with gsutil, a common way of interfacing with Cloud Storage buckets. A focus should be placed on making this script align with the Google Cloud resources of this template.
The text was updated successfully, but these errors were encountered: