Switch to using requester pays on storage buckets #23
Conversation
updates: - [github.com/myint/rstcheck: v5.0.0 → v6.0.0a1](rstcheck/rstcheck@v5.0.0...v6.0.0a1)
Codecov Report
@@ Coverage Diff @@
## main #23 +/- ##
=======================================
Coverage 100.0% 100.0%
=======================================
Files 2 2
Lines 42 42
=======================================
Hits 42 42 Continue to review full report at Codecov.
|
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
| Usage | ||
| ----- | ||
|
|
||
| Public data and "requester pays" |
There was a problem hiding this comment.
can we add this stuff into the data access page instead of the readme??
There was a problem hiding this comment.
I'll break it out into a separate page and link to it. I agree this is too much detail for the README.
| .. code:: bash | ||
|
|
||
| gcloud auth login | ||
| gcloud init |
There was a problem hiding this comment.
this step asked me some questions:
Pick configuration to use:
[1] Re-initialize this configuration [default] with new settings
[2] Create a new configuration
There was a problem hiding this comment.
it also asked:
Pick cloud project to use:
[1] northern-hope-350719
[2] pudl-test
[3] Enter a project ID
[4] Create a new project
(I had just made the pudl-test project when i first logged in)
There was a problem hiding this comment.
Which one did you choose? I think it should be the project you just created, and within which you should have given yourself the permission to spend money.
| See the notebook included in this repository for more details. | ||
| .. code:: bash | ||
|
|
||
| gsutil ls gs://intake.catalyst.coop |
There was a problem hiding this comment.
okay i got:
(pudl-dev) %0 ~/code% gsutil ls gs://intake.catalyst.coop christinagosnell@New-Shiny-Thing
BadRequestException: 400 Bucket is a requester pays bucket but no user project provided.
[1] 18496 exit 1 gsutil ls gs://intake.catalyst.coop
``
There was a problem hiding this comment.
What do you get when you do
gcloud config configurations listThere was a problem hiding this comment.
(but good to know that the gsutil ls is a sufficient check!)
There was a problem hiding this comment.
(pudl-dev) %0 ~/code% gcloud config configurations list christinagosnell@New-Shiny-Thing
NAME IS_ACTIVE ACCOUNT PROJECT COMPUTE_DEFAULT_ZONE COMPUTE_DEFAULT_REGION
default True gosnellc11@gmail.com pudl-test
There was a problem hiding this comment.
for me, the most confusing part of this was the initial setup of the account and project. It felt very fuck-around-and-find-out.... some lil screenshots would be helpful.
(a part of my problem was i was trying to do this on my non-primary google account so I could read the instructions on all of the links but not actually do anything there.)
and i commented on the several command line hurdles
…-config [pre-commit.ci] pre-commit autoupdate
No description provided.