Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove run_queries.sh as no longer used #1179

Merged
merged 2 commits into from
Aug 8, 2020
Merged

Conversation

tunetheweb
Copy link
Member

We added a bash linter in #1177 however the run_queries.sh is throwing up some errors. Not sure if this is even used but this fixes it in case it is used, or needed in the future.

@rviscomi / @paulcalvano can you test this?

When I try to run ./run_queries.sh 2019/19_Resource_Hints I get the below produced in the JSON files:

BigQuery error in query operation: Access Denied: Project httparchive: User does
not have bigquery.jobs.create permission in project httparchive.

So not 100% sure it's actually working. Or can you give me access so I can test it?

Or if it's not used, then I could just change this PR to delete this file instead as it's the only one failing our linting at the moment when I lint the whole repo.

@tunetheweb tunetheweb added the analysis Querying the dataset label Aug 7, 2020
@tunetheweb tunetheweb added this to the 2020 Analysis milestone Aug 7, 2020
@tunetheweb tunetheweb added this to TODO in 2020 via automation Aug 7, 2020
@rviscomi
Copy link
Member

rviscomi commented Aug 8, 2020

Let's remove it. The intent behind the script was to generate JSON results for each SQL file to be used for data viz, but we ended up with (and continue to use) Sheets for that. JSON needed for one-off data viz like #896 can be created manually from BQ.

BigQuery error in query operation: Access Denied: Project httparchive: User does not have bigquery.jobs.create permission in project httparchive.

This is a normal error message as the queries should be billed back to the GCP project and only HTTP Archive admins can do that. I didn't want anyone accidentally running this script on their personal GCP projects and incurring $$$.

@tunetheweb tunetheweb changed the title Fix linting issue for run_queries.sh Remove run_queries.sh as no longer used Aug 8, 2020
@tunetheweb tunetheweb merged commit 9e82ce1 into main Aug 8, 2020
2020 automation moved this from TODO to Done Aug 8, 2020
@tunetheweb tunetheweb deleted the run_script_linting_fxies branch August 8, 2020 19:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
analysis Querying the dataset
Projects
No open projects
2020
  
Done
Development

Successfully merging this pull request may close these issues.

None yet

2 participants