Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Job ID in the error output of `bq_perform_upload` #252

Closed
byapparov opened this issue Jun 1, 2018 · 2 comments

Comments

@byapparov
Copy link
Contributor

commented Jun 1, 2018

When I run bq_perform_upload I get an error:

Running job [-] 4s
Error: Error while reading data, error message: JSON table encountered too many errors, giving up.
Rows: 88477; errors: 1. Please look into the error stream for more details. [invalid]

Which does not give me details about the job, though it is available in the environment:

 job <- bigrquery::bq_perform_upload(x = tbl, values = data, 
      write_disposition = write.disposition, create_disposition = "CREATE_IF_NEEDED")
    res <- bq_job_wait(job)

There are two options to make debugging possible:

  • Add job id into Running Job ... progress message
  • Catch exception and append a new message with Job Id

This will allow me to get error details in terminal:

bq --format=prettyjson show -j {job_id}

error troubleshooting doc for reference:
https://cloud.google.com/bigquery/troubleshooting-errors

@hadley

This comment has been minimized.

Copy link
Member

commented Jan 22, 2019

I think displaying the job id in the progress message would be ideal. Do you want to do a PR?

@hadley

This comment has been minimized.

Copy link
Member

commented Jan 23, 2019

I did it because I needed a small programming problems. But I'll restrain myself from fixing any more!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.