Google PROTOCOL_ERROR

[scottrobertson]

Hey

Getting the following error when trying to deploy:

2017/03/19 02:22:48 Post https://www.googleapis.com/storage/v1/b?alt=json stream error: stream ID 3; PROTOCOL_ERROR

This is intermittent. Not sure if this is Google's issue or something on my end. Any ideas?

Deployments have been working fine. This error started to happen last night.

[scottrobertson]

It's worth noting that this has taken my app down.

[vdice]

@scottrobertson is this behavior still occurring? If so, are there any logs from the builder or controller pods during time of error? I take it GCS is being used for off-cluster storage?

[bacongobbler]

All of the other bugs related to this "stream error: PROTOCOL_ERROR" bug points at http/2 somewhere. I think this has resolved itself over the weekend though: https://deis.slack.com/archives/C0Q7XKSF4/p1489919024672279

[bacongobbler]

@scottrobertson any potential action items you'd like to see in this ticket or do you think we can close this?

[scottrobertson]

@bacongobbler it's not happened again. I assume it was something on Google's end since it was happening at the same time every night.

[scottrobertson]

Hitting this again:

Counting objects: 9045, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (2844/2844), done.
Writing objects: 100% (9045/9045), 2.18 MiB | 0 bytes/s, done.
Total 9045 (delta 6302), reused 8652 (delta 6031)
remote: Resolving deltas: 100% (6302/6302), done.
remote: 2017/04/20 00:30:24 Error creating storage driver (Post https://www.googleapis.com/storage/v1/b?alt=json&project=app-slug: stream error: stream ID 3; PROTOCOL_ERROR)

[Cryptophobia]

This issue was moved to teamhephy/builder#14