New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"cannot talk to GitHub" #63

Closed
shivamMg opened this Issue Sep 11, 2018 · 28 comments

Comments

Projects
None yet
@shivamMg

shivamMg commented Sep 11, 2018

For some reason it cannot talk to GitHub. The requests time out. GH is up. Must be something between your server and GH.

screenshot_20180911_141120

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

Right, GitHub is not accepting connections from gopkg.in right now. I'm in touch with support trying to figure out why and get it sorted.

Owner

niemeyer commented Sep 11, 2018

Right, GitHub is not accepting connections from gopkg.in right now. I'm in touch with support trying to figure out why and get it sorted.

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

As a side note, if you have a good contact at GitHub for that kind of issue, please raise attention so we can get it back up ASAP. If they take too long to respond I may end up switching IP addresses for a while so they can take their time to evaluate the issue, but I'd prefer to sort it the proper way instead.

Owner

niemeyer commented Sep 11, 2018

As a side note, if you have a good contact at GitHub for that kind of issue, please raise attention so we can get it back up ASAP. If they take too long to respond I may end up switching IP addresses for a while so they can take their time to evaluate the issue, but I'd prefer to sort it the proper way instead.

@sysradium

This comment has been minimized.

Show comment
Hide comment
@sysradium

sysradium Sep 11, 2018

Unfortunately no :( Maybe switching IPs is a way to go now ...

sysradium commented Sep 11, 2018

Unfortunately no :( Maybe switching IPs is a way to go now ...

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

We have a hot spare at https://p3.gopkg.in/yaml.v2 ready to switch. Let's give them another moment to evaluate the issue with the domain pointing to the right location, and if it takes too long we switch.

Owner

niemeyer commented Sep 11, 2018

We have a hot spare at https://p3.gopkg.in/yaml.v2 ready to switch. Let's give them another moment to evaluate the issue with the domain pointing to the right location, and if it takes too long we switch.

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

From GitHub:

I'm speaking with our infrastructure teams and we've just updated our status while we work on this. I'll follow up with you as soon as we have an update.

Owner

niemeyer commented Sep 11, 2018

From GitHub:

I'm speaking with our infrastructure teams and we've just updated our status while we work on this. I'll follow up with you as soon as we have an update.

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer
Owner

niemeyer commented Sep 11, 2018

Reflected in https://status.github.com/

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

Update from support:

We think we found the problem machine and are looking for a root cause.

Seems to be working now. Might be fixed, but given that feedback we might still see a few bumps.

Owner

niemeyer commented Sep 11, 2018

Update from support:

We think we found the problem machine and are looking for a root cause.

Seems to be working now. Might be fixed, but given that feedback we might still see a few bumps.

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

And it's sorted:

We've just deployed some changes to resolve this and I can see that https://gopkg.in/mgo.v2 is now loading again. We've updated our status back to green.

Sorry for the trouble this caused you and your users. Don't hesitate to follow up if you're still seeing any problems or if you have any questions.

Owner

niemeyer commented Sep 11, 2018

And it's sorted:

We've just deployed some changes to resolve this and I can see that https://gopkg.in/mgo.v2 is now loading again. We've updated our status back to green.

Sorry for the trouble this caused you and your users. Don't hesitate to follow up if you're still seeing any problems or if you have any questions.

@sysradium

This comment has been minimized.

Show comment
Hide comment
@sysradium

sysradium Sep 11, 2018

@niemeyer unfortunately the problem is back

sysradium commented Sep 11, 2018

@niemeyer unfortunately the problem is back

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

There we go again... just got in touch with them again.

Owner

niemeyer commented Sep 11, 2018

There we go again... just got in touch with them again.

@Ads20000

This comment has been minimized.

Show comment
Hide comment
@Ads20000

Ads20000 commented Sep 11, 2018

Problems have been reflected on GitHub System Status

@andrewslotin

This comment has been minimized.

Show comment
Hide comment
@andrewslotin

andrewslotin Sep 11, 2018

It looks like the same issue is happening again. I'm currently experiencing the same behaviour while trying to install the gometalinter.v2:

$ curl https://gopkg.in/alecthomas/gometalinter.v2
Cannot obtain refs from GitHub: cannot talk to GitHub: Get https://github.com/alecthomas/gometalinter.git/info/refs?service=git-upload-pack: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

andrewslotin commented Sep 11, 2018

It looks like the same issue is happening again. I'm currently experiencing the same behaviour while trying to install the gometalinter.v2:

$ curl https://gopkg.in/alecthomas/gometalinter.v2
Cannot obtain refs from GitHub: cannot talk to GitHub: Get https://github.com/alecthomas/gometalinter.git/info/refs?service=git-upload-pack: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

@andrewslotin Please see the last few messages above.

It also looks like it's almost sorted, from their status page:

image

Owner

niemeyer commented Sep 11, 2018

@andrewslotin Please see the last few messages above.

It also looks like it's almost sorted, from their status page:

image

@Baha-sk

This comment has been minimized.

Show comment
Hide comment
@Baha-sk

Baha-sk Sep 11, 2018

GitHub issue still persisting
golang/go#27622 was closed but my build is still failing.

Thanks!

Baha-sk commented Sep 11, 2018

GitHub issue still persisting
golang/go#27622 was closed but my build is still failing.

Thanks!

@mdittmer

This comment has been minimized.

Show comment
Hide comment
@mdittmer

mdittmer Sep 11, 2018

Is this a special case of this issue?

go get -u gopkg.in/src-d/go-git.v4/...                     
# cd [...]/src/gopkg.in/src-d/go-git.v4; git pull --ff-only                           
remote: Cannot obtain refs from GitHub: cannot talk to GitHub: Get https://github.com/src-d/go-git.git/info/refs?service=git-upload-pack: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
fatal: unable to access 'https://gopkg.in/src-d/go-git.v4/': The requested URL returned error: 502
package gopkg.in/src-d/go-git.v4: exit status 1
package gopkg.in/check.v1: unrecognized import path "gopkg.in/check.v1" (parse https://gopkg.in/check.v1?go-get=1: no go-import meta tags ())
package gopkg.in/src-d/go-git-fixtures.v3: unrecognized import path "gopkg.in/src-d/go-git-fixtures.v3" (parse https://gopkg.in/src-d/go-git-fixtures.v3?go-get=1: no go-import meta tags ())

mdittmer commented Sep 11, 2018

Is this a special case of this issue?

go get -u gopkg.in/src-d/go-git.v4/...                     
# cd [...]/src/gopkg.in/src-d/go-git.v4; git pull --ff-only                           
remote: Cannot obtain refs from GitHub: cannot talk to GitHub: Get https://github.com/src-d/go-git.git/info/refs?service=git-upload-pack: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
fatal: unable to access 'https://gopkg.in/src-d/go-git.v4/': The requested URL returned error: 502
package gopkg.in/src-d/go-git.v4: exit status 1
package gopkg.in/check.v1: unrecognized import path "gopkg.in/check.v1" (parse https://gopkg.in/check.v1?go-get=1: no go-import meta tags ())
package gopkg.in/src-d/go-git-fixtures.v3: unrecognized import path "gopkg.in/src-d/go-git-fixtures.v3" (parse https://gopkg.in/src-d/go-git-fixtures.v3?go-get=1: no go-import meta tags ())
@Baha-sk

This comment has been minimized.

Show comment
Hide comment
@Baha-sk

Baha-sk Sep 11, 2018

looks like it, it's a general Github http 502 error

Baha-sk commented Sep 11, 2018

looks like it, it's a general Github http 502 error

@esetnik

This comment has been minimized.

Show comment
Hide comment
@esetnik

esetnik Sep 11, 2018

@niemeyer can you fail over to hot spare https://p3.gopkg.in/yaml.v2 please?

esetnik commented Sep 11, 2018

@niemeyer can you fail over to hot spare https://p3.gopkg.in/yaml.v2 please?

@niemeyer niemeyer referenced this issue Sep 11, 2018

Closed

go get broken #404

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 11, 2018

Owner

@esetnik Since this is a more general issue on GitHub and the issue comes and goes, we have no guarantees that shifting won't present the same problem. Also, GitHub is using our service to debug their outage, so I'm keen on not masking the problem for them so it can be fixed faster and for good.

Per their support:

It looks like https://gopkg.in/mgo.v2 is accessible at the moment and our team are making use of this URL as they work to resolve the issue. I'll follow up again when I have another update for you.

We also had an update moments ago:

image

Owner

niemeyer commented Sep 11, 2018

@esetnik Since this is a more general issue on GitHub and the issue comes and goes, we have no guarantees that shifting won't present the same problem. Also, GitHub is using our service to debug their outage, so I'm keen on not masking the problem for them so it can be fixed faster and for good.

Per their support:

It looks like https://gopkg.in/mgo.v2 is accessible at the moment and our team are making use of this URL as they work to resolve the issue. I'll follow up again when I have another update for you.

We also had an update moments ago:

image

@adriamb

This comment has been minimized.

Show comment
Hide comment
@adriamb

adriamb Sep 11, 2018

there's any known workaround for golang module system? Like adding/modifying something in the go.mod?

adriamb commented Sep 11, 2018

there's any known workaround for golang module system? Like adding/modifying something in the go.mod?

@esetnik

This comment has been minimized.

Show comment
Hide comment
@esetnik

esetnik Sep 11, 2018

@esetnik Since this is a more general issue on GitHub and the issue comes and goes, we have no guarantees that shifting won't present the same problem. Also, GitHub is using our service to debug their outage, so I'm keen on not masking the problem for them so it can be fixed faster and for good.

Per their support:

It looks like https://gopkg.in/mgo.v2 is accessible at the moment and our team are making use of this URL as they work to resolve the issue. I'll follow up again when I have another update for you.

We also had an update moments ago:

image

I'm not sure what's different about your connection, but I definitely cannot resolve https://gopkg.in/mgo.v2. I think it's a bit unreasonable for Github team to assume third-parties won't alter their own infrastructure to do everything they can to mitigate upstream affects of the outage for their users.

esetnik commented Sep 11, 2018

@esetnik Since this is a more general issue on GitHub and the issue comes and goes, we have no guarantees that shifting won't present the same problem. Also, GitHub is using our service to debug their outage, so I'm keen on not masking the problem for them so it can be fixed faster and for good.

Per their support:

It looks like https://gopkg.in/mgo.v2 is accessible at the moment and our team are making use of this URL as they work to resolve the issue. I'll follow up again when I have another update for you.

We also had an update moments ago:

image

I'm not sure what's different about your connection, but I definitely cannot resolve https://gopkg.in/mgo.v2. I think it's a bit unreasonable for Github team to assume third-parties won't alter their own infrastructure to do everything they can to mitigate upstream affects of the outage for their users.

@brandoncole

This comment has been minimized.

Show comment
Hide comment
@brandoncole

brandoncole Sep 11, 2018

We haven't been able to build our packages in CircleCI for 8+ hours because of this GitHub issue. We might be able to override some IPs in the build containers but this is a really crappy situation to be in. I'm experiencing all the issues pointed out above while this occurs on the Github side.

brandoncole commented Sep 11, 2018

We haven't been able to build our packages in CircleCI for 8+ hours because of this GitHub issue. We might be able to override some IPs in the build containers but this is a really crappy situation to be in. I'm experiencing all the issues pointed out above while this occurs on the Github side.

@glb

This comment has been minimized.

Show comment
Hide comment
@glb

glb Sep 11, 2018

Issue appears to be resolved from here at least! 🎉 My build just passed.

image

glb commented Sep 11, 2018

Issue appears to be resolved from here at least! 🎉 My build just passed.

image

@Baha-sk

This comment has been minimized.

Show comment
Hide comment
@Baha-sk

Baha-sk Sep 11, 2018

same here... but hopefully it's not intermittent.

Baha-sk commented Sep 11, 2018

same here... but hopefully it's not intermittent.

@sublee

This comment has been minimized.

Show comment
Hide comment
@sublee

sublee Sep 12, 2018

The GitHub status says everything operates normally since 6 hours ago: ("한국 표준시" in the screenshot means KST, UTC+9)

image

When I visit http://gopkg.in/yaml.v2 in a Web browser, it works as well. But my build in Travis CI is still failing (gin-gonic depends on go-yaml in gopkg.in):

$ dep ensure -update github.com/hangulize/hangulize
Solving failure:
	(1) failed to list versions for https://gopkg.in/yaml.v2: remote: Not Found
fatal: repository 'https://github.com/go-yaml/yaml/' not found
: exit status 128
	(2) failed to list versions for http://gopkg.in/yaml.v2: remote: Not Found
fatal: repository 'http://github.com/go-yaml/yaml/' not found
: exit status 128

Is there anyone who has an idea about this experience?

sublee commented Sep 12, 2018

The GitHub status says everything operates normally since 6 hours ago: ("한국 표준시" in the screenshot means KST, UTC+9)

image

When I visit http://gopkg.in/yaml.v2 in a Web browser, it works as well. But my build in Travis CI is still failing (gin-gonic depends on go-yaml in gopkg.in):

$ dep ensure -update github.com/hangulize/hangulize
Solving failure:
	(1) failed to list versions for https://gopkg.in/yaml.v2: remote: Not Found
fatal: repository 'https://github.com/go-yaml/yaml/' not found
: exit status 128
	(2) failed to list versions for http://gopkg.in/yaml.v2: remote: Not Found
fatal: repository 'http://github.com/go-yaml/yaml/' not found
: exit status 128

Is there anyone who has an idea about this experience?

@jney

This comment has been minimized.

Show comment
Hide comment
@jney

jney Sep 12, 2018

maybe they do have cache. I just opened travis an issue

jney commented Sep 12, 2018

maybe they do have cache. I just opened travis an issue

@niemeyer

This comment has been minimized.

Show comment
Hide comment
@niemeyer

niemeyer Sep 12, 2018

Owner

Apparently they've solved the issue for good, so I'm closing this one as well.

Sorry for the trouble everyone.

Owner

niemeyer commented Sep 12, 2018

Apparently they've solved the issue for good, so I'm closing this one as well.

Sorry for the trouble everyone.

@niemeyer niemeyer closed this Sep 12, 2018

@sublee

This comment has been minimized.

Show comment
Hide comment
@sublee

sublee Sep 14, 2018

My problem #63 (comment) was not due to this service issue. The reason was GIT_HTTP_USER_AGENT customized by Travis CI's deploy stage. Travis CI sets it as GIT_HTTP_USER_AGENT=travis/0.1.0 dpl/1.10.0 git/2.15.1 only in the deploy stage.

GitHub's git HTTPS URL without .git, like https://github.com/go-yaml/yaml rather than https://github.com/go-yaml/yaml.git, fails on an unexpected User-Agent header.

$ GIT_HTTP_USER_AGENT='' go get gopkg.in/yaml.v2
# cd .; git clone <https://gopkg.in/yaml.v2> .../go/src/gopkg.in/yaml.v2
Cloning into '.../go/src/gopkg.in/yaml.v2'...
error: RPC failed; HTTP 422 curl 22 The requested URL returned error: 422 Unprocessable Entity
fatal: The remote end hung up unexpectedly
package gopkg.in/yaml.v2: exit status 128

sublee commented Sep 14, 2018

My problem #63 (comment) was not due to this service issue. The reason was GIT_HTTP_USER_AGENT customized by Travis CI's deploy stage. Travis CI sets it as GIT_HTTP_USER_AGENT=travis/0.1.0 dpl/1.10.0 git/2.15.1 only in the deploy stage.

GitHub's git HTTPS URL without .git, like https://github.com/go-yaml/yaml rather than https://github.com/go-yaml/yaml.git, fails on an unexpected User-Agent header.

$ GIT_HTTP_USER_AGENT='' go get gopkg.in/yaml.v2
# cd .; git clone <https://gopkg.in/yaml.v2> .../go/src/gopkg.in/yaml.v2
Cloning into '.../go/src/gopkg.in/yaml.v2'...
error: RPC failed; HTTP 422 curl 22 The requested URL returned error: 422 Unprocessable Entity
fatal: The remote end hung up unexpectedly
package gopkg.in/yaml.v2: exit status 128
@acloudiator

This comment has been minimized.

Show comment
Hide comment
@acloudiator

acloudiator Sep 27, 2018

Github status seems all good for today, but I encountered this issue again.

package gopkg.in/inf.v0: unrecognized import path "gopkg.in/inf.v0" (https fetch: Get https://gopkg.in/inf.v0?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)
package gopkg.in/mgo.v2: unrecognized import path "gopkg.in/mgo.v2" (https fetch: Get https://gopkg.in/mgo.v2?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)
package gopkg.in/mgo.v2/bson: unrecognized import path "gopkg.in/mgo.v2/bson" (https fetch: Get https://gopkg.in/mgo.v2/bson?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)

acloudiator commented Sep 27, 2018

Github status seems all good for today, but I encountered this issue again.

package gopkg.in/inf.v0: unrecognized import path "gopkg.in/inf.v0" (https fetch: Get https://gopkg.in/inf.v0?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)
package gopkg.in/mgo.v2: unrecognized import path "gopkg.in/mgo.v2" (https fetch: Get https://gopkg.in/mgo.v2?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)
package gopkg.in/mgo.v2/bson: unrecognized import path "gopkg.in/mgo.v2/bson" (https fetch: Get https://gopkg.in/mgo.v2/bson?go-get=1: dial tcp 35.196.143.184:443: i/o timeout)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment