Update example multiaddrs of boostrap nodes #772

mburns · 2020-10-06T04:58:49Z

This updates the docs to point to new(er) bootstrap nodes. Infra would like to decouple how we announce bootstrap records so that the datacenter (ams-1, lon-1) is not strictly tied to a peer id (QmSol...).

These new examples are using servers on different continents, instead of both being EU-based.

This points to 2 new bootstrap nodes, as we would like to decouple the datacenter (`ams-1`, `lon-1`) from the peer id. Also, this (currently) uses both an EU and US based servers, instead of bother being EU-based.

vasco-santos

Thanks for the PR @mburns

I tried the browser example with the new addresses, but they are all failing:

WebSocket connection to 'wss://bootstrap.libp2p.io/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa' failed: Error in connection establishment: net::ERR_NAME_NOT_RESOLVED

Is this blocked by https://github.com/protocol/bifrost-infra/pull/827 ?

mburns · 2020-10-06T18:36:13Z

Is this blocked by protocol/bifrost-infra#827 ?

Hrm. Nope, the new addresses have been live and in production for several months.

I've kicked one of the instances that seemed wedged:

$ ipfs swarm connect /dns4/bootstrap.libp2p.io/tcp/443/wss/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa
connect QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa success

Otherwsie, all connect for me.

vasco-santos · 2020-10-07T07:54:40Z

I am able to dial using go-ipfs, but not in JS. The address is not being resolved.
While wss://ams-1.bootstrap.libp2p.io:443/p2p/QmSoLer265NRgSp2LA3dPaeykiS1J6DifTC88f5uVQKNAd (old bootstrap) resolves and connects, the same does not happen with wss://bootstrap.libp2p.io:443/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN.

I am getting on websockets:

message: 'getaddrinfo ENOTFOUND bootstrap.libp2p.io',
  error: Error: getaddrinfo ENOTFOUND bootstrap.libp2p.io
      at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:66:26) {
    errno: 'ENOTFOUND',
    code: 'ENOTFOUND',
    syscall: 'getaddrinfo',
    hostname: 'bootstrap.libp2p.io'
  }

@jacobheun any ideas?

jacobheun · 2020-10-07T12:30:49Z

/dns4/bootstrap.libp2p.io/tcp/443/wss/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa
/dns4/bootstrap.libp2p.io/tcp/443/wss/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN

@mburns @vasco-santos these are bad addresses. It "works" in go-ipfs because it already knows good addresses for those peers due to dnsaddr TCP addr resolution on boot. There is no dns4 resolution for bootstrap.libp2p.io, only TXT records, so this will never resolve.

@vasco-santos we need to implement multiformats/js-multiaddr#94 (comment).

The bootstrap addresses should ideally just be:

/dnsaddr/bootstrap.libp2p.io/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa
/dnsaddr/bootstrap.libp2p.io/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN

@mburns In order for the dnsaddr's to work we also need the TXT records to contain the wss addresses, can we add them?

A temporary workaround would be to use the underlying subdomains:

/dns4/ewr-1.bootstrap.libp2p.io/tcp/443/wss/p2p/QmQCU2EcMqAqQPR2i9bChDtGNJchTbq5TbXJJ16u19uLTa
/dns4/sjc-1.bootstrap.libp2p.io/tcp/443/wss/p2p/QmNnooDu7bfjPFoTZYxMNLWUQJyrVwtbZg5gBMjTezGAJN

This isn't great because we're still hardcoding the subdomain addresses but until we add dnsaddr resolution in JS and add wss addresses to the TXT records, we can't dynamically resolve this.

@vasco-santos let's sync up to get the dnsaddr resolution support done so we're no longer blocked there.

vasco-santos · 2020-10-08T15:55:24Z

Do we have any example on how the TXT records will look like?

jacobheun · 2020-10-08T16:11:26Z

Do we have any example on how the TXT records will look like?

You can use dig to see the existing multiaddrs, dig -t TXT _dnsaddr.bootstrap.libp2p.io.

Or a curl from Cloudflare's service:
curl -H 'accept: application/dns-json' 'https://cloudflare-dns.com/dns-query?name=_dnsaddr.bootstrap.libp2p.io&type=TXT'

vasco-santos · 2020-10-08T16:16:15Z

Cool thanks! I was missing the _dnsaddr part. I could get it now

mburns · 2020-10-10T01:02:37Z

thanks for connecting those dots, @jacobheun

wss (and quic) addresses are now being advertised for the Bootstrap nodes.

$ dig +short TXT _dnsaddr.bootstrap.libp2p.io | tail -n 1
"dnsaddr=/dnsaddr/sjc-2.bootstrap.libp2p.io/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"

=>

$ dig +short TXT _dnsaddr.sjc-2.bootstrap.libp2p.io
"dnsaddr=/ip4/147.75.109.29/tcp/4001/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip4/147.75.109.29/tcp/443/wss/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip4/147.75.109.29/udp/4001/quic/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip6/2604:1380:1000:6000::5/tcp/4001/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip6/2604:1380:1000:6000::5/tcp/443/wss/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip6/2604:1380:1000:6000::5/udp/4001/quic/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"

jacobheun · 2020-10-12T14:44:59Z

@mburns so one problematic thing we have to deal with for wss addresses is that we can't resolve the domain in the dnsaddr record, because we need it for SSL resolution.

/ip4/147.75.109.29/tcp/443/wss/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp needs to be backed by an SSL certificate for the browser to resolve it so we actually need the dns address to return, because we have to pass the domain to the Websocket transport in order for it to resolve in browsers.

So I think it will need to look like:

$ dig +short TXT _dnsaddr.sjc-2.bootstrap.libp2p.io
"dnsaddr=/ip4/147.75.109.29/tcp/4001/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/dns4/sjc-2.bootstrap.libp2p.io/tcp/443/wss/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip4/147.75.109.29/udp/4001/quic/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip6/2604:1380:1000:6000::5/tcp/4001/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/dns6/sjc-2.bootstrap.libp2p.io/tcp/443/wss/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"
"dnsaddr=/ip6/2604:1380:1000:6000::5/udp/4001/quic/p2p/QmZa1sAxajnQjVM8WjWXoMbmPd7NsWhfKsPkErzpm9wGkp"

And we have to avoid resolving dns4/dns6 addresses on the JS side.

mburns · 2020-10-14T01:12:48Z

So I think it will need to look like:

Great. I've pushed those changes:

$  dig +short TXT _dnsaddr.nyc-2.bootstrap.libp2p.io
"dnsaddr=/dns4/nyc-2.bootstrap.libp2p.io/tcp/443/wss/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/dns6/nyc-2.bootstrap.libp2p.io/tcp/443/wss/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip4/104.236.76.40/tcp/4001/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip4/104.236.76.40/tcp/443/wss/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip4/104.236.76.40/udp/4001/quic/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip6/2604:a880:800:10::4a:5001/tcp/4001/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip6/2604:a880:800:10::4a:5001/tcp/443/wss/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"
"dnsaddr=/ip6/2604:a880:800:10::4a:5001/udp/4001/quic/p2p/QmSoLV4Bbm51jM9C4gDYZQ9Cy3U6aXMJDAbzgu2fzaDs64"

vasco-santos

LGTM! Merging this into #782 with the doh resolver

Adds the new `dnsaddr` multiaddrs for browser bootstrapping peers per libp2p/js-libp2p#772 and libp2p/js-libp2p#782

mburns added 2 commits October 6, 2020 04:55

Update example multiaddrs of boostrap nodes

cb6c8c5

This points to 2 new bootstrap nodes, as we would like to decouple the datacenter (`ams-1`, `lon-1`) from the peer id. Also, this (currently) uses both an EU and US based servers, instead of bother being EU-based.

update example code to use new boostrap fqdn

9dcc27f

mburns mentioned this pull request Oct 6, 2020

update example bootstrap list to use newer nodes ipfs/js-dag-service#397

Closed

14 tasks

vasco-santos reviewed Oct 6, 2020

View reviewed changes

mburns marked this pull request as draft October 7, 2020 22:12

mburns added 3 commits October 10, 2020 01:03

use dnsaddr, fix multiaddr

3db8a3f

use dnsaddr

8fda65a

use dnsaddr

bd1c6b2

vasco-santos mentioned this pull request Oct 13, 2020

feat: resolve multiaddrs before dial #782

Merged

2 tasks

vasco-santos mentioned this pull request Oct 15, 2020

feat: add dnsnaddr p2p multiformats/js-mafmt#62

Merged

vasco-santos changed the base branch from master to feat/resolve-multiaddrs-before-dial October 30, 2020 10:54

vasco-santos marked this pull request as ready for review October 30, 2020 10:56

vasco-santos approved these changes Oct 30, 2020

View reviewed changes

vasco-santos merged commit 3b3911b into libp2p:feat/resolve-multiaddrs-before-dial Oct 30, 2020

vasco-santos pushed a commit that referenced this pull request Oct 30, 2020

chore: update example multiaddrs of boostrap nodes (#772)

336ee0c

vasco-santos mentioned this pull request Nov 5, 2020

chore: use dnsaddr for bootstrap nodes ipfs/js-ipfs#3370

Merged

achingbrain pushed a commit to ipfs/js-ipfs that referenced this pull request Nov 6, 2020

chore: use dnsaddr for bootstrap nodes (#3370)

7a0f1a2

Adds the new `dnsaddr` multiaddrs for browser bootstrapping peers per libp2p/js-libp2p#772 and libp2p/js-libp2p#782

mburns mentioned this pull request Nov 30, 2020

remove references to Solarnet #820

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update example multiaddrs of boostrap nodes #772

Update example multiaddrs of boostrap nodes #772

mburns commented Oct 6, 2020 •

edited

vasco-santos left a comment

mburns commented Oct 6, 2020 •

edited

vasco-santos commented Oct 7, 2020

jacobheun commented Oct 7, 2020

vasco-santos commented Oct 8, 2020

jacobheun commented Oct 8, 2020

vasco-santos commented Oct 8, 2020

mburns commented Oct 10, 2020

jacobheun commented Oct 12, 2020

mburns commented Oct 14, 2020 •

edited

vasco-santos left a comment

Update example multiaddrs of boostrap nodes #772

Update example multiaddrs of boostrap nodes #772

Conversation

mburns commented Oct 6, 2020 • edited

vasco-santos left a comment

Choose a reason for hiding this comment

mburns commented Oct 6, 2020 • edited

vasco-santos commented Oct 7, 2020

jacobheun commented Oct 7, 2020

vasco-santos commented Oct 8, 2020

jacobheun commented Oct 8, 2020

vasco-santos commented Oct 8, 2020

mburns commented Oct 10, 2020

jacobheun commented Oct 12, 2020

mburns commented Oct 14, 2020 • edited

vasco-santos left a comment

Choose a reason for hiding this comment

mburns commented Oct 6, 2020 •

edited

mburns commented Oct 6, 2020 •

edited

mburns commented Oct 14, 2020 •

edited