COMPOST website on DWeb

[benhylau]

🎟️ Re-ticketed from: #
📅 Due date: Jan 18, 2021
🎯 Success criteria: Put COMPOST website on WWW, IPFS, HYPERCORE.

Task Summary

Publish COMPOST site on staging.compost.digital then compost.digital.

Publish COMPOST api on api.staging.compost.digital then api.compost.digital.

To Do

• Set up Nginx files for WWW @ASoTNetworks
  • Map <project.domain>/ -> distributed.press/compost/ and verify SSL certs
  • Map api.<project.domain>/ -> api.distributed.press/compost/ and verify SSL certs
  • Map <project.domain>/ -> ~/.distributed-press/data/projects/staging.compost.digital/www/ and verify SSL certs
  • Map api.<project.domain>/ -> ~/.distributed-press/data/projects/staging.compost.digital/api/ and verify SSL certs
• Publish on IPFS
• Publish on Hypercore
• Verify that site and api work according to the URLs in the spec
• Update content to display DWeb URLs

[benhylau]

@ASoTNetworks you can publish this site if you like to test out #17 this way we have two web roots to test:

• compost.digital
• one.compost.digital

[benhylau]

IPFS more or less works now, aside from some subdomain-based gateway/Opera Android issue that IPFS is already investigating. See bottom right of the footer here, it's working https://ipfs.io/ipns/staging.compost.digital

For Hypercore pinning, it's "code complete" but somehow dat-store doesn't do what I expect it to do. Specifically:

• pinning the website just hung at hyperdrive-publisher.sync (even tho the first time it showed the diff) you'll see that the archives aren't available
  • https://hyper.distributed.press/eae46fb25b88cfd1b8cd2bb7e45584d9f1170065422dbfab05adade945f22b20/
  • https://hyper.distributed.press/staging.compost.digital
• the gateway returns stale data https://hyper.distributed.press/api.staging.compost.digital/monetization (balances.json should be there)
• the dat-store CLI is always hung now, and I have tried wiping urls manually, but publishing the site seems to break it

Aside from this, the last couple commits I made to https://github.com/hyphacoop/compost.digital contains some learnings about how to design dweb compatible websites. @bennlich we should sync up in Jan about this, mainly relating to paths and ending files with .html

1. links need to be relative, with ./ and ../ indicating the level of depth
2. URLs need to end in .html not some virtual path like ./about/

cc. @ASoTNetworks @RangerMauve

[benhylau]

On IPFS, even though bafybeigks5khlraols4otk3n4nlcipzphyjxpkbgfboiihby5rkjc75aqm is available on our server and ipfs.io, I can't seem to get it on some other servers with ipfs get bafybeigks5khlraols4otk3n4nlcipzphyjxpkbgfboiihby5rkjc75aqm and public gateways. Let's try again after we open 4001.

[benhylau]

• pinning the website just hung at hyperdrive-publisher.sync

This is fixed temporarily with a long sync timeout, and filed RangerMauve/hyperdrive-publisher#8 (comment) for hypercore-publisher to implement a long-term fix.

Hopefully this also addresses the other two hypercore problems above.

(Edit: Actually it didn't fully work. A bunch of assets didn't get uploaded https://hyper.distributed.press/staging.compost.digital/about.html#partners-and-supporters see how six of those png files are missing.)

[benhylau]

All the links in this spec's example are now working 🚀

[bennlich]

@benhylau Should these links work?

https://ipfs.distributed.press/ipns/api.staging.compost.digital/v0/monetization/balances.json
https://hyper.distributed.press/api.staging.compost.digital/v0/monetization/balances.json
https://api.staging.compost.digital/v0/monetization/balances.json

I got them from https://github.com/hyphacoop/api.distributed.press#monetization-api