Split transports up, make the bundle smaller include transports separately

[mitra42]

As more transports get integrated into dweb-transports, and as the IA's UI team start looking at using dweb-archivecontroller which depends on dweb-transports, its become necessary to split up dweb-transports and make it lighter.

Solution will need ...

• Work in nodejs
• Work in browser via webpack
• At some point work in browser via ES6 modules

Experimentation is in the 'split' branch, which may or may not always be working !

Steps might be ... (this section will be edited)

• Pull out each transport to its own script (most are NOT ES6 Module compatable)

  • Ideally these will be the standard, maintained scripts that each transport supports
  • have TransportXxx.load() find the result of the <script> and wrap in its own API
  • figure out how to do this in nodejs,
    • maybe at the application level (where it chooses to pass e.g. "IPFS" to Transports.connect()

• Split each transport, test in browser and node

  • IPFS - see below
  • gun - see below
  • http (splits out httptools or maybe include them always)
  • webtorrent - see below
  • wolk - see below
  • yjs

• Move code from DA/archive.html and DM/internetarchive.js into DTS/Transports &/or shims

• Cleanup - when this is done

  • move naming into DwebTransports or remove, then remove need for dweb-objects
    • see Split: Naming - move into transports then refactor #22 Remove dependency remnants on dweb-objects dweb-archive#149 Remove remnants of dweb-objects dweb-mirror#250
  • split contenthash into its own transport (depending on http) as not really used
  • move the caching from dwebMirror into a module (maybe)

• figure out distribution mechanisms for

  • dweb-mirror shouldnt include IPFS/GUN etc by defaut, but needs way to add
  • dweb-archive bundled with DM, should not include node_modules or bundle with transports
  • dweb-archive on its own, needs to have all transports

[mitra42]

IPFS

• comment out in TransportIPFS
• add in via document.write in archive.html
• move into dist during install so dont get cross-origin warning relating to unpkg
• make sure updated during updates on each platform

[mitra42]

GUN

• comment out in TransportGUN size before = 2.65Mb after = 2.61Mb
• add in via document.write in archive.html
  • unclear how ?
• move into dist during install so dont get cross-origin warning relating to unpkg
• make sure updated during updates on each platform

[mitra42]

WEBTORRENT

• comment out in TransportGUN size before = 2.65Mb after = 2.61Mb
• add in via document.write in archive.html
• move into dist during install so dont get cross-origin warning relating to unpkg
• make sure updated during updates on each platform

[mitra42]

WOLK

• comment out in TransportGUN size before = 2.65Mb after = 2.61Mb
• add in via document.write in archive.html
• Fails - as script doesnt generate a global
• move into dist during install so dont get cross-origin warning relating to unpkg
• make sure updated during updates on each platform

[mitra42]

YJS

• comment out in TransportGUN size before = 2.65Mb after = 2.61Mb
• add in via document.write in archive.html
• move into dist during install so dont get cross-origin warning relating to unpkg
• make sure updated during updates on each platform