Sprint January 25th

[RichardLitt]

Sprint January 25

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Time (PDT - UTC/Z - CET)	Pad
apps on ipfs	Juan Benet	10:30PDT 18:30Z 19:30CET	https://public.etherpad-mozilla.org/p/ipfs-Jan-25-apps-on-ipfs
infrastructure	Lars Gierth	11:00PDT 19:00Z 20:00CET	https://public.etherpad-mozilla.org/p/ipfs-Jan-25-infrastructure
libp2p	David Dias	11:30PDT 19:30Z 20:30CET	https://public.etherpad-mozilla.org/p/ipfs-Jan-25-libp2p
js-ipfs	David Dias	12:00PDT 20:00Z 21:00CET	https://public.etherpad-mozilla.org/p/ipfs-Jan-25-js-ipfs
go-ipfs	Jeromy Johnson	12:30PDT 20:30Z 21:30CET	https://public.etherpad-mozilla.org/p/ipfs-Jan-25-go-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add your tasks below in a comment, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[daviddias]

libp2p

Lead: @diasdavid

Agenda

• utp-native

Notes

• Current focus in more on js-ipfs
• We know have an utp implementation that uses libutp (propts to @maffintosh)
• ucat module https://www.npmjs.com/package/ucat like netcat, but with utp
• Jeromy Coffee Talks this Wednesday about gx

[hackergrrl]

@noffle

• pm
  • meet up & work with @jbenet in PA on Thursday
  • chat with @diasdavid re: helping out on js-ipfs
  • share upcoming summer vacation dates
• go-ipfs
  • LGTM+merge Resolve paths in 'pin rm' /wo network lookup kubo#2201
  • mounting only /ipfs (Mount only /ipfs/ kubo#2187)
• ipget
  • LGTM+merge adds 'ipget' to distributions distributions#42
  • start on sharness tests
  • support custom bootstrap list
  • improve readme

[daviddias]

js-ipfs

Lead: @diasdavid

Participants

Agenda

• Status Update
• Data Importing
• API work
• Lot of things can worked in parallel
• close goals
• have files add working
• have remainingt parts of files api working

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Notes

• Write an entry on ipfs/community with what is Captain.log
• Update Captain.log for js-ipfs
• Describe what are all the things that can be done right no to help js-ipfs
• Implement js-ipfs files add

[daviddias]

DAVID DIAS TODO

• js-ipfs
  • Write Captain.log entry 🚣 captain.log - IPFS JavaScript implementation 🌟 js-ipfs#30
  • Open issues for each component that can be already made https://github.com/ipfs/js-ipfs/issues
  • CR+M Use buffer-loader for tests js-ipfs#62
  • Update to latest repo (and enable browser tests) WIP: move to latest ipfs-repo js-ipfs#61
  • js-ipfs-repo
  • CR+M Get tests to pass using indexeddb instead of local-storage js-ipfs-repo#27
  • CR+M Use buffer-loader on tests instead of raw-loader js-ipfs-repo#28
  • Architecture Overview add full architecture visualization js-ipfs#64
  • js-ipfs-merkle-dag
    • dag-service
      • refactor https://github.com/vijayee/js-ipfs-merkle-dag/pull/10
      • fix bugs + complete impl + finish tests https://github.com/vijayee/js-ipfs-merkle-dag/pull/14
      • fix serialisation (to right block size) https://github.com/vijayee/js-ipfs-merkle-dag/pull/15
    • es6ify + mochaify https://github.com/vijayee/js-ipfs-merkle-dag/pull/13
  • js-ipfs-blocks
    • factor it out from merkle-dag module https://github.com/ipfs/js-ipfs-blocks
    • mochafy Mochafy js-ipfs-block-service#1
    • es6ify es6ify js-ipfs-block-service#2
  • js-ipfs-data-importing
    • files add
• api documentation
• js-ipfs-api
  • rebase master on files-api Update to be compatible with IPFS 0.4.0 ipfs-inactive/js-ipfs-http-client#74
• libp2p
  • utp
    • Make tests for utp-native
• npm on ipfs
  • update ipfs-blob-store to latest js-ipfs-api + add more docs + add option to set the flush flag Update to latest js-ipfs-api and make ipfs-blob-store more easy to co… ipfs-shipyard/ipfs-blob-store#9
  • pick custom repo path and option to init it or not Enable the use of a custom repo path and decide if we want to init or not js-ipfsd-ctl#48
  • refactor a bunch + adding more tests Refactoring the Code ipfs-shipyard/npm-on-ipfs#30
  • log latest folder hash by creating a record of files stat /npm-registry add logging to the root of npm registry, if needed ipfs-shipyard/npm-on-ipfs#31
• specs
• extra
  • Document what is captain.log in ipfs/community captain.log, aye, where is my grog community#100
  • Jeromy Coffee Talks on GX this Wednesday
  • R Added block and its subcommands ipfs-inactive/http-api-spec#25
  • R Added Group bitswap ipfs-inactive/http-api-spec#24
  • Host an IPFS Hack Day in Lisbon
  • Check "needs review" label everyday and give my input
  • Send proposal to http://icwe2016.inf.usi.ch/ for a Tutorial

[whyrusleeping]

@whyrusleeping TODO:

TODO:

• 0.3.11 changelog
• modtimes in files api
• fix ipfs files 'deadlocks'
• private networks
  • implement 'encrypted transport' thing
• thin out go-libp2p deps
  • go-net needs to die
• directory sharding
• node aliases (should be easy to add to config)
  • keep map in IpfsNode object, maybe in resolver too
• docker testing networks (with routers, upnp, nat-pmp, etc)
• progress bar lib

[ghost]

@lgierth todo

• dev040
  • ipfs.io v03x/v04x multiplexing via multireq
  • review monday's post mortem
  • stop multireq from following redirects
  • make multireq more robust
  • migrate pinbot to v04x
• infrastructure
  • captain's log
  • merge ng branch
  • stop using docker networking (no more bootstrappers behind NAT)
  • consolidate, it's a bit messy at the moment
• misc
  • set up sundial
  • set up yubikey / 2-factor-auth
  • work through github notifications backlog
• wishlist
  • ipv6 for ipfs.io
  • make use of _dnslink and cname
  • wildcart cert for *.ipfs.io

[dignifiedquire]

@dignifieqquire TODO

•  Fight with node streams
•  Improve data flow in the webui

[RichardLitt]

To do

• Sprint Management
• Write the weekly roundup, plan the next one
• IPFS API
  • Add curl commands to all method descriptions
  • Check all responses have maximal entries
  • Open a feature issue about having multiple language implementations for curl requests

[whyrusleeping]

Go-ipfs notes:

Lead: @whyrusleeping

Participants

@RichardLitt
@jbenet
@kyledrake
@dignifiedquire

This Week

gx vendoring of go-libp2p

• will need others to try it out
  • 0.4.0 release
• mark release canidate
• testing testing testing
• taking more time is okay
  • networking tests
• CORE
• imunes
• want to have it CLI based
  • webui updates
• automated
• version checks

[Kubuxu]

@Kubuxu Update:

• - resolving dnslink under _dnslink. - Make dns resolve paths under _dnslink.example.com kubo#2191
• - buying ipfs.ovh to dnslink random things (if you need anything linked, just ping me on IRC)
• - changing (again) domain of my codebin to https://ipfs.io/ipns/bin.ipfs.ovh/ - Change URL of hasteIPFS to new domain awesome-ipfs#44
• - restructuring the codebin (it is a complete mess) - https://github.com/kubuxu/hasteipfs
• - vectorised logo - Add vector logos ipfs-inactive/logo#7
• - migrating my nodes to 0.4 - one test node already is migrated, everything seems to work

[daviddias]

DAVID DIAS CHECK IN

js-ipfs

• write a captain.log entry 🚣 captain.log - IPFS JavaScript implementation 🌟 js-ipfs#30
• document possible good contributions, tag them by difficulty level https://github.com/ipfs/js-ipfs/issues
• CR+M Use buffer-loader for tests js-ipfs#62
• update to latest repo (and enable browser tests) WIP: move to latest ipfs-repo js-ipfs#61
  • js-ipfs-repo
• CR+M Get tests to pass using indexeddb instead of local-storage js-ipfs-repo#27
• CR+M Use buffer-loader on tests instead of raw-loader js-ipfs-repo#28
• Create an architecture overview to help everyone understand how pieces tie together add full architecture visualization js-ipfs#64
  • js-ipfs-merkle-dag
    • dag-service
      • refactor https://github.com/vijayee/js-ipfs-merkle-dag/pull/10
      • fix bugs + complete impl + finish tests https://github.com/vijayee/js-ipfs-merkle-dag/pull/14
      • fix serialisation (to right block size) https://github.com/vijayee/js-ipfs-merkle-dag/pull/15
    • es6ify + mochaify https://github.com/vijayee/js-ipfs-merkle-dag/pull/13
  • js-ipfs-blocks
    • factor it out from merkle-dag module https://github.com/ipfs/js-ipfs-blocks
    • mochafy Mochafy js-ipfs-block-service#1
    • es6ify es6ify js-ipfs-block-service#2
  • js-ipfs-data-importing
    • file -> merkledag works and I can move it around with IPFS, but I was seeing some weird encoding, so went back and did all of the above to improve ipfs-blocks and merkle-dag, fixing problems along the way

js-ipfs-api

• rebase master on files-api Update to be compatible with IPFS 0.4.0 ipfs-inactive/js-ipfs-http-client#74

npm on ipfs

• update ipfs-blob-store to latest js-ipfs-api + add more docs + add option to set the flush flag Update to latest js-ipfs-api and make ipfs-blob-store more easy to co… ipfs-shipyard/ipfs-blob-store#9
• pick custom repo path and option to init it or not Enable the use of a custom repo path and decide if we want to init or not js-ipfsd-ctl#48
• refactor a bunch + adding more tests Refactoring the Code ipfs-shipyard/npm-on-ipfs#30
• log latest folder hash by creating a record of files stat /npm-registry add logging to the root of npm registry, if needed ipfs-shipyard/npm-on-ipfs#31

extra

• Document what is captain.log in ipfs/community captain.log, aye, where is my grog community#100
• Jeromy Coffee Talks on GX this Wednesday
• R Added block and its subcommands ipfs-inactive/http-api-spec#25
• R Added Group bitswap ipfs-inactive/http-api-spec#24
• Host an IPFS Hack Day in Lisbon Lisbon IPFS Sunday Hack Day community#103
• Check "needs review" label everyday and give my input
• Send proposal to http://icwe2016.inf.usi.ch/ for a Tutorial

[dignifiedquire]

@dignifiedquire Sprint Update

JS IPFS

• Won fight with node streams (https://github.com/dignifiedquire/idb-plus-blob-store) (this cost me more time of my life than I'd like to admit..) ⭐
• CR
  • Use buffer-loader on tests instead of raw-loader js-ipfs-repo#28
  • Use buffer-loader for tests js-ipfs#62
• Find and file bug in webpack Arrow functions are not getting node globals injected webpack/webpack#1944

Webui

• Improve data flow in the webui
  • Research into redux and co
  • Settled on redux + redux-saga ⭐
  • [~] Start conversion [WIP] Implement Redux ipfs-webui#229
• Update dependencies to lates

dist.ipfs.io

• CR and merge tmp-build -> ipfs distributions#47
• Build and release new dist.ipfs.io

Misc

• Record CoffeeTalk about gx ⭐

[hackergrrl]

noffle sync update

I went down an 'ipfs mount` rabbit hole when looking at ipfs/kubo#2187. I realized that we were letting users publish manually while /ipns was mounted. Then I realized that we don't do state cleanup after a user 'ipfs mount's -- we assume it's still mounted as long as the daemon is running. In fixing that I realized that test nodes often fail to publish (since we try to pull their pubkey from the dht, which is often not yet populated by a fresh node). And then in this I felt that 'ipfs mount' as a command could benefit from some improvements, and so I started a discussion on this (ipfs/notes#105).

• pm
  • meet up & work with @jbenet in PA on Thursday
  • chat with @diasdavid re: helping out on js-ipfs
  • share upcoming summer vacation dates
• go-ipfs
  • LGTM+merge Resolve paths in 'pin rm' /wo network lookup kubo#2201
  • [~] mounting only /ipfs (Mount only /ipfs/ kubo#2187)
    • [~] error out on 'ipfs name publish' if /ipns is already mounted
      • [~] do proper state clean-up when the user unmounts /ipfs or /ipns
        • [~] fix sharness tests from failing when a new node tries to mount (Adds offline key resolution on ipns mount. kubo#2266)
    • research what a 'mount'-compatible 'ipfs mount' cmd looks like + start discussion
• ipfs/distributions
  • PR: support custom repo owners for apps
  • [~] CR+M: ipget on dist.ipfs.io
• ipget
  • use whyrusleeping's newer ipfs-embedded-shell instead of cryptix's
  • fix breakage in whyrusleeping/ipfs-embedded-shell due to go-ipfs api changes + PR
  • integrate why's improvements back into fallback-ipfs-shell
  • rig up ipget to use fallback-ipfs-shell
  • fix ipget build (godeeeeeeeeeps!)
  • start on sharness tests
  • support custom bootstrap list
  • improve readme
• other
  • mentor @ NodeSchool SF

[ghost]

@lgierth update

• dev040
  • ipfs.io v03x/v04x multiplexing via multireq
  • review monday's post mortem
  • stop multireq from following redirects
  • make multireq more robust
  • migrate pinbot to v04x
• infrastructure
  • merge ng branch
  • stop using docker networking (no more bootstrappers behind NAT)
  • [~] consolidate, it's a bit messy at the moment
  • captain's log
• misc
  • set up sundial
  • set up yubikey / 2-factor-auth
  • [~] work through github notifications backlog
• wishlist
  • ipv6 for ipfs.io
  • make use of _dnslink and cname
  • wildcart cert for *.ipfs.io### @lgierth todo

[RichardLitt]

This Week

• Sprint Management
• Write the weekly roundup
• IPFS API
  • bitswap Added Group bitswap ipfs-inactive/http-api-spec#24
  • block Added block and its subcommands ipfs-inactive/http-api-spec#25
  • bootstrap Added Group bootstrap and its subcommands ipfs-inactive/http-api-spec#26
  • Added an Error datastructure Added an Error datastructure ipfs-inactive/http-api-spec#27
  • Add curl commands to all method descriptions
  • Check all responses have maximal entries
  • Open a feature issue about having multiple language implementations for curl requests

Extra

• Edited the Docs styleguide Added default notice community#101
• go-ipfs docs Added quotes around block put command kubo#2265, Added quotes to swarm and ping descriptions kubo#2270
• Wrote a dist.ipfs.io intro blogpost Added in a dist blog post draft #21 ipfs-inactive/blog#23
• CR Make dns resolve paths under _dnslink.example.com kubo#2191
• CR feature object js-ipfs#63
• CR https://github.com/vijayee/js-ipfs-merkle-dag/pull/14
• CR + Edits on go-ipfs changelog. finally add changelog for v0.3.11 kubo#2248
• CR + Edits captain.log, aye, where is my grog community#100
• CRM Fix setup.py behavior. ipfs-shipyard/py-ipfs#27
• CRM Fix repo path specs#70
• CRM Fix the organization link ipfs#155
• Plan the NYC IPFS meet up for February. ⭐

[whyrusleeping]

DONE (week of Jan 25):

• coffee talk on gx
• docker test networks
  • spent a solid day and a half here.. made a miniscule amount of progress
• 0.3.11 changelog
• review/merge cbor#3
• fix ipfs files 'deadlocks'
  • this is probably done, just hard to confirm
• gx to vendor libp2p in go-ipfs ⭐
  • 98% done! now just working on getting CI to run properly
• reviewed every PR, closing old ones, and merging ready ones
  • will stay more up to date on these in the future
• some fixes for distributions
  • once that ships, make ipfs-update use it (just waiting on it to ship now)