Sprint Dec 7

[RichardLitt]

Sprint Goals

• Push 0.3.10
• Completed IPFS API Spec (core + transports) by Jan 1

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Pad
Apps on IPFS	Juan Benet	https://public.etherpad-mozilla.org/p/dec-7-apps-on-ipfs
infrastructure	Lars Gierth	https://public.etherpad-mozilla.org/p/dec-7-infrastructure
libp2p	David Dias	https://public.etherpad-mozilla.org/p/dec-7-libp2p
js-ipfs	David Dias	https://public.etherpad-mozilla.org/p/dec-7-js-ipfs
go-ipfs	Jeromy Johnson	https://public.etherpad-mozilla.org/p/dec-7-go-ipfs
api	Juan Benet	https://public.etherpad-mozilla.org/p/dec-7-api

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add your tasks below in a comment, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[ghost]

Infrastructure

Lead: @lgierth

Agenda

• ops levelup
• writable gateway
• more hetzner hosts
• distributions

Participants

• @lgierth
• @dignifiedquire
• @jbenet
• @diasdavid
• @whyrusleeping

Notes

• issues tracking for ops requests
  • repo /ipfs/ops-request
  • @lgierth might revisit waffle/trello
• writable gateway PR needs CR Fix/compliant writable gw kubo#1917
• storage
  • hetzner nodes not today
  • one host needed for ipfs tar add test
  • no more OVH hosts, we're moving away from that
  • get an ec2 instance for @diasdavid

[dignifiedquire]

Apps On IPFS

Lead: @dignifiedquire

Agenda

• Station
  • How to get people to contribute more, as @dignifiedquire needs help
  • station bugs (crash on exit)
• Package Managers
  • npm on IPFS - registry-mirror
  • Pacman
• Pub/Sub
• Webui
• Thoughts on ipscend?
• ipfs/distributions (moved to infrastucture)
• Core Network

Participants

• Friedel Ziegelmayer (@dignifiedquire)
• David Dias (@diasdavid)
• Harlan T Wood (@harlantwood)
• Juan (@jbenet)

Notes

Station

• road to 1.0.0 https://github.com/ipfs/station/milestones/1.0.0
• finishing the packaging
• pick the right architecture for each package
• make sure that it always runs (not everyone are having the same experience)
• ipfs-install npm module
• pick a version and a path where to install the IPFS binary from gobuilder (instead of using go-ipfs, which always install in a postinstall script IPFS for the current architecture)
• something like require('ipfs-install')(, )
• make a strategy about how to handle multiple IPFS installations
• detail strategy about running/installed daemons in Better handling of already running ipfs daemon ipfs-desktop#19

Package Managers

• npm on IPFS
• Still wip
• Large overhead when adding all the npm modules (merkle dag links)
• Using a trie (hacky way from @jbenet)
• write a issue with learnings from this experience (challenges seen when adding all of this data)

Webui

• Update
  • Merge internationalizations
• Detail in an issue ways to update the webui independent of go-ipfs

Core Network

• Visual demo
• source: https://github.com/core-network/client
• Interested in what emerges from POST format
• Interested in collaborating with others doing similar apps

[daviddias]

libp2p

Lead: David Dias

Agenda

• vendoring go-libp2p (separed by repos)
• specs
  https://github.com/ipfs/specs/labels/libp2p
• libp2p website
• define plan for this week sprint
• websockets transport

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Participants

• David Dias

Notes

go-libp2p

• vendoring is "on going"
• Jeromy is solving multipart issue, which gx uses and blocks the vendoring from go-libp2p/separate it on smaller repos
• This week plan
  • Make demos
    • connecting two peers using swarm for a chat app
    • Using the DHT to find peers
    • Store a record
    • make go-libp2p and js-libp2p swarm interop demo
  • update interfaces from abstract to interface
  • interop between go-libp2p-swarm and js-libp2p-swarm
  • very full roadmap for libp2p, js-ipfs, go-ipfs

[daviddias]

js-ipfs

Lead: David Dias

Agenda

• specs
• ipfs-repo IPFS Repo Spec update specs#43 <-
• http-api
• define plan for this week sprint

Participants

• David Dias

Notes

roadmap
milestone 0.1.0 - js-ipfs with delegated nodes
- writable gateways
ipfs-repo
IPLD - update to the latest state of IPLD spec
IPRS -
DagStore
IPLD store on top ipfs-repo
a config
Importer
How to turn a file into a DAG (normal, tar, rabin)

"delegated node can't delegate its identity"

• This week plan
• Writable gateways
• Ship js-ipfs with writable gateways and a 'unstable interface' warning, as it m

[ghost]

@lgierth

• infrastructure
  • bootstrap new storage hosts (nihal and biham)
    • An-Nihal -- The camels quenching their thirst (https://en.wikipedia.org/wiki/Beta_Leporis)
    • S'ad al-Biham -- Lucky Star of the Young Beasts (https://en.wikipedia.org/wiki/Theta_Pegasi)
  • ops-requests repo Add readme ipfs-inactive/ops-requests#2
  • gandi account
  • start moving domains
  • go-ipfs 0.3.10 and go1.5.2 ipfs: update to 0.3.10 infra#131
  • project-repos.ipfs.io deploy to project-repos.ipfs.io ipfs-inactive/project-repos#9
  • ipfs.io/blog Deploy ipfs-inactive/blog#11
  • [~] more dev040 bootstrappers Migrate more bootstrappers to dev040 ipfs-inactive/ops-requests#3
• cjdns
  • [~] discover peers from cjdns (todo: tests) WIP: discover peers from cjdns kubo#1316
  • [~] invite to fc00 development (aka go-cjdns) https://github.com/fc00/spec
• go-ipfs
  • gateway prefix hardening https://github.com/ipfs/go-ipfs/pull/1988/files#r46498115
  • test fs-repo-migrations
• hope
  • files api response status codes
  • writable gateway (blocked) Making ipfs.io gateway writable infra#105

[daviddias]

David Dias TODO

• libp2p
  • write throughout roadmap
  • demos
    • connecting two peers using swarm using swarm example libp2p/js-libp2p#3
    • Using the DHT to find peers
    • store a record
  • update abstract to interface
    • peer-routing
    • record-store
    • connection
    • transport
    • stream-muxer
  • merge libp2p - Update Implementations Chapter specs#49
  • merge libp2p - [WIP] Update the Interfaces chapter specs#48
• js-ipfs
  • write throughout roadmap
  • js-ipfs-repo
    • wip, adding tests, repo exists, repo load masylum/js-ipfs-repo#1
    • Bring @masylum PR and @diasdavid PR to be a PR from a ipfs/js-ipfs-repo branch to master js-ipfs-repo#2
    • feat repo init js-ipfs-repo#10
    • IPFS Repo Feature - Implement locks js-ipfs-repo#9
    • locks https://github.com/ipfs/js-ipfs-repo/pulls
  • $ jsipfs daemon
  • $ jsipfs init
  • $ jsipfs id feat/id js-ipfs#39
  • $ jsipfs version
  • $ jsipfs repo version
• npm-on-ipfs
  • stats
    • ipfs
    • ipfs tar
    • ipfs with rabin
    • ipfs tar with rabin
  • write issue with learnings (post mortem analysis) made with registry-mirror
  • transfer out repos from aws and stop that machine
  • blog post for registry-mirror http://blog.daviddias.me/2015/12/08/stellar-module-management
• extra
  • Deliver talk at Node.js Interactive
  • cp blog posts to ipfs/blog 3 blog posts ipfs-inactive/blog#10
  • improve blog posts - WIP ipfs-inactive/blog#12
  • Jeromy Coffee Talks
  • 32c3 + NYE + Berlin Logistics

[harlantwood]

@harlantwood todo:

• subdomain bikeshedding ipfs-inactive/project-repos#8 subdomain bikeshedding
• plz make me an admin of the https://github.com/ipfs/ci-status repo
• deploy to project-repos.ipfs.io ipfs-inactive/project-repos#9 push first version of CI build board to some-subdomain.ipfs.io

[RichardLitt]

My todos:

This Week

• Spec out http api bootstrap Spec out current state of the http api ipfs-inactive/http-api-spec#7 Added bootstrap dignifiedquire/ipfs-http-api#1
• Spec out http api cat Spec out current state of the http api ipfs-inactive/http-api-spec#7
• Make sure that each IPFS repository has a README.
• Find the old Copyright stuff Copyright stuff community#79
• Sprint Management

[whyrusleeping]

• ship 0.3.10
• ship super fast jellyfish add
• take a deep breath

[dignifiedquire]

My Todos

• ipfs/distributions

[RichardLitt]

Update

This Week

• Spec out http api bootstrap. PR Added bootstrap dignifiedquire/ipfs-http-api#1
• Spec out http api cat. PR Added cat dignifiedquire/ipfs-http-api#2
• Make sure that each IPFS repository has a README. PR examples/pull/42, CR py-ipfs/pull/22
• Find the old Copyright stuff. community/issues/79
• Sprint Management

Also Done

• Limit video quality. PR pm/pull/70
• Update ipfs-update readme. PR ipfs-update/pull/6
• Weigh in on distro page. Comment distributions/issues/11
• Moved api specs around. specs/pull/51 api/pull/12
• Added images to contributing. community/pull/89
• Closed go-ipfs/issues/1706.
• ⭐ Worked on API: Speced out add, put, config, daemon, and dht so far. PR api/pull/13

[dignifiedquire]

Update @dignifiedquire

Planned

• ipfs/distributions
  • Finish design draft and get it approved (need better frontend design distributions#11 (comment)) ⭐️
  • [~] Implement the draft ([WIP] Front end II distributions#19 and [WIP] Front end design & cleanup distributions#14)

Extra

• [~] rust-multiaddr (https://github.com/Dignifiedquire/rust-multiaddr)
• Help out with 32c3 logistics
• Jeromy Coffee Talk on Files API

[ghost]

@lgierth sync update

Bouncing between all kinds of different tasks, but got through it okay

• infrastructure
  • * bootstrap new storage hosts with 17 TB each (nihal and biham) Add storage hosts biham and nihal infra#135
    • An-Nihal -- The camels quenching their thirst (https://en.wikipedia.org/wiki/Beta_Leporis)
    • S'ad al-Biham -- Lucky Star of the Young Beasts (https://en.wikipedia.org/wiki/Theta_Pegasi)
  • ops-requests repo Add readme ipfs-inactive/ops-requests#2
  • gandi account
  • start moving domains
  • go-ipfs 0.3.10 and go1.5.2 ipfs: update to 0.3.10 infra#131
  • project-repos.ipfs.io deploy to project-repos.ipfs.io ipfs-inactive/project-repos#9
  • ipfs.io/blog Deploy ipfs-inactive/blog#11
  • [~] more dev040 bootstrappers Migrate more bootstrappers to dev040 ipfs-inactive/ops-requests#3
• cjdns
  • [~] discover peers from cjdns (todo: tests) WIP: discover peers from cjdns kubo#1316
  • [~] invite to fc00 development (aka go-cjdns) https://github.com/fc00/spec
• go-ipfs
  • gateway prefix hardening https://github.com/ipfs/go-ipfs/pull/1988/files#r46498115
  • test fs-repo-migrations
• hope
  • files api response status codes
  • writable gateway (blocked) Making ipfs.io gateway writable infra#105

[whyrusleeping]

• ship 0.3.10 *
• ship super fast add
• fix ipfs-update install issue (Sprint G #8)
• improve flatfs query speed
• misc gx work

[daviddias]

I ### David Dias Check In

• libp2p
  • Roadmap Roadmap for libp2p #72
  • demos
    • connecting two peers using swarm using swarm example libp2p/js-libp2p#3
  • update abstract to interface
    • peer-routing
    • record-store
    • connection
    • transport
    • stream-muxer
  • specs Implementations merge libp2p - Update Implementations Chapter specs#49
  • specs Interfaces merge libp2p - [WIP] Update the Interfaces chapter specs#48
• js-ipfs
  • Wrote a Roadmap Roadmap for js-ipfs #71 which lead me to update https://github.com/ipfs/js-ipfs. I would prefer to merge both, but it is definitely nice to understand what is the list of all the things that need to be done and the subset of those that are our core priority
  • js-ipfs-repo
    • refactor js-ipfs-repo to enable a new Arch (IPFS Repo Feature - Implement locks js-ipfs-repo#9 (comment))
    • implement locks locks js-ipfs-repo#11
    • add tests (with mocha so that when Friedel sees it, he feels happy :)) + CI
    • wip, adding tests, repo exists, repo load masylum/js-ipfs-repo#1
    • Bring @masylum PR and @diasdavid PR to be a PR from a ipfs/js-ipfs-repo branch to master js-ipfs-repo#2
    • feat repo init js-ipfs-repo#10
    • IPFS Repo Feature - Implement locks js-ipfs-repo#9
  • $ jsipfs id feat/id js-ipfs#39
  • $ jsipfs version
  • $ jsipfs repo version
• npm-on-ipfs ⭐️ (also count with blog post + talk, referenced below)
  • stats - I was unable to get any stats as I am always filling up disks 'disk full'. I'm using now straight registry-mirror on Pollux, so that I can pause and resume anywhere and not be surprised by a massive overhead from ipfs add -r
  • write issue with learnings (post mortem analysis) made with registry-mirror
  • transfer out repos from aws and stop that machine
  • blog post for registry-mirror http://blog.daviddias.me/2015/12/08/stellar-module-management
• extra
  • Deliver talk at Node.js Interactive
  • cp blog posts to ipfs/blog 3 blog posts ipfs-inactive/blog#10
  • improve blog post - WIP ipfs-inactive/blog#12
  • Jeromy Coffee Talks
  • 32c3 + NYE + Berlin Logistics

[jbenet]

@jbenet update

• ⭐ made dnslink tool: https://github.com/jbenet/go-dnslink
• added gobuilder to go-ipfs release checklist
• bumped new go-ipfs gobuilder builds to start
• bump go-ipfs travis-ci to go1.5.2
• blog fixing, reverting stellar modules post
• temp go-ipfs asciinema asciinema for go-ipfs distributions#17
• gobuilder dl badge Idea: readme badge Luzifer/gobuilder#67
• npm-on-ipfs last push
• dist progress and PRs
• Code Review + Merges:
  • CR + M initial support for commands to use external binaries kubo#1961
  • CR + M update go-peerstream dep kubo#2048
  • CR + M travis-ci: use go 1.5.2 kubo#2049
  • CR + M Dignifiedquire fix/access controll headers kubo#2019
  • CR + M t0080 improvements kubo#2041
  • CR + M add 'get' to the allowed gateway commands kubo#2065
  • CR + M makefile: add -ldflags to install and nofuse tasks kubo#2066
  • CR + M Added the API Specs from ipfs/api specs#51
  • CR + M Split up level1 commands ipfs-inactive/http-api-spec#9
  • CR + M Small edits fs-repo-migrations#9
  • CR + M Auto resize images for smaller screens ipfs-inactive/blog#14
  • CR + M [WIP] Front end design & cleanup distributions#14
  • CR + M v0.3.10 npm-kubo#5
  • CR + M fix how path returned by stash is used ipfs-update#10
  • CR + M use filepath walk for flatfs query go-datastore#34
  • CR Ipfs.pics blog post ipfs-inactive/blog#15
  • CR 3 blog posts ipfs-inactive/blog#10
  • CR WIP ipfs-inactive/blog#12
  • CR [WIP] Front end II distributions#19
• Discussions
  • ⭐ pacman ipfs and pacman  notes#84
  • files api mount mounting files api kubo#2060
  • blocks wrapping Blocks don't have a nice size kubo#2053
  • Making files Searchable ipfs-inactive/faq#81
  • How to implement arbitrary blockchain protocols on top of IPFS? ipfs-inactive/faq#82
  • some ipfs-users posts

[harlantwood]

@harlantwood update

• subdomain bikeshedding ipfs-inactive/project-repos#8 subdomain bikeshedding
• get admin on the https://github.com/ipfs/ci-status repo
• [~] deploy to project-repos.ipfs.io ipfs-inactive/project-repos#9 push first version of CI build board to some-subdomain.ipfs.io