New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sprint: February 1 #88

Closed
RichardLitt opened this Issue Feb 1, 2016 · 29 comments

Comments

Projects
None yet
9 participants
@RichardLitt
Member

RichardLitt commented Feb 1, 2016

Sprint February 1st

Sprint Goals

Sprint Discussions

Schedule

Note: There is no libp2p talk this week, so we've moved go-ipfs up

Please take notes in a separate pad, if you can, and link it here.

Endeavour Lead Time (PDT - UTC/Z - CET) Pad
sync Rich Littauer 9:00pDT 17:00Z 18:00CET IRC: #ipfs on Freenode
apps on ipfs Friedel Ziegelmayer 10:30PDT 18:30Z 19:30CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-apps-on-ipfs
infrastructure Lars Gierth 11:00PDT 19:00Z 20:00CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-infrastructure
go-ipfs Jeromy Johnson 11:30PDT 19:30Z 20:30CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-go-ipfs
js-ipfs David Dias 12:00PDT 20:00Z 21:00CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-js-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

  • Add your tasks below in a comment, that way we only have people listed who are really in the sprint
  • Add links to issues down here. Only add things you can finish this sprint.

@RichardLitt RichardLitt added the sprint label Feb 1, 2016

@dignifiedquire

This comment has been minimized.

Show comment
Hide comment
@dignifiedquire

dignifiedquire Feb 1, 2016

Member

Apps on IPFS

Lead: @dignifiedquire

Participants

Agenda

  • registry-mirror
  • removing a lot of technical debt (from glue code to actual code)
  • adding more features (the requested ones)
  • making it nicer to contribute (more proper testing!)
  • webui
    • lots of research cumulating in starting to use redux + redux-saga (no more setInterval soon)
  • distributions
    • new version with fixed containing folder

Notes

Registry Mirror

  • diasdavid is working on a big code refactoring
  • Daemon in biham died and hung, still need to do research into why
  • new features:
    • logging the root hash from time to time, to help with debugging and crashes
    • remove different blob stores (part of the refactor) we just use ipfs
    • if statements --
  • Adding debug logs for api requests, to easier figure out which commands fail

Webui

  • research -> redux + redux-saga
  • short demo of redux-devtools
  • TODO: migrate ipfs-geoip data to 0.4
  • TODO: make progress on the migration to redux

Distributions

  • new version with containing folder fix
Member

dignifiedquire commented Feb 1, 2016

Apps on IPFS

Lead: @dignifiedquire

Participants

Agenda

  • registry-mirror
  • removing a lot of technical debt (from glue code to actual code)
  • adding more features (the requested ones)
  • making it nicer to contribute (more proper testing!)
  • webui
    • lots of research cumulating in starting to use redux + redux-saga (no more setInterval soon)
  • distributions
    • new version with fixed containing folder

Notes

Registry Mirror

  • diasdavid is working on a big code refactoring
  • Daemon in biham died and hung, still need to do research into why
  • new features:
    • logging the root hash from time to time, to help with debugging and crashes
    • remove different blob stores (part of the refactor) we just use ipfs
    • if statements --
  • Adding debug logs for api requests, to easier figure out which commands fail

Webui

  • research -> redux + redux-saga
  • short demo of redux-devtools
  • TODO: migrate ipfs-geoip data to 0.4
  • TODO: make progress on the migration to redux

Distributions

  • new version with containing folder fix
@diasdavid

This comment has been minimized.

Show comment
Hide comment
@diasdavid

diasdavid Feb 1, 2016

Member

IPFS implementation in JavaScript

Lead: David Dias

Participants

Agenda

  • update
  • js-ipfs-blocks
  • js-ipfs-merkle-dag
  • js-ipfs-data-importing (managed to import a file)
  • this week focus
  • js-ipfs object
  • js-ipfs files add
  • js-ipfs-bitswap
  • other things that can be done
Member

diasdavid commented Feb 1, 2016

IPFS implementation in JavaScript

Lead: David Dias

Participants

Agenda

  • update
  • js-ipfs-blocks
  • js-ipfs-merkle-dag
  • js-ipfs-data-importing (managed to import a file)
  • this week focus
  • js-ipfs object
  • js-ipfs files add
  • js-ipfs-bitswap
  • other things that can be done
@lgierth

This comment has been minimized.

Show comment
Hide comment
@lgierth

lgierth Feb 1, 2016

Member

Infrastructure

Lead: @lgierth

Participants

Agenda

  • 0.4.0
    • multireq
    • documentation
    • pinbot
  • testing
  • connectivity work
    • ipv6
    • domains & redirects
    • ssl cert

Notes

  • 0.4.0
    • blog post about the migration /cc richardlitt
    • pinbot
      • ipfs-shell => go-ipfs-api
  • docker & gx
    • with gx, the dependencies are no longer within the source tree, but instead in GOPATH
    • build outside docker and just copy the ipfs daemon in?
    • an export/import step at the end to get rid of intermediary images?
  • testing
  • pages deploy
    • multipublish tool /cc jbenet
  • ipns perf
  • TODO RIGHT NOW
    • publish dist
    • publish website
Member

lgierth commented Feb 1, 2016

Infrastructure

Lead: @lgierth

Participants

Agenda

  • 0.4.0
    • multireq
    • documentation
    • pinbot
  • testing
  • connectivity work
    • ipv6
    • domains & redirects
    • ssl cert

Notes

  • 0.4.0
    • blog post about the migration /cc richardlitt
    • pinbot
      • ipfs-shell => go-ipfs-api
  • docker & gx
    • with gx, the dependencies are no longer within the source tree, but instead in GOPATH
    • build outside docker and just copy the ipfs daemon in?
    • an export/import step at the end to get rid of intermediary images?
  • testing
  • pages deploy
    • multipublish tool /cc jbenet
  • ipns perf
  • TODO RIGHT NOW
    • publish dist
    • publish website
@RichardLitt

This comment has been minimized.

Show comment
Hide comment
@RichardLitt

RichardLitt Feb 1, 2016

Member

To Do

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • version
Member

RichardLitt commented Feb 1, 2016

To Do

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • version
@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 1, 2016

Member

go-ipfs

go-go-ipfs

Lead: @whyrusleeping

Participants

Agenda

  • gx vendoring
  • files hang debugging
  • take a look at suspected memory leaks
  • multistream seems to have some goroutine issues
  • going through issues, gonna try and triage most of them
  • files api inotify
  • swarm peers notify
  • improvements to 'ipfs mount'

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Notes

  • figure out docker stuff with @lgierth
  • stress tests on files api stuff for registry mirror
  • issue triage ftw
  • discuss making mount a separate binary
After sprint meeting is finished, create the respective action items on the Github sprint issue
Member

whyrusleeping commented Feb 1, 2016

go-ipfs

go-go-ipfs

Lead: @whyrusleeping

Participants

Agenda

  • gx vendoring
  • files hang debugging
  • take a look at suspected memory leaks
  • multistream seems to have some goroutine issues
  • going through issues, gonna try and triage most of them
  • files api inotify
  • swarm peers notify
  • improvements to 'ipfs mount'

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Notes

  • figure out docker stuff with @lgierth
  • stress tests on files api stuff for registry mirror
  • issue triage ftw
  • discuss making mount a separate binary
After sprint meeting is finished, create the respective action items on the Github sprint issue
@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 1, 2016

Member

you know, i didnt add that gif in there. but i'm also not gonna remove it

Member

whyrusleeping commented Feb 1, 2016

you know, i didnt add that gif in there. but i'm also not gonna remove it

@RichardLitt

This comment has been minimized.

Show comment
Hide comment
@RichardLitt

RichardLitt Feb 1, 2016

Member

i did it was me

Member

RichardLitt commented Feb 1, 2016

i did it was me

@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 1, 2016

Member
  • 'verbose' mode for some commands to help debugging
  • debug files api hangs
    • add tests for this too
  • debug random multistream goroutines...
    • too many goroutines open in yamux Read wait
    • likely an issue with readHandshake in go-multistream. (too many goroutines waiting)
  • modtimes in files api
  • fuse mount code as separate binary
    • files api as fuse mount
  • private networks
    • implement 'encrypted transport' thing
  • directory sharding?
  • node aliases (should be easy to add to config)
    • keep map in IpfsNode object, maybe in resolver too
  • progress bar lib
  • gx
    • writeup
    • command polishing
Member

whyrusleeping commented Feb 1, 2016

  • 'verbose' mode for some commands to help debugging
  • debug files api hangs
    • add tests for this too
  • debug random multistream goroutines...
    • too many goroutines open in yamux Read wait
    • likely an issue with readHandshake in go-multistream. (too many goroutines waiting)
  • modtimes in files api
  • fuse mount code as separate binary
    • files api as fuse mount
  • private networks
    • implement 'encrypted transport' thing
  • directory sharding?
  • node aliases (should be easy to add to config)
    • keep map in IpfsNode object, maybe in resolver too
  • progress bar lib
  • gx
    • writeup
    • command polishing
@diasdavid

This comment has been minimized.

Show comment
Hide comment
@diasdavid

diasdavid Feb 1, 2016

Member

DAVID DIAS TODO

Member

diasdavid commented Feb 1, 2016

DAVID DIAS TODO

@noffle

This comment has been minimized.

Show comment
Hide comment
@noffle

noffle Feb 1, 2016

Contributor

noffle todo

  • design
  • go-ipfs
    • PR: offline pubkey resolution when mounting (to reduce test flakiness) (ipfs/go-ipfs#2266)
    • PR: proper clean-up when /ipfs or /ipns is unmounted
    • PR: error out if user tries to 'ipfs name publish' while /ipns is mounted
    • PR: 'ipfs mount --read-only' flag for read-only /ipns mounting
  • multireq
  • distributions
    • PR: ipget on 'distributions'
  • gx
Contributor

noffle commented Feb 1, 2016

noffle todo

  • design
  • go-ipfs
    • PR: offline pubkey resolution when mounting (to reduce test flakiness) (ipfs/go-ipfs#2266)
    • PR: proper clean-up when /ipfs or /ipns is unmounted
    • PR: error out if user tries to 'ipfs name publish' while /ipns is mounted
    • PR: 'ipfs mount --read-only' flag for read-only /ipns mounting
  • multireq
  • distributions
    • PR: ipget on 'distributions'
  • gx
@Kubuxu

This comment has been minimized.

Show comment
Hide comment
@Kubuxu

Kubuxu Feb 2, 2016

Member

Kubuxu todo:

Member

Kubuxu commented Feb 2, 2016

Kubuxu todo:

@dignifiedquire

This comment has been minimized.

Show comment
Hide comment
@dignifiedquire

dignifiedquire Feb 2, 2016

Member

@dignifiedquire todo

  • Redux and the webui
Member

dignifiedquire commented Feb 2, 2016

@dignifiedquire todo

  • Redux and the webui
@rht

This comment has been minimized.

Show comment
Hide comment
@rht

rht Feb 2, 2016

Can someone on go-ipfs look over and merge ipfs/go-ipfs#2100, ipfs/go-ipfs#2120, ipfs/go-ipfs#2205, ipfs/go-ipfs#2221, ipfs/go-ipfs#2251 (in particular the last one)?

rht commented Feb 2, 2016

Can someone on go-ipfs look over and merge ipfs/go-ipfs#2100, ipfs/go-ipfs#2120, ipfs/go-ipfs#2205, ipfs/go-ipfs#2221, ipfs/go-ipfs#2251 (in particular the last one)?

@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 3, 2016

Member

hey @rht, mind posting your weekly TODO's here too? It would help us get a better idea what everyone is working as a group and makes planning easier. (also posting an update at the end of the sprint cycle is super helpful!)

Member

whyrusleeping commented Feb 3, 2016

hey @rht, mind posting your weekly TODO's here too? It would help us get a better idea what everyone is working as a group and makes planning easier. (also posting an update at the end of the sprint cycle is super helpful!)

@lgierth

This comment has been minimized.

Show comment
Hide comment
@lgierth

lgierth Feb 4, 2016

Member

@lgierth todo

  • 0.4.0
    • [~] update pinbot
    • update dockerfile for libp2p/gx
    • automated docker image jbenet/go-ipfs => ipfs/go-ipfs
    • [~] figure out grace period for jbenet/go-ipfs image
  • infrastructure
    • live integration test ipfs/infrastructure#150
    • websites acceptance test
    • [~] ssl wildcard cert for *.ipfs.io
    • redirect http: => https:
    • www.ipfs.io
    • redirect gateway.ipfs.io => ipfs.io
  • ops
    • deploy dist.ipfs.io
    • 2x deploy website/blog
    • work through pinning troubles
    • [~] blog post about 0.4.0 migration ipfs/blog#27
  • whislist
    • proposal for simpler website deployments
Member

lgierth commented Feb 4, 2016

@lgierth todo

  • 0.4.0
    • [~] update pinbot
    • update dockerfile for libp2p/gx
    • automated docker image jbenet/go-ipfs => ipfs/go-ipfs
    • [~] figure out grace period for jbenet/go-ipfs image
  • infrastructure
    • live integration test ipfs/infrastructure#150
    • websites acceptance test
    • [~] ssl wildcard cert for *.ipfs.io
    • redirect http: => https:
    • www.ipfs.io
    • redirect gateway.ipfs.io => ipfs.io
  • ops
    • deploy dist.ipfs.io
    • 2x deploy website/blog
    • work through pinning troubles
    • [~] blog post about 0.4.0 migration ipfs/blog#27
  • whislist
    • proposal for simpler website deployments
@rht

This comment has been minimized.

Show comment
Hide comment
@rht

rht Feb 4, 2016

hey @rht, mind posting your weekly TODO's here too?

Figure a way to properly fix bitswap duplicate blocks. I don't think this issue is present in torrent.

rht commented Feb 4, 2016

hey @rht, mind posting your weekly TODO's here too?

Figure a way to properly fix bitswap duplicate blocks. I don't think this issue is present in torrent.

@rht

This comment has been minimized.

Show comment
Hide comment
@rht

rht Feb 4, 2016

pin & pin & pin [& pin ...]

How should this be parsed?

rht commented Feb 4, 2016

pin & pin & pin [& pin ...]

How should this be parsed?

@lgierth

This comment has been minimized.

Show comment
Hide comment
@lgierth

lgierth Feb 4, 2016

Member

How should this be parsed?

Sorry this should have been clearer: I had trouble pinning dist and website, the pin would eventually succeed, but the CLI hung forever.

Member

lgierth commented Feb 4, 2016

How should this be parsed?

Sorry this should have been clearer: I had trouble pinning dist and website, the pin would eventually succeed, but the CLI hung forever.

@rht

This comment has been minimized.

Show comment
Hide comment
@rht

rht Feb 4, 2016

ic, I think this can be consistently reproduced with running the daemon with auto-gc enabled, with sufficiently low GCPeriod such that added blocks get gc-ed before the pinning starts. (I mean, this should be put in test)

rht commented Feb 4, 2016

ic, I think this can be consistently reproduced with running the daemon with auto-gc enabled, with sufficiently low GCPeriod such that added blocks get gc-ed before the pinning starts. (I mean, this should be put in test)

@rht

This comment has been minimized.

Show comment
Hide comment
@rht

rht Feb 4, 2016

ic, the issue is in the CLI, but the pin completes just fine?

rht commented Feb 4, 2016

ic, the issue is in the CLI, but the pin completes just fine?

@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 4, 2016

Member

please move discussion to a relevant issue elsewhere, this issue is just for task tracking.

Member

whyrusleeping commented Feb 4, 2016

please move discussion to a relevant issue elsewhere, this issue is just for task tracking.

@noffle

This comment has been minimized.

Show comment
Hide comment
@noffle

noffle Feb 8, 2016

Contributor

noffle sync update

Lots of reading and thinking about records, freshness, and how the record routing layer will fit into IPFS. Started some discussions around 'ipfs mount' and app-layer pubsub. Big progress on improving fuse UX!

Contributor

noffle commented Feb 8, 2016

noffle sync update

Lots of reading and thinking about records, freshness, and how the record routing layer will fit into IPFS. Started some discussions around 'ipfs mount' and app-layer pubsub. Big progress on improving fuse UX!

@RichardLitt

This comment has been minimized.

Show comment
Hide comment
@RichardLitt

RichardLitt Feb 8, 2016

Member

To Done

Mostly lots of API stuff this week; also, tons of docs for go-ipfs.

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • mount
    • name
    • object
    • pin
    • ping
    • refs
    • repo
    • resolve
    • stats
    • swarm
    • tar
    • tour
    • update
    • version

Extra

Member

RichardLitt commented Feb 8, 2016

To Done

Mostly lots of API stuff this week; also, tons of docs for go-ipfs.

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • mount
    • name
    • object
    • pin
    • ping
    • refs
    • repo
    • resolve
    • stats
    • swarm
    • tar
    • tour
    • update
    • version

Extra

@lgierth

This comment has been minimized.

Show comment
Hide comment
@lgierth

lgierth Feb 8, 2016

Member

@lgierth sync update

I started off the week with blog and dist deployments, which were a bit hairy because pinning was/is buggy and tended to hang indefinitely. The gx dependencies support for the go-ipfs docker image took me a bit longer than I expected but it does work nicely now.

  • go-ipfs & 0.4.0
  • infrastructure
    • live integration test ipfs/infrastructure#150
    • websites acceptance test
    • [~] ssl wildcard cert for *.ipfs.io
    • redirect http: => https:
    • www.ipfs.io
    • redirect gateway.ipfs.io => ipfs.io
  • ops
    • 2x deploy dist.ipfs.io
    • 2x deploy website/blog
    • work through pinning troubles
    • [~] blog post about 0.4.0 migration ipfs/blog#27
  • whislist
    • proposal for simpler website deployments
Member

lgierth commented Feb 8, 2016

@lgierth sync update

I started off the week with blog and dist deployments, which were a bit hairy because pinning was/is buggy and tended to hang indefinitely. The gx dependencies support for the go-ipfs docker image took me a bit longer than I expected but it does work nicely now.

  • go-ipfs & 0.4.0
  • infrastructure
    • live integration test ipfs/infrastructure#150
    • websites acceptance test
    • [~] ssl wildcard cert for *.ipfs.io
    • redirect http: => https:
    • www.ipfs.io
    • redirect gateway.ipfs.io => ipfs.io
  • ops
    • 2x deploy dist.ipfs.io
    • 2x deploy website/blog
    • work through pinning troubles
    • [~] blog post about 0.4.0 migration ipfs/blog#27
  • whislist
    • proposal for simpler website deployments
@whyrusleeping

This comment has been minimized.

Show comment
Hide comment
@whyrusleeping

whyrusleeping Feb 8, 2016

Member
  • 'verbose' mode for some commands to help debugging
    • getting pretty close to finishing this, pretty useful already
  • debug files api hangs
    • all the hangs i was previously seeing are accounted for
    • still an issue with 'too many open files' causing a block to be lost
  • debug random multistream goroutines
    • didnt get time to look at this
  • shipped gx ipfs PR. Woo! ⭐️
  • wrote tool to publish ipns records without the ipfs daemon 🌟
    • also a tool to generate private keys as needed to use with said tool
  • gx cleanup, fixed an issue that was reported and modified some UX after feedback in irc
Member

whyrusleeping commented Feb 8, 2016

  • 'verbose' mode for some commands to help debugging
    • getting pretty close to finishing this, pretty useful already
  • debug files api hangs
    • all the hangs i was previously seeing are accounted for
    • still an issue with 'too many open files' causing a block to be lost
  • debug random multistream goroutines
    • didnt get time to look at this
  • shipped gx ipfs PR. Woo! ⭐️
  • wrote tool to publish ipns records without the ipfs daemon 🌟
    • also a tool to generate private keys as needed to use with said tool
  • gx cleanup, fixed an issue that was reported and modified some UX after feedback in irc
@diasdavid

This comment has been minimized.

Show comment
Hide comment
@diasdavid

diasdavid Feb 8, 2016

Member

David Dias Check in

js-ipfs
api documentation
js-ipfs-api
libp2p
npm on ipfs
extra
Member

diasdavid commented Feb 8, 2016

David Dias Check in

js-ipfs
api documentation
js-ipfs-api
libp2p
npm on ipfs
extra
@dignifiedquire

This comment has been minimized.

Show comment
Hide comment
@jbenet

This comment has been minimized.

Show comment
Hide comment
@jbenet

jbenet Feb 8, 2016

Member

@jbenet update

My last week has been spent primarily in important meetings with people, discussing IPFS and other protocols. I had very little time for code or review. If i'm blocking something major, please ping me on IRC or here with what you need review on. (Sorry @whyrusleeping and @rht for go-ipfs laggg)

  • a TON of meetings about IPFS
  • NYU mazieres talk
  • tested out ipfs-update in prep for 0.4.0 (found UX bugs)
  • reviewed / improved weekly
  • iprs / records / dht discussion with @noffle
  • ICT related work
Member

jbenet commented Feb 8, 2016

@jbenet update

My last week has been spent primarily in important meetings with people, discussing IPFS and other protocols. I had very little time for code or review. If i'm blocking something major, please ping me on IRC or here with what you need review on. (Sorry @whyrusleeping and @rht for go-ipfs laggg)

  • a TON of meetings about IPFS
  • NYU mazieres talk
  • tested out ipfs-update in prep for 0.4.0 (found UX bugs)
  • reviewed / improved weekly
  • iprs / records / dht discussion with @noffle
  • ICT related work
@Kubuxu

This comment has been minimized.

Show comment
Hide comment
@Kubuxu

Kubuxu Feb 8, 2016

Member

Kubuxu update:

Member

Kubuxu commented Feb 8, 2016

Kubuxu update:

@jbenet jbenet removed the sprint label Feb 11, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment