Skip to content

Pipe block operators proposal

vird edited this page May 17, 2017 · 34 revisions

Operators

  • Excellent parallel
    • map
    • filter
  • Good parallel
    • reduce (makes sure that size >= 1)
    • reduce0 (also takes zero element. Can accept zero-sized stream)
    • group_by (in fact it's reduce by google whitepaper)
  • Bad parallel
    • sort
    • unique (alias disctinct)
  • Shrinkable
    • skip
    • limit
    • any
    • all
  • Debug
    • peek(dst)
    • print (==peek(stdout))

Frame operators

  • Pack N frames into 1. Pack each block to make it operational over N-subblock-frame
  • Unpack 1 frame into N. (in fact combos with pack-blocking)

Clone this wiki locally