Skip to content

Latest commit

 

History

History
45 lines (34 loc) · 1.79 KB

TODO.md

File metadata and controls

45 lines (34 loc) · 1.79 KB

Fix exit code handling

Fix ordering

The current inner-join operator joins on \t to form the comparison key, which is wrong: it needs to join on \0 to be consistent with the way sort looks at it. (And I'm not even sure that will work; need to research it more.)

Scaling operator improvements

Autoscale

Do we want to implement our own sorting function?

There's some possibility it would be faster, and it preemptively avoids issues around LC_ALL.

Monitors should handle various distribution cases (no clue how)

For example, suppose we have a scale-by-single-row or scale-by-key operator later on. We might want to know the details of how each of those is working. This makes me think that fixed space allocation is a non-starter; we might want some kind of expand/collapse interface, or we might want aggregation by axis.

I think this requires us to write a pager (or at least defer its instantiation) because less captures terminal input immediately.

Configuration variables should be tied to %ENV

Double-layer namespacing is way too confusing.

Better abstraction around procfhs

We need more detailed process tracking, and ideally some more structured interface to pipelines. Streams should be objects since we aren't creating/destroying them inside any loops.

Autoscaling

Like S, but auto-configure buffer sizes and #children to maximize throughput.

Generalized/optimized destructuring

Should apply to JSON, XML, headed CSV/TSV, SQL-as-text, possibly other formats too. Also should optimize for the consistent-schema case and predict field positions. Support assertions (?)

JSPlot

Refactor renderer to support arbitrary operations

Labeled axes/grids/etc

Must be client-side; this way it can happen after autoranging and during zooms.

View history