Streaming/chunked inputs?

[danvk]

I'm getting my input as a sequence of ArrayBuffers. I can merge them all into a single ArrayBuffer for jBinary, but I'd save time & memory if I could feed the individual ArrayBuffers in one at a time. Is this possible with jBinary/jDataView?

[RReverser]

Not currently possible but I definitely thought on that kind of thing. The main problem is that much of data structures rely on knowing at least size of entire data, so making jBinary streaming would make parsing those impossible/inconsistent with other structures. Not sure how to properly address both kind of cases (where generic streaming mode is needed + where byteLength is needed) now, but PRs are welcome!

[danvk]

This would be easiest to implement in jDataView. The method to read one byte, for example, would read it either from the current buffer or advance to the next if there were no remaining bytes in the current buffer.

Streaming parsing would be harder—some of the APIs might have to become async.

[RReverser]

Even in jDataView, advancing mode is completely optional, and you still need to have ability to read/write stuff at any offset. Thus, all the APIs become async and so breaking+slower :(