add functionality for analyzing data streams #38
Labels
category: enhancement
improvements of code or code behavior
priority: high
impacts proper operation or use of feature important to most users
Milestone
Originally reported by: Andrew Tritt (Bitbucket: ajtritt, GitHub: ajtritt)
Within the specification, there are fields that can be determined from other datasets that might be written from a DataChunkIterator. For example, the field .num_samples can be determined from .data. If data is passed in as a DataChunkIterator, num_samples can only be determined when the DataChunkIterator is exhausted.
We need a class that can analyze a DataChunkIterator while it is being read from. Once the DataChunkIterator is closed, this class should be able to call back to some other object for further processing (e.g. setting a variable), or provide a way for its result to be read.
The text was updated successfully, but these errors were encountered: