Grain 0.2.12

• New features:

  • Adds Windows build.
  • Allow passing read_kwargs to ParquetIterDataset for configuring parquet
    file reading.
  • ThreadPrefetchDatasetIterator now supports non-Grain iterators that
    support checkpointing.
  • Introduces API for device prefetch - grain.experimental.device_put() for
    easy CPU and device prefetching.
  • Introduces API for autotuning -- given the user provided RAM restrictions
    and specific IterDataset, finds number of processes for mp_prefetch
    and buffer size for PrefetchDatasetIterator.
  • Allow passing reader_options to ArrayRecordDataSource for configuring
    array record file reading.
  • Introduces grain.experimental.batch_and_pad for padding a partial batch to
    avoid dropping batch remainder data.
  • Grain interleave optimization - allow creating more threads to parallelly
    keep starting iterators and prefetching elements.

• Breaking changes:

  • Upgrades array_record and protobuf.