Skip to content
Lior Privman edited this page Jun 19, 2023 · 22 revisions

Welcome to the dataframe wiki!

Dataframe Release Notes

Version 1.2.11 (2023-06-18)

  • added DataFrame::joinLeft(DataFrame, String[], String[])

Version 1.2.10 (2023-05-27)

  • bumped sqlite-jdbc to 3.41.2.2

Version 1.2.9 (2022-12-31)

  • added DataFrameToStringOptions
  • added DateColumn::of(int...)

Version 1.2.8

  • added missing getters to DataFrame and Row

Version 1.2.7

  • added FixedAsciiColumn
  • updated InstantColumn to support ~2^31 elements (previously limited to ~2^31 / 3)

Version 1.2.6

  • support for NormalStringColumn in DataFrame::asResultSet

Version 1.2.5

  • bug fixes for memory-mapped dataframes

Version 1.2.4

  • support for memory-mapped dataframes
  • support for converting between Java records and DataFrame

Version 1.2.3

  • NormalStringColumn supports 65536 distinct values, up from 256
  • performance micro-optimizations

Version 1.2.2

  • added BlobColumn
  • reverted: optimized sorting of ASCII-only string columns

Version 1.2.1

  • improved support for NormalStringColumn

Version 1.2.0

  • requires Java 17
  • fully support columns with up to ~2^31 elements
  • StringColumn supports any amount of text data (previously limited to 2 GB)
  • sealed DataFrame interface
  • replaced Joda-Beans with Java records

Version 1.1.7

  • improved implementation of StringColumn::normalize
  • optimized sorting of ASCII-only string columns
  • updated UuidColumn to support ~2^31 elements (previously limited to ~2^30)

Version 1.1.6

  • added specialized evaluate method to primitive column types
  • added specialized clean and filter methods to Byte/Short/FloatColumn
  • updated clean and filter for NormalStringColumn

Version 1.1.5

  • fixed bug in NonNullVarLenColumn::checkDistinct
  • added support for DataFrame.asResultSet().getMetaData()

Version 1.1.4

  • improved support for direct allocation mode (-Dtech.bitey.allocateDirect=true) by reducing large heap allocations

Version 1.1.3

  • proper handling of key column in select/dropColumns

Version 1.1.2

  • added Column::filter method
  • performance improvements

Version 1.1.1

  • added Column::clean method
  • support custom null value in CSV file parsing
  • added InstantColumn

Version 1.1.0

  • JPMS and Maven modularization

Version 1.0.0

  • First publicized release.