Skip to content

Latest commit

 

History

History
183 lines (150 loc) · 8.61 KB

CHANGELOG.md

File metadata and controls

183 lines (150 loc) · 8.61 KB
Raw

nanoarrow Changelog

nanoarrow 0.1.0 (2023-03-01)

Feat

  • extensions/nanoarrow_ipc: Improve type coverage of schema field decode (#115)
  • r: Add as_nanoarrow_array() implementation that does not fall back on arrow::as_arrow_array() everywhere (#108)
  • r: Create nanoarrow_array objects from buffers (#105)
  • r: Implement infer schema methods (#104)
  • r: Create and modify nanoarrow_schema objects (#101)

Fix

  • Correct storage type for timestamp and duration types (#116)
  • extensions/nanoarrow_ipc: Remove extra copy of flatcc from dist/ (#113)
  • make sure bundled nanoarrow is also valid C++ (#112)
  • extensions/nanoarrow_ipc: Tweak draft interface (#111)
  • set map entries/key to non-nullable (#107)
  • ci: Actually commit bundled IPC extension to dist/ (#96)

nanoarrow 0.2.0 (2023-06-16)

Feat

  • python: Python schema, array, and array view skeleton (#117)
  • Include dictionary member in ArrowArrayView struct (#221)
  • extensions/nanoarrow_ipc: Add endian swapping to IPC reader (#214)
  • r: Improve printing and conversion of buffers (#208)
  • Add enum ArrowType buffer_data_type member to struct ArrowLayout (#207)
  • Implement ListChildOffset function (#197)
  • r: Add ability to deterministically run a finalizer on an array stream (#196)
  • r: Union array support (#195)
  • r: Add ArrowArrayStream implementation to support keeping a dependent object in scope (#194)
  • Add Decimal Get/Set utilities (#180)
  • extensions/nanoarrow_ipc: Add option to validate arrays at NANOARROW_VALIDATION_LEVEL_FULL (#177)
  • Allow explicit validation level in ArrowArrayFinishBuilding() (#175)
  • Implement ArrowArrayViewValidateFull() (#174)
  • extensions/nanoarrow_ipc: Allow shared buffers for zero-copy buffer decode (#165)
  • extensions/nanoarrow_ipc: Add single-threaded stream reader (#164)
  • ci: Add suite of Docker-based release verification script tests (#160)
  • extensions/nanoarrow_ipc: Decode RecordBatch message to ArrowArray (#143)
  • extensions/nanoarrow_ipc: Improve type coverage of schema field decode (#115)
  • r: Add as_nanoarrow_array() implementation that does not fall back on arrow::as_arrow_array() everywhere (#108)
  • r: Create nanoarrow_array objects from buffers (#105)
  • r: Implement infer schema methods (#104)
  • r: Create and modify nanoarrow_schema objects (#101)

Fix

  • Improve limit check for unsigned input (#233)
  • extensions/nanoarrow_ipc: Don't produce arrays with NULL data buffers (#226)
  • r: Fix convert_array_stream() for non-record batch stream with zero batches (#212)
  • clear release in EmptyArrayStream::release_wrapper (#204)
  • r: Release streams when calling as.vector() or as.data.frame() (#202)
  • Improve readability of ArrowArrayAllocateChildren() (#199)
  • extensions/nanoarrow_ipc: Fix + test calling ArrowIpcDecoderSetSchema() more than once (#173)
  • extensions/nanoarrow_ipc: Don't release input stream automatically on end of input (#168)
  • r: Don't invoke undefined behaviour in conversions to/from Arrow (#167)
  • extensions/nanoarrow_ipc: Test without C11 atomics on CI (#166)
  • extensions/nanoarrow_ipc: Ensure tests pass on big endian (#162)
  • r: Use strict prototypes in all internal C functions (#151)
  • r: Don't memcpy NULL when converting buffer to raw (#149)
  • include compilers in conda instructions (#142)
  • include gtest in conda instructions (#138)
  • Explicit stringsAsFactors = FALSE for R <= 3.6 (#135)
  • Support centos7/gcc 4.8 for CMake build + test workflow (#133)
  • Fix cmake build + test and verification script on Windows (#130)
  • isnan() usage compatible with old clang (#126)
  • Improve reliability of R tests on non-standard systems (#127)
  • Ensure tests pass on big endian (#128)
  • Correct storage type for timestamp and duration types (#116)
  • extensions/nanoarrow_ipc: Remove extra copy of flatcc from dist/ (#113)
  • make sure bundled nanoarrow is also valid C++ (#112)
  • extensions/nanoarrow_ipc: Tweak draft interface (#111)
  • set map entries/key to non-nullable (#107)
  • ci: Actually commit bundled IPC extension to dist/ (#96)

Refactor

  • extensions/nanoarrow_ipc: Reconfigure assembling arrays for better validation (#209)
  • Unify ArrowArrayView and ArrowArray validation (#201)

nanoarrow 0.3.0 (2023-09-26)

Feat

  • r: Use classed warnings to signal that a lossy conversion occurred (#298)
  • r: Add support for bit64::integer64() conversions (#293)
  • r: Implement extension type registration/conversion (#288)
  • r: Implement dictionary conversion (#285)
  • Add ArrowBitsUnpackInt32() (#278)
  • Add ArrowBitmapUnpackInt8Unsafe() (#276)
  • Add Support for Intervals (#258)
  • extensions/nanoarrow_device: Draft DeviceArray interface (#205)

Fix

  • Resolve build warnings on Windows (#304)
  • Return EOVERFLOW when appending to a string or binary type would exceed 2 GB (#302)
  • dev/release: Increase test discovery timeout value (#300)
  • Fix declaration of an array with an ambiguously constexpr size (#301)
  • r: Ensure ordered is reflected in na_dictionary() (#299)
  • r: Warn for possibly out of range int64 -> double conversions (#294)
  • extensions/nanoarrow_ipc: Check number of bytes read when reading buffer body (#295)
  • Ensure that test for increasing offsets is not affected by overflow (#291)
  • extensions/nanoarrow_ipc: Fix crash and mixleading error messages resulting from corrupted streams (#289)
  • r: Support map conversion to R vector (#282)
  • examples/linesplitter: Fix CMake Build (#271)
  • r: Don't link to arrow package R6 class pages (#269)
  • python: Ensure generator does not raise StopIteration (#262)
  • docs: Fix typo in getting started article (#250)
  • Fix bad access crash in ArrowBitmapByteCountSet() (#242)

Refactor

  • r: Use basic_array_stream() to improve array stream to data.frame conversion (#279)
  • python: Cleaner strategy for __iter__() on an ArrowArrayStream (#263)

nanoarrow 0.4.0

Docs

  • r: fix source links from pkgdown site (#315)

Feat

  • Check flags field of ArrowSchema on ArrowSchemaViewInit (#368)
  • Add decimal support to integration tester (#361)
  • Add support for datetime types in integration tester (#356)
  • Add dictionary support in integration test utility (#342)
  • Add C Data integration test shared library (#337)
  • Add Array/Schema/ArrayStream comparison utility to testing helpers (#330)
  • Add batch reader and data file read/write to/from ArrowArrayStream (#328)
  • Add integration testing reader for Column (#325)
  • Add integration testing JSON reader (#322)
  • Add Type/Field/Schema JSON writer for integration testing JSON (#321)
  • extensions/nanoarrow_testing: Add nanoarrow_testing extension with testing JSON writer (#317)
  • python: Implement user-facing Schema class (#366)
  • python: basic export through PyCapsules (#320)
  • python: Add ArrowDeviceArray extension to Python bindings (#313)
  • python: Support the PyCapsule protocol (#318)
  • r: Provide LinkingTo headers for extension packages (#332)
  • r: Add more nanoarrow_array_stream generics (#349)
  • r: Add conversion from integer type to character() (#345)

Fix

  • Issue with appending NULLs to IntervalArray (#376)
  • Suppress unused parameter warnings (#365)
  • Add const qualifier where appropriate in struct fields and declarations (#327)
  • docs: Correct typo in testing.rst (#348)
  • r: Ensure simple list()s can be converted without arrow installed (#344)
  • r: Ensure wrapper array stream eagerly releases the wrapped array stream (#333)

Perf

  • Improved Bit (Un)packing Performance (#280)

Refactor

  • Add wrappers around callbacks to improve syntax and debuggability (#338)
  • Improve syntax for implementing ArrowArrayStream from C++ (#336)
  • python: Document, prefix, and add reprs for C-wrapping classes (#340)