Skip to content

Latest commit

 

History

History
953 lines (652 loc) · 52.5 KB

HISTORY.md

File metadata and controls

953 lines (652 loc) · 52.5 KB
Raw

TileDB-Py 0.17.3 Release Notes

API Changes

  • Add ability to pass shape tuple to empty_like #1316
  • Support retrieving MBRs of var-sized dimensions #1311

Misc Updates

  • Wheels will no longer be supported for macOS 10.15 Catalina; the minimum supported macOS version is now 11 Big Sur #1300
  • Wheels will no longer supported for Python 3.6 #1300

TileDB-Py 0.17.2 Release Notes

TileDB Embedded updates:

Bug Fixes

  • Fix issue where querying an array with a Boolean type when arrow=True, but is unselected in .query(attr=...), results in an error pyarrow.lib.ArrowInvalid: Invalid column index to set field. #1291
  • Use Arrow type fixed-width binary ("w:") for non-variable TILEDB_CHAR #1286

TileDB-Py 0.17.1 Release Notes

API Changes

  • Support datetime64 for QueryCondition #1279

TileDB-Py 0.17.0 Release Notes

TileDB Embedded updates:

TileDB-Py 0.16.5 Release Notes

TileDB Embedded updates:

TileDB-Py 0.16.4 Release Notes

TileDB Embedded updates:

Improvements

  • setup.py revert back to retrieving core version by using ctypes by parsing tiledb_version.h; the tiledb shared object lib now returns back a full path #1226
  • Update minimum required cmake version to =>3.23; required for building libtiledb #1260

API Changes

  • Addition of in operator for QueryCondition #1214
  • Revert the regular indexer [:] to return entire array rather than nonempty domain in order to maintain NumPy semantics #1261

Bug Fixes

  • Deprecate Filestore.import_uri in lieu of Filestore.copy_from #1226

TileDB-Py 0.16.3 Release Notes

Packaging Notes

  • This removes import tkinter from test_libtiledb.py which was preventing the conda package from building properly

TileDB-Py 0.16.2 Release Notes

TileDB Embedded updates:

Improvements

  • setup.py retrieves core version by using ctypes to call tiledb_version rather than parsing tiledb_version.h #1191

Bug Fixes

  • Set nonempty domain to (None, None) for empty string #1182

API Changes

  • Support QueryCondition for dense arrays #1198
  • Querying dense array with [:] returns shape that matches nonempty domain, consistent with .df[:] and .multi_index[:] #1199
  • Addition of from_numpy support for mode={ingest,schema_only,append} #1185

TileDB-Py 0.16.1 Release Notes

TileDB Embedded updates:

TileDB-Py 0.16.0 Release Notes

TileDB Embedded updates:

API Changes

  • Addition of Filestore API #1070
  • Use bool instead of uint8 for Boolean dtype in dataframe_.py #1154
  • Support QueryCondition OR operator #1146

TileDB-Py 0.15.6 Release Notes

TileDB Embedded updates:

TileDB-Py 0.15.5 Release Notes

TileDB Embedded updates:

API Changes

  • Support TILEDB_BLOB dtype #1159

Bug Fixes

  • Fix error where passing a Context to Group would segfault intermittenly #1165
  • Correct Boolean values when use_arrow=True #1167

TileDB-Py 0.15.4 Release Notes

Packaging Notes

  • Due to a packaging error, the wheels for 0.15.4 should not be used.

TileDB-Py 0.15.3 Release Notes

TileDB Embedded updates:

TileDB-Py 0.15.2 Release Notes

TileDB Embedded updates:

Improvements

  • Refactor MultiRangeIndexer & DataFrameIndexer: addition of ABC _BaseIndexer with virtual method _run_query and generator _BaseIndexer.__iter__; remove _iter_state; and fix bugs related to incomplete queries #1134

Bug Fixes

  • Fix race condition in {Dense,Sparse}Array.__new__ #1096
  • Correcting stats_dump issues: Python stats now also in JSON form if json=True, resolve name mangling of json argument and json module, and pulling "timer" and "counter" stats from stats_json_core for libtiledb>=2.3 #1140

API Changes

  • Addition of tiledb.DictionaryFilter #1074
  • Add support for Datatype::TILEDB_BOOL #1110
  • Addition of Group.__contains__ to check if member with given name is in Group #1125
  • Support with-statement for Groups #1124
  • Addition of keys, values, and items to Group.meta #1123
  • Group.member also returns name if given #1141

TileDB-Py 0.15.1 Release Notes

TileDB Embedded updates:

TileDB-Py 0.15.0 Release Notes

TileDB Embedded updates:

Misc Updates

  • Wheels will no longer be supported for macOS 10.14 Mojave; the minimum supported macOS version is now 10.15 Catalina #1080

TileDB-Py 0.14.5 Release Notes

TileDB Embedded updates:

TileDB-Py 0.14.4 Release Notes

Misc Updates

  • Update MACOSX_DEPLOYMENT_TARGET from 10.14 to 10.15 #1080

Bug Fixes

  • Correct handling of Arrow cell count with all empty result #1082

TileDB-Py 0.14.3 Release Notes

Improvements

  • Refactor display of TileDB objects in Jupyter notebooks to be more readable #1049
  • Improve documentation for Filter, FilterList, VFS, FileIO, Group, and QueryCondition #1043, #1058

Bug Fixes

  • Dim.shape correctly errors out if type is not integer or datetime #1055
  • Correctly check dtypes in from_pandas for supported versions of NumPy <1.20 #1054
  • Fix Arrow Table lifetime issues when using.query(return_arrow=True) #1056

TileDB-Py 0.14.2 Release Notes

TileDB Embedded updates:

Improvements

  • Add Group and Object to docs #1040

Bug Fixes

  • Correct Group.__repr__ to call correct _dump function #1040
  • Check type of ctx in from_pandas and from_csv #1042
  • Only allow use of .df indexer for .query(return_arrow=True); error out with meaningful error message otherwise #1045

TileDB-Py 0.14.1 Release Notes

TileDB Embedded updates:

TileDB-Py 0.14.0 Release Notes

TileDB Embedded updates:

API Changes

  • Addition of Group and Object classes to support improved groups #1022

TileDB-Py 0.13.3 Release Notes

TileDB Embedded updates:

  • The Python 3.10 / manylinux2014 wheels for TileDB-Py 0.13.3 include TileDB Embedded TileDB 2.7.2 built with GCS support

Improvements

  • Move VFS, FileIO, and FileHandle classes from Cython to Pybind11 #934

TileDB-Py 0.13.2 Release Notes

TileDB Embedded updates:

Improvements

  • Move FilterList and Filter classes from Cython to Pybind11 #921

Bug Fixes

  • Fix default validity for write to nullable attribute #994
  • Reduce query time for dense var-length arrays by including extra offset element in initial buffer allocation #1005
  • Fix round-trippable repr for dimension tile #998

API Changes

  • Addition of ArraySchema.version to get version of array schema #949
  • Deprecate coords_filters from ArraySchema #993
  • Allow setting ascii in column_type for from_pandas/from_csv #999

TileDB-Py 0.13.1 Release Notes

TileDB Embedded updates:

TileDB-Py 0.13.0 Release Notes

TileDB Embedded updates:

API Changes

  • Deprecate partial vacuuming #930
  • Default from_csv to use filter=ZstdFilter() if not specified for Attr or Dim #937

TileDB-Py 0.12.4 Release Notes

TileDB Embedded updates:

TileDB-Py 0.12.3 Release Notes

TileDB Embedded updates:

Bug Fixes

  • Properly initalize query in order to retrieve estimate results #920
  • Enable building with serialization disabled #924
  • Do not print out FragmentInfo_frags for repr #925
  • Error out with IndexError when attempting to use a step in the regular indexer #911

TileDB-Py 0.12.2 Release Notes

TileDB Embedded updates:

API Changes

  • Addition of ArraySchema.validity_filters #898

TileDB-Py 0.12.1 Release Notes

TileDB Embedded updates:

Bug fixes

  • Cast 'dim's dtype in Domaintostrprior to applyinghtml.escape` #883
  • Support attributes with spaces in QueryCondition by casting with attr(); values may be casted with val() #886

TileDB-Py 0.12.0 Release Notes

TileDB Embedded updates:

API Changes

  • Allow writing to dimension-only array (zero attributes) by using assignment to None, for example: A[coords] = None (given A: tiledb.Array) #854
  • Remove repeating header names for attr when displaying ArraySchema in Jupyter Notebooks #856
  • tiledb.VFS.open returns FileIO object; no longer returns FileHandle #802
  • Addition of tiledb.copy_fragments_to_existing_array #864

Bug fixes

  • HTML escape strings for Dim and Attr's name and dtype #856
  • Fix attribute view for multi-indexer #866

Improvements

  • Metadata-related API calls are now 'nogil' #867

TileDB-Py 0.11.5 Release Notes

TileDB-Py 0.11.4 Release Notes

TileDB Embedded updates:

API Changes

  • Add rich display for TileDB objects in Jupyter notebooks #824
  • Support TILEDB_STRING_ASCII for array metadata #828

TileDB-Py 0.11.3 Release Notes

Impovements

  • Support for Python 3.10 #808

API Changes

  • Addition of tiledb.version() to return version as a tuple #801
  • Query.get_stats and Ctx.get_stats changed function signature; automatically print_out stats and add option to output as json #809

Bug fixes

  • tiledb.delete_fragments removes unused schemas #813

TileDB-Py 0.11.2 Release Notes

TileDB Embedded updates:

Bug fixes

  • Support dict parameter for 'config' argument to VFS constructor #805

TileDB-Py 0.11.1 Release Notes

TileDB Embedded updates:

Bug fixes

  • Support dict parameter for 'config' argument to VFS constructor #805
  • Correct libtiledb version checking for Fragment Info API getters' MBRs and array schema name #784

TileDB-Py 0.11.0 Release Notes

TileDB Embedded updates:

API Changes

  • Addition of MBRs to FragmentInfo API #760
  • Addition of array_schema_name to FragmentInfo API #777
  • Addition of tiledb.create_array_from_fragments to copy fragments within a given timestamp range to a new array #777

TileDB-Py 0.10.5 Release Notes

API Changes

  • Addition of tiledb.delete_fragments to remove fragments within a given timestamp range #774

TileDB-Py 0.10.4 Release Notes

TileDB Embedded updates:

Bug fixes

  • Error out when applying QueryCondition to dense arrays; this feature will be implemented in TileDB Embedded 2.5 #753
  • Ensure that indexer, multi-indexer, and .df return the same results when applying QueryCondition #753
  • Fix error when using .df with PyArrow 6 due to incorrect metadata field in exported schema #764
  • Fix #755: from_pandas to correctly round-trip unnamed Index #761
  • Fix .df indexer bug with empty result set #744

API Changes

  • Close the PyFragmentInfo object in the FragmentInfoList constructor to reflect changes in the FragmentInfo API in TileDB Embedded 2.5 #752
  • Make ctx argument optional for ArraySchemaEvolution #743
  • Remove coords_filters from ArraySchema for dense arrays #762

TileDB-Py 0.10.3 Release Notes

TileDB Embedded updates:

  • TileDB-Py 0.10.3 includes TileDB Embedded TileDB 2.4.2
    • Note that 2.4.1 was skipped due to accidental tagging of the 2.4.1 git tag during CI testing

API Changes

  • Addition of overwrite parameter to Array.create #713
  • Addition of "ascii" dtype for Dims #720

Bug fixes

  • Pass Ctx to ArraySchema.load in from_pandas #709
  • Give clear error message when attempting to apply QueryCondition on dimensions #722
  • Do not add string range when querying empty array #721

Improvements

  • String dimension default fix in core #2436 reverts a previous change in which the nonempty domain was passed the to multi-range indexer if unspecified #712

TileDB-Py 0.10.2 Release Notes

API Changes

  • Deprecate sparse writes to dense arrays #681
  • Addition of Attr.isascii #681
  • Addition of Ctx.get_stats and Query.get_stats #698

Improvements

  • Added support for timestamp argument in tiledb.from_numpy #699

TileDB-Py 0.10.1 Release Notes

API Changes

  • Do not require domain=(None, None) for string dimensions #662

Improvements

  • Print a warning about ContextVar bug when running under ipykernel < 6.0. #665 Please see #667 for more information.
  • tiledb.Dim representation now displays var=True for dimensions with bytes datatype, consistent with tiledb.Attr #669

Bug fixes

  • Fix concurrent use of Array.multi_index and .df by using new instance for each invocation #672
  • For attributes, if var=False but the bytestring is fixed-width or if var=True but the bytestring is variable length, error out #663

TileDB-Py 0.10.0 Release Notes

TileDB Embedded updates:

  • TileDB-Py 0.10.0 includes TileDB Embedded TileDB 2.4.0 with a number of new features and improvements, including:
    • new platform support: Apple M1
    • support for ArraySchema evolution (adding and removing attributes)
    • support for Azure SAS (shared access signature) tokens

API Changes

  • When using Array.multi_index, an empty result is returned if the nonempty domain is empty #656
  • Addition of Array.set_query to read array using a serialized query #651

Improvements

  • Support numeric column names in from_pandas by casting to str dtype #652
  • New tiledb.ArraySchemaEvolution API to add and drop attributes from an existing array #657

Bug Fixes

  • Correct listing of consolidated fragments to vacuum in the Fragment Info API by deprecating FragmentInfoList.to_vacuum_uri, FragmentInfoList.to_vacuum_num, FragmentInfo.to_vacuum_uri, and FragmentInfo.to_vacuum_num and replacing with FragmentInfoList.to_vacuum #650
  • Correct issue where appending None to FilterList causes segfault by checking the filter argument #653

TileDB-Py 0.9.5 Release Notes

TileDB Embedded updates:

Improvements

  • Consolidate _nonempty_domain_var into nonempty_domain #632
  • Support more valid Python syntax for QueryCondition statements #636
  • Addition of ascii dtype to Attr allows QueryCondition to support var-length strings #637

TileDB-Py 0.9.4 Release Notes

Improvements

  • Support pickling for arrays in write-mode #626

Bug Fixes

  • Fixed multi-range indexer to default to explicitly pass in the non-empty domain if dimensions are unspecified #630

TileDB-Py 0.9.3 Release Notes

Packaging Notes

  • Due to a packaging issue released with 0.9.3 (NumPy ABI compatibility with NumPy < 1.20 for Python 3.8), this section is intentionally left blank.

TileDB-Py 0.9.2 Release Notes

Packaging Notes

  • Fixed release builder ordering issue which led to CRLF line endings in 0.9.1 source distribution.

API Changes

  • Deprecate Array.timestamp and replace with Array.timestamp_range #616

Improvements

  • Set ArraySchema.tile_order=None for Hilbert-ordered arrays #609
  • Use CIBW to build release wheels on Linux #613
  • Addition of Pickling functionality for SparseArray #618

TileDB-Py 0.9.1 Release Notes

TileDB Embedded updates:

Improvements

  • Support passing a timestamp range for consolidation and vacuuming #603

Bug Fixes

  • FragmentInfo API's to_vacuum_uri() function corrected to iterate through to_vacuum_num rather than fragment_num#603
  • Return "NA" For ArraySchema.tile_order if "Hilbert" #605

TileDB-Py 0.9.0 Release Notes

TileDB Embedded updates:

  • TileDB-Py 0.9.0 includes TileDB Embedded TileDB 2.3 with a significant number of new features and improvements.

Packaging Notes

  • Windows wheels are now built with TileDB Cloud REST support enabled #541

Improvements

  • Addition of QueryCondition API to filter query on attributes #576

Bug Fixes

  • Fixed from_pandas append error for sparse arrayse: no need to specify 'row_start_idx' #593
  • Fixed 'index_dims' kwarg handling for from_pandas #590

API Changes

  • from_dataframe function has been removed; deprecated in TileDB-Py 0.6 and replaced by from_pandas.

TileDB-Py 0.8.11 Release Notes

Bug fixes

  • Fixed incorrect NumPy ABI target in Linux wheels #590
  • QueryCondition API will cast condition values to the datatype of the corresponding attribute #589
  • QueryCondition API errors out when there are mismatched attributes to query's attr_cond and attrs arguments #589
  • QueryCondition API can now parse negative numbers #589

TileDB-Py 0.8.10 Release Notes

Improvements

  • Disabled libtiledb Werror compilation argument for from-source builds via setup.py #574
  • Relaxed NumPy version requirements for from-source builds via setup.py #575

Bug fixes

  • Fixed FragmentInfoList where context was not being passed to ArraySchema #573
    • Fixed FragmentInfoList where context was not being passed to ArraySchema #578
  • Fixed read bug due to large estimated result size #579
  • Fixed bug reading nullable attributes due to missing buffer resize #581
  • Fixed Python output for tiledb.stats_dump #586

TileDB-Py 0.8.9 Release Notes

TileDB Embedded updates:

Improvements

  • Support for iterating over incomplete query results #548
    • This feature provides the capability to consume partial query results with a fixed maximum buffer size rather than the the default behavior of resizing buffers and resubmitting to completion. Usage example: examples/incomplete_iteration.py (along with test in: test_libtiledb.py:test_incomplete_return)
  • Rename FragmentsInfo to FragmentInfoList #551
  • Dataframe creation uses Zstd default compression level (-1) #552
  • Rename Fragment Info API's non_empty_domain attribute to nonempty_domain #553
  • Added configuration option py.alloc_max_bytes to control maximum initial buffer allocation #557

Bug fixes

  • Fixed incorrected error raised in .df[] indexer when pyarrow not installed #554
  • Fixed from_pandas(attr_filters=None, dim_filters=None) (previously used internal defaults) #564
  • Fixed from_pandas write bug due to incorrect classification of str/bytes columns #562
  • Fix segfault due to mismatched validity num and data buffer sizes #567

TileDB-Py 0.8.8 Release Notes

TileDB Embedded updates:

TileDB-Py 0.8.7 Release Notes

Improvements

  • ArraySchema support for cell_order="hilbert" #535

Bug fixes

  • Fixed regression in from_pandas with string-valued index dimensions #526
  • Fixed GC lifetime bug in string buffer conversion #525
  • Fixed FilterList's repr() method #528

TileDB-Py 0.8.6 Release Notes

TileDB Embedded updates:

Improvements

  • Addition of VFS() functions copy_file() and copy_dir() #507
  • Add support in from_pandas for storing Pandas extension types as variable-length attributes #515
  • Add support for sparse writes to dense arrays #521

Bug fixes

  • Multi-length attributes, regardless of fixed or var-length, do not work query properly with PyArrow enabled due to lack of Arrow List support. When using .df[] with PyArrow enabled, we are returning a clear message to the user to use query(use_pyarrow=False) #513

TileDB-Py 0.8.5 Release Notes

TileDB Embedded updates:

Documentation Updates

  • Added example reading/writing RGB (multi-component) array #487

Improvements

  • Restore tiledb.stats_dump default to verbose=True #491
  • Remove non_empty_domain_var() Fragment Info PyBind11 Function and only use get_non_empty_domain() for both fixed and var-length domains #505

TileDB-Py 0.8.4 Release Notes

Improvements

  • Addition of high-level function array_fragments() that returns a FragmentsInfo object #488
  • Added support for from_pandas/df[] round-trip of Pandas nullable integer and bool types #480
  • Fragment info API example usage now provided at examples/fragment_info.py #479
  • Fragment info API parameters have been rearranged to match the rest of the TileDB Python API such that the uri is provided first and context, an optional parameter that defaults to tiledb.default_ctx(), is provided second #479

Bug fixes

  • Fix bug in Attr to ensure that all Unicode strings are automatically set to var=True [#495]#495
  • Fix bug in Array.multi_index slicing bug for sparse array with dimension range including 0 #482

TileDB-Py 0.8.3 Release Notes

TileDB Embedded updates:

Improvements

  • Added nullable keyword argument to Attr constructor #474

Bug fixes

  • Fix bug in Array.multi_index with slice range including 0 (incorrectly used the nonempty domain as endpoint) #473

TileDB-Py 0.8.2 Release Notes

Packaging Notes

  • This is a version bump to fix numpy compatibility pinning in the wheel build system.

TileDB-Py 0.8.1 Release Notes

TileDB Embedded updates:

Packaging Notes

  • TileDB-Py 0.8 does not support Python 2.

TileDB-Py 0.8.0 Release Notes

TileDB Embedded updates:

  • TileDB-Py 0.8.0 includes TileDB Embedded 2.2.2 featuring a number of significant improvements in core storage engine functionality. See release notes for TileDB 2.2.1 and TileDB 2.2.2.

Packaging Notes

  • TileDB-Py 0.8 does not support Python 2.

Improvements

  • Add initial tiledb.from_parquet functionality (beta) [a90d5d9b1b]
  • Preload metadata in .df query path to reduce read latency for remote arrays [79ab12fcf0]

Bug fixes

  • Update py::dtype usage for compatibility with pybind11 2.6.2 [9d3d3d3c43]

TileDB-Py 0.7.7 Release Notes

Bug fixes

  • Cherry-pick commit 9d3d3d3c43 to ix runtime bug in conda packages built against pybind11 2.6.2 9d3d3d3c430f

TileDB-Py 0.7.6 Release Notes

Packaging Notes

  • TileDB-Py 0.7.x will be the last version of TileDB-Py supporting Python 2.

Bug fixes

  • Fix read compatibility for empty strings written with 2.1 or 2.2 #462
  • Fix #457: make sure to fit automatic tile extent to dim range for date type #464

TileDB-Py 0.7.5 Release Notes

Packaging Notes

  • TileDB-Py 0.7.x will be the last version of TileDB-Py supporting Python 2.

TileDB Embedded updates:

Improvements

  • FragmentInfo API by default returns information from all fragments and dimensions #444
  • Add integer multi-indexing for NumPy datetime64 dimensions #447
  • Add from_csv/pandas support for timestamp keyword argument to specify write timestamp #450
  • Add verbosity option to stats_dump() #452
  • Add unique_dim_values() to return unique dimension values for a given SparseArray #454
  • Add support to query() for returning subsets of specified dimensions #458
  • Optimize string array writes #459

Bug fixes

  • Fix Dim.shape for dense array with datetime dimension #448

TileDB-Py 0.7.4 Release Notes

Improvements

  • Support selecting subset of dimensions in Array.query via new keyword argument dims: List[String]. The coords=True kwarg is still supported for compatibility, and continues to return all dimensions #433
  • Support Dim(filters=FilterList) keyword argument to set filters on a per-Dim basis #434
  • Support tiledb.from_csv setting attribute and dimension filters by dictionary of {name: filter} #434
  • Add ArraySchema.check wrapping tiledb_array_schema_check #435
  • Add support for attribute fill values tiledb.Attr(fill=...) and Attr.fill getter #437

API Changes

  • tiledb.from_csv keyword arg attrs_filters renamed to attr_filters #434

Bug fixes

  • Fix bug in multi_index slicing of dense arrays #438

TileDB-Py 0.7.3 Release Notes

Improvements

  • The default result layout for indexing/querying sparse arrays is now TILEDB_UNORDERED #428, #431
  • Added documentation for all TileDB-Py configuration parameters #430
  • Fixed documentation rendering for Array.query #430

Bug fixes

  • Fix sparse dimension type selection when array type is not specified to from_pandas #429
  • Don't pass allows_duplicates=True to dense array constructor (tiledb.from_csv) #428

TileDB-Py 0.7.2 Release Notes

TileDB Embedded updates:

Changes

  • The default array type for from_pandas and from_csv is now dense, if unspecified, except when passing a dataframe with string indexes to from_pandas #424

Improvements

  • Automatically determine column to dimension mapping for tiledb.from_csv append mode #408

Bug fixes

  • Fixed tiledb.from_csv/dataframe error when ingesting single-row/index datasets #422
  • Fixed intermittent csv_sparse_col_to_dims failure due to duplicate result ordering #423

TileDB-Py 0.7.1 Release Notes

Improvements

  • Added support for df[] indexing via tiledb.Array.query #411
  • Modified stats_dump to return internal stats as string, allowing for output in Jupyter notebooks #403
  • Added __repr__ to Array and Ctx #413
  • tiledb.open now supports timestamp keyword argument #419
  • tiledb.Domain now supports passing a list of Dims without unpacking #419

Bug fixes

  • Fixed PyPI wheels load error on newer macOS due to overlinkage against system libraries in build process (curl -> libintl) #418
  • Fixed PyPI wheels load error on Windows due to building against TBB #419
  • Fixed indexing of attribute named 'coords' #414
  • open_dataframe now uses the underlying Array's nonempty_domain to avoid errors opening unlimited domain arrays #409

TileDB-Py 0.7.0 Release Notes

TileDB Embedded updates:

  • TileDB-Py 0.7.0 includes TileDB Embedded 2.1.2 featuring a number of significant improvements, with major highlights including:
    • no longer uses Intel TBB for parallelization by default. Along with many benefits to TileDB Embedded, this significantly reduces complications and bugs with python multiprocessing fork mode.
    • Support coalescing subarray ranges to give major performance boosts.

Packaging Notes

  • TileDB-Py 0.7 packages on PyPI support macOS 10.13+ and manylinux10-compatible Linux distributions only. For now, wheels could be produced supporting older systems but without Google Cloud Support; if needed, please contact us to discuss.

Improvements

  • Added ".df[]" indexer tiledb.Array: directly returns a Pandas dataframe from a query (uses multi_index indexing behavior) #390
  • Added parallel CSV ingestion example using Python multiprocessing with tiledb.from_csv #397
  • Added wrapping and support for TileDB checksumming filters: ChecksumMD5Filter and ChecksumSHA256Filter #389
  • Removed TBB install from default setup.py, corresponding to TileDB Embedded changes #389
  • Add support for 'capacity' kwarg to from_csv/from_pandas #391
  • Add support for 'tile' kwarg to from_csv/from_pandas to customize Dim tile extent #391
  • Added '--release-symbols' option for building in release optimization with debug symbols #402
  • Changed allows_duplicates default to True for from_csv/from_pandas #394

Bug fixes

  • Fixed bug indexing anonymous attributes of sparse arrays using A[] (did not affect dense or multi_index) #404
  • Fixed rendering of column name in mixed dtype exception #382
  • Fixed forwarding of 'ctx' kwarg to from_csv/from_pandas #383
  • Fixed type of return values for empty results when indexing a sparse array #384

Misc Updates

  • Added round-trip tests for all filter repr objects #389

TileDB-Py 0.6.6 Release Notes

Note that we will be removing wheel support for macOS 10.9-10.12 in TileDB-Py 0.7 (planned for release in August 2020). This change is due to upstream (AWS SDK) minimum version requirements. The minimum supported version for macOS wheels on PyPI will be macOS 10.13.

Note that we will be removing support for manylinux1 wheels in TileDB-Py 0.7 (planned for release in August 2020). manylinux1 is based on CentOS5, which has been unsupported for several years. We now provide wheels built with manylinux2010, which is based on CentOS6 / glibc 2.12.

Improvements

TileDB-Py 0.6.5 Release Notes

We have added manylinux2010 wheels, corresponding to CentOS6 / glibc 2.12.

We are deprecating support for manylinux1 (CentOS5 / glibc 2.0.7), which is not supported by the Google Cloud Storage SDK. We are planning to remove manylinux1 wheel support in the TileDB-Py 0.7 release.

Improvements

  • Enabled Google Cloud Storage support in macOS and linux (manylinux2010) wheels on PyPI (#364)

TileDB-Py 0.6.4 Release Notes

API notes

  • Deprecated initialize_ctx in favor of default_ctx(config: tiledb.Config) #351

Improvements

  • Bump release target to TileDB 2.0.6
  • Improved error reporting for input data type mismatches #359
  • Added tiledb.VFS.dir_size #343
  • Added read and buffer conversion statistics for python to tiledb.stats_dump #354
  • Implemented string deduplication to reduce conversion time for string arrays #357

Bug fixes

  • Fixed argument order for Array.consolidate with a Config override parameter #344

TileDB-Py 0.6.3 Release Notes

Improvements

Bug fixes

  • Fix unnecessary implicit ordering requirement for multi-attribute assignment. #328

TileDB-Py 0.6.2 Release Notes

Bug fixes

  • Fix nonempty_domain with heterogeneous non-string dimensions (#320)

Improvements

  • Add doctest for tiledb.vacuum (#319)

TileDB-Py 0.6.1 Release Notes

Bug fixes

  • Fix assignment order for nonempty_domain with string dimensions (#308) (test in #311)
  • Fix bug in string attribute handling for var-length attributes (#307)
  • Fix regression reading anonymous attributes from TileDB 1.7 arrays (#311)
  • Fix incorrect multi_index error when string attribute results are empty (#311)

TileDB-Py 0.6.0 Release Notes

Improvements

  • Target TileDB version 2.0
    • Added support for heterogeneous and string-typed dimensions #304
    • Added support for tiledb_array_vacuum for cleaning up consolidated fragments
  • Added Windows wheels for Python 3.7 and 3.8 on PyPI

TileDB-Py 0.5.9 Release Notes

TileDB-Py 0.5.8 Release Notes

  • Rebuild/release due to wheel build error on linux for 0.5.7.

TileDB-Py 0.5.7 Release Notes

TileDB-Py 0.5.6 Release Notes

TileDB-Py 0.5.5 Release Notes

Improvements

  • Return coordinates by default for dense multi_index queries #259

TileDB-Py 0.5.4 Release Notes

Improvements

  • macOS wheels are now available on PyPI #258
  • Delay default ctx initialization, allows per-process global config options to be controlled by user #256

TileDB-Py 0.5.3 Release Notes

PyPI packages: https://pypi.org/project/tiledb/0.5.3/

Improvements

  • Reduce i/o overhead of tiledb.open and array constructors. #239, #240
  • Internal support for retrying incomplete queries in all array indexing modes. #238, #252
  • Eliminate reference cycles to improve Ctx cleanup. #249
  • Support for retrieving compressor level from filter. #234

Bug fixes

  • Fix variable-length indexing error. #236
  • Fix race condition initializing tiledb.cloud mixin from thread pool. #246

TileDB-Py 0.5.2 Release Notes

Bug fixes

  • Fix bug in multi_index result buffer calculation #232

TileDB-Py 0.5.1 Release Notes

Bug fixes

Other

TileDB-Py 0.5.0 Release Notes

New features

  • add support for multi-range queries #219
  • add support for TileDB array metadata #213
  • add support for TILEDB_DATETIME_* attributes, domains, and slicing #211
  • add support for retrieving list of fragments written by the most recent write to an array #207

Bug fixes

  • fix read error with multi-attribute sparse arrays #214

TileDB-Py 0.4.4 Release Notes

New features

  • add dim_type keyword argument to from_numpy in order to override inferred Dimension dtype #194
  • add Array.domain_index: slice over any range within the domain bounds, including negative slices #202

TileDB-Py 0.4.3 Release Notes

New features

  • allow tiledb.open and Array.create to take an optional Ctx to override schema #162
  • add tiledb.array_exists #167

Bug fixes

  • wrap query_submits into try / finally blocks correctly propagate KeyboardInterrupt errors while cleaning up resources #155
  • fixed OOB access in exception handling path #159
  • raise an error when trying to consolidate an open readonly array #172

TileDB-Py 0.4.2 Release Notes

TileDB-Py 0.4.2 contains several improvements as well as bug-fixes associated with the TileDB 1.5.1 release.

New features

  • support for NumPy complex types (#142)

Bug fixes

  • fixed query buffer memory leak (#151)
  • fixed segfault during consolidation (TileDB #1213)
    • note: to receive this fix, conda and source builds should be updated to TileDB 1.5.1. TileDB-Py 0.4.2 binaries on PyPI bundle the updated TileDB 1.5.1 library.
  • fixed indexing with array dtype different from the platform default (#146)
  • fixed VFS.is_bucket when VFS is initialized with a Ctx object (#148)
  • fixed schema_like to correctly forward a Ctx keyword arg (#148)

TileDB-Py 0.4.1 Release Notes

New Features:

  • several high-level API additions (tiledb.open, .save, .empty_like, .schema_like), and serialization improvements including pickling support for DenseArray objects (#129)
  • manylinux1 wheels for Python 2.7, 3.5, 3.6, and 3.7 are available on PyPI: https://pypi.org/project/tiledb

TileDB-Py 0.4.0 Release Notes

This release builds TileDB-Py against TileDB 1.5

New Features:

  • support for variable-length arrays (#120)

Breaking changes:

  • the Ctx argument is now a keyword argument, simplifying API use in the common case (#122)

    for example: tiledb.DenseArray(ctx, uri, ...) becomes: tiledb.DenseArray(uri, ...) or optionally tiledb.DenseArray(uri, ..., ctx=ctx)