v1.1.0
New Platforms
✅ Version 1.1 includes the first official release of the Windows version of ArcticDB!
Versions 1.1 includes the following caveats:
- Please have a recent Visual C++ Redistributable for Visual Studio 2015-2022 installed.
- Windows does not support fixed-width NumPy strings and so will not be able to write fixed-width strings contained within a NumPy array.
- Writing pickled data can fail on machines with limited memory, see #340 for details and a workaround.
- The LMDB store on Windows pre-allocates the max storage size on disk, so we limited the size to 128MB. We will provide an option to increase the size in the future (#229).
✅ Version 1.1 now supports Python 3.11!
New Features
✅ batch_get_descriptor method added (#219)
✅ batch_get_metadata method added (#220)
Both batch methods do not achieve optimal parallelism - we are aiming to address in 1.2.
Changes
✅ 1.1 pins to Pandas < 2.0 whilst we address a few remaining compatibility issues 🐼 (#237)
✅ 1.1 supports Protobuf V3 as well as V4
✅ Out-of-order data updates now raises exceptions should they prevent future indexed reads (#203)
✅ PCRE is now statically linked (#321)
✅ stream id
which is a confusing term has been renamed to symbol
in error messages and should be better understood (#311)
✅ Pickled data supports up-to 4GB (#260)
✅ Debugging toolbox added (#209)
✅ Introduced a base exception type arcticdb.exceptions.ArcticException
. Exceptions are exposed in arcticdb.exceptions
module with the following hierarchy:
RuntimeError
└-- ArcticException
|-- ArcticNativeNotYetImplemented
|-- DuplicateKeyException
|-- MissingDataException
|-- NoDataFoundException
|-- NoSuchVersionException
|-- NormalizationException
|-- PermissionException
|-- SchemaException
|-- SortingException
| └-- UnsortedDataException
|-- StorageException
|-- StreamDescriptorMismatch
└-- InternalException
Next version:
NEW FEATURE: defragment_symbol_data method added (#180)
The wheels are on Pypi. Below are for debugging: