Skip to content

0.6.1555

Compare
Choose a tag to compare
@lambdaforge-ci lambdaforge-ci released this 04 Dec 19:57
4b3a87d
feat: improve writer latency (#618)

* Release all test connections. Fix create-database without arguments.

* Remove randomization from tests.

* Release connections locally on deletions, but warn if they were not released.

* Add connections file...

* Fix create-database and connection spec.

* First take on parallel operations for writer.

* Fix format.

* Implement batching transactor.

* Expose buffer sizes and warn on back pressure.

Reduce blocking => speedup. Rename get-time to get-date.

* Provide synchronous flushing of pending writes.

* Fix outstanding tests.

* Update Datahike API and writer

* Update persistent-sorted-set version and branching
factor

* Fix formatting and whitespace in versioning and
persistent_set files

* Add Leaf type hint for native compilation.

* Fix indentation for persistent set

* Add boolean argument to update-and-commit function

* Deref transact! function call in server.clj

* Fix transact! function to handle updates correctly

* Add Leaf type hint for native compilation

* Minor cleanups.

* Fix commit-db variable assignment

* Fix callback bug in commit function

* Refactor connection handling and fix writer test

* Add missing files

* Fix format

* Ensure atomic extraction of pending write operations

* Refactor flush-pending-writes function

* Refactor config normalization in connector

* Format.

* Only update commit-id of connection in writer.

* Separate update logic from commiting.

* Fix commit! function arguments

* Add parents to connection metadata

* Fix parents assignment in writer.cljc

* Fix commit metadata in writer.cljc

* Update commit-id in merge!

* Add add-commit-meta function

* Fix commit-queue input channel in writer.cljc

* Try to simplify commit!

* Simplify commit!

* Add current branch head again.

* Send committed db as db-after to ensure data structure integrity.

* Improve error handling and use JSON for writer.

* Add missing paren.

* Improve error handling.

* Fix format.

* Fix server connections.

* Update DEFAULT_COMMIT_WAIT_TIME to 0

* Add resources to native compilation, fixes libdatahike build.

* Use konserve git version konserve upstream filestore fix.

* Instrumented konserve release

* Use new konserve version.

* Update git/sha for io.replikativ/konserve

* Update git/sha for io.replikativ/konserve

* Add simple stress test for file store

* Fix format

* Update git/sha for io.replikativ/konserve

* Don't run spec tests on stress-test

* Fix JSON handlers in writer. Small fixes.

* Test with old konserve version

* Use konserve release and remove commented code

* Update datahike logo

* Add missing flush statement on db creation.

* Use Exception for node not found. last -> peek.

* Fix condition for node exception.

* Use dt/raise instead of throw.