Release v0.10.1 (obsolete)

Acknowledgements:

• Alexey Akhunov and Alex Sharov for bug reporting and testing.

New features:

• Added -p option to mdbx_stat utility for printing page operations statistic.
• Added explicit checking for and warning about using unfit github's archives.

Fixes:

• Fixed minor "foo not used" warnings from modern C++ compilers when building the C++ part of the library.
• Fixed confusing/messy errors when build library from unfit github's archives (#197).
• Fixed #​e​l​s​i​f typo.
• Fixed rare unexpected MDBX_PROBLEM error during altering data in huge transactions due to wrong spilling/oust of dirty pages (#195).

TODO for next releases:

• More flexible support of asynchronous runtime/framework(s).
• Migration guide from LMDB to MDBX.
• Get rid of dirty-pages list in MDBX_WRITEMAP mode.
• Large/Overflow pages accounting for dirty-room.
• C++ Buffer issue.
• Support for RAW devices.
• Test framework issue.
• Support MessagePack for Keys & Values.
• Engage new terminology.
• Finalize C++ API (few typos and trivia bugs are still likely for now).
• Packages for Astra Linux, ALT Linux, ROSA Linux, etc.

---

SHA256 checksums

dfcf8993a5242fcd7e7b28e3c3019d60a337e81d5e8c6f4d8368050264262e9a  libmdbx-amalgamated-0.10.1.tar.gz
e58f24ea71a00b2aeda23c7a6382818091962e9738593891e382078b314ba35d  libmdbx-amalgamated-0_10_1.zip

*** Please don't use github's tarballs nor zips, but the amalgamated sources or clone the git repository ***
*** Moreover, please vote for "disable tarballs" feature to vanish this discommodity ***

Release v0.10.0 (obsolete)

Acknowledgements:

• Mahlon E. Smith for Ruby bindings.
• Alex Sharov for mdbx-go, bug reporting and testing.
• Artem Vorotnikov for bug reporting and PR.
• Paolo Rebuffo, Alexey Akhunov and Mark Grosberg for donations.
• Noel Kuntze for preliminary Python bindings.

New features:

• Added mdbx_env_set_option() and mdbx_env_get_option() for controls
  various runtime options for an environment (announce of this feature was missed in a previous news).
• Added MDBX_DISABLE_PAGECHECKS build option to disable some checks to reduce an overhead
  and detection probability of database corruption to a values closer to the LMDB.
  The MDBX_DISABLE_PAGECHECKS=1 provides a performance boost of about 10% in CRUD scenarios,
  and conjointly with the MDBX_ENV_CHECKPID=0 and MDBX_TXN_CHECKOWNER=0 options can yield
  up to 30% more performance compared to LMDB.
• Using float point (exponential quantized) representation for internal 16-bit values
  of grow step and shrink threshold when huge ones (#166).
  To minimize the impact on compatibility, only the odd values inside the upper half
  of the range (i.e. 32769..65533) are used for the new representation.
• Added the mdbx_drop similar to LMDB command-line tool to purge or delete (sub)database(s).
• Ruby bindings is available now by Mahlon E. Smith.
• Added MDBX_ENABLE_MADVISE build option which controls the use of POSIX madvise() hints and friends.
• The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases
  and a slight increase in limits for a keys size to ≈½ of page size.
• Added to mdbx_chk output number of keys/items on pages.
• Added explicit install-strip and install-no-strip targets to the Makefile (#180).
• Major rework page splitting (af9b7b5) for
  • An "auto-appending" feature upon insertion for both ascending and
    descending key sequences. As a result, the optimality of page filling
    increases significantly (more densely, less slackness) while
    inserting ordered sequences of keys,
  • A "splitting at middle" to make page tree more balanced on average.
• Added mdbx_get_sysraminfo() to the API.
• Added guessing a reasonable maximum DB size for the default upper limit of geometry (#183).
• Major rework internal labeling of a dirty pages (958fd5b) for
  a "transparent spilling" feature with the gist to make a dirty pages
  be ready to spilling (writing to a disk) without further altering ones.
  Thus in the MDBX_WRITEMAP mode the OS kernel able to oust dirty pages
  to DB file without further penalty during transaction commit.
  As a result, page swapping and I/O could be significantly reduced during extra large transactions and/or lack of memory.
• Minimized reading leaf-pages during dropping subDB(s) and nested trees.
• Major rework a spilling of dirty pages to support LRU
  policy and prioritization for a large/overflow pages.
• Statistics of page operations (split, merge, copy, spill, etc) now available through mdbx_env_info_ex().
• Auto-setup limit for length of dirty pages list (MDBX_opt_txn_dp_limit option).
• Support make options to list available build options.
• Support make help to list available make targets.
• Silently make's build by default.
• Preliminary Python bindings is available now
  by Noel Kuntze (#147).

Backward compatibility break:

• The MDBX_AVOID_CRT build option was renamed to MDBX_WITHOUT_MSVC_CRT.
  This option is only relevant when building for Windows.
• The mdbx_env_stat() always, and mdbx_env_stat_ex() when called with the zeroed transaction parameter,
  now internally start temporary read transaction and thus may returns MDBX_BAD_RSLOT error.
  So, just never use deprecated mdbx_env_stat()' and call mdbx_env_stat_ex()` with transaction parameter.
• The build option MDBX_CONFIG_MANUAL_TLS_CALLBACK was removed and now just a non-zero value of
  the MDBX_MANUAL_MODULE_HANDLER macro indicates the requirement to manually call mdbx_module_handler()
  when loading libraries and applications uses statically linked libmdbx on an obsolete Windows versions.

Fixes:

• Fixed performance regression due non-optimal C11 atomics usage (#160).
• Fixed "reincarnation" of subDB after it deletion (#168).
• Fixed (disallowing) implicit subDB deletion via operations on @MAIN's DBI-handle.
• Fixed a crash of mdbx_env_info_ex() in case of a call for a non-open environment (#171).
• Fixed the selecting/adjustment values inside mdbx_env_set_geometry() for implicit out-of-range cases (#170).
• Fixed mdbx_env_set_option() for set initial and limit size of dirty page list ((#179).
• Fixed an unreasonably huge default upper limit for DB geometry (#183).
• Fixed constexpr specifier for the slice::invalid().
• Fixed (no)readahead auto-handling (#164).
• Fixed non-alloy build for Windows.
• Switched to using Heap-functions instead of LocalAlloc/LocalFree on Windows.
• Fixed mdbx_env_stat_ex() to returning statistics of the whole environment instead of MainDB only (#190).
• Fixed building by GCC 4.8.5 (added workaround for a preprocessor's bug).
• Fixed building C++ part for iOS <= 13.0 (unavailability of std::filesystem::path).
• Fixed building for Windows target versions prior to Windows Vista (WIN32_WINNT < 0x0600).
• Fixed building by MinGW for Windows (#155).

TODO for a next releases:

• Get rid of dirty-pages list in MDBX_WRITEMAP mode.
• Large/Overflow pages accounting for dirty-room.
• C++ Buffer issue.
• Finalize C++ API (few typos and trivia bugs are still likely for now).
• Support for RAW devices.
• Test framework issue.
• Support MessagePack for Keys & Values.
• Engage new terminology.
• Packages for Astra Linux, ALT Linux, ROSA Linux, Fedora/RHEL, Debian/Ubuntu.

---

SHA256 checksums

767776d961fadeb51ee895fb70ed82a03051bae855a19396f0067b03076103bb  libmdbx-amalgamated-0.10.0.tar.gz
66a46c83b27fb47930e245d1dae99b5b9656a1e0017439f42c6a735fb710d427  libmdbx-amalgamated-0_10_0.zip

*** Please don't use github's tarballs nor zips, but the amalgamated sources or clone the git repository ***

Release v0.9.3 (obsolete)

Acknowledgements:

• Mahlon E. Smith for FreeBSD port of libmdbx.
• 장세연 for bug fixing and PR.
• Clément Renault for Heed fully typed Rust wrapper.
• Alex Sharov for bug reporting.
• Noel Kuntze for bug reporting.

Removed options and features:

• Drop MDBX_HUGE_TRANSACTIONS build-option (now no longer required).

New features:

• Package for FreeBSD is available now by Mahlon E. Smith.
• New API functions to get/set various options (#128):
  • the maximum number of named databases for the environment;
  • the maximum number of threads/reader slots;
  • threshold (since the last unsteady commit) to force flush the data buffers to disk;
  • relative period (since the last unsteady commit) to force flush the data buffers to disk;
  • limit to grow a list of reclaimed/recycled page's numbers for finding a sequence of contiguous pages for large data items;
  • limit to grow a cache of dirty pages for reuse in the current transaction;
  • limit of a pre-allocated memory items for dirty pages;
  • limit of dirty pages for a write transaction;
  • initial allocation size for dirty pages list of a write transaction;
  • maximal part of the dirty pages may be spilled when necessary;
  • minimal part of the dirty pages should be spilled when necessary;
  • how much of the parent transaction dirty pages will be spilled while start each child transaction;
• Unlimited/Dynamic size of retired and dirty page lists (#123).
• Added -p option (purge subDB before loading) to mdbx_load tool.
• Reworked spilling of large transaction and committing of nested transactions:
  • page spilling code reworked to avoid the flaws and bugs inherited from LMDB;
  • limit for number of dirty pages now is controllable at runtime;
  • a spilled pages, including overflow/large pages, now can be reused and refunded/compactified in nested transactions;
  • more effective refunding/compactification especially for the loosed page cache.
• Added MDBX_ENABLE_REFUND and MDBX_PNL_ASCENDING internal/advanced build options.
• Added mdbx_default_pagesize() function.
• Better support architectures with a weak/relaxed memory consistency model (ARM, AARCH64, PPC, MIPS, RISC-V, etc) by means C11 atomics.
• Speed up page number lists and dirty page lists (#132).
• Added LIBMDBX_NO_EXPORTS_LEGACY_API build option.

Fixes:

• Fixed missing cleanup (null assigned) in the C++ commit/abort (#143).
• Fixed mdbx_realloc() for case of nullptr and MDBX_AVOID_CRT=ON for Windows.
• Fixed the possibility to use invalid and renewed (closed & re-opened, dropped & re-created) DBI-handles (#146).
• Fixed 4-byte aligned access to 64-bit integers, including access to the bootid meta-page's field (#153).
• Fixed minor/potential memory leak during page flushing and unspilling.
• Fixed handling states of cursors's and subDBs's for nested transactions.
• Fixed page leak in extra rare case the list of retired pages changed during update GC on transaction commit.
• Fixed assertions to avoid false-positive UB detection by CLANG/LLVM (#153).
• Fixed MDBX_TXN_FULL and regressive MDBX_KEYEXIST during large transaction commit with MDBX_LIFORECLAIM (#123).
• Fixed auto-recovery (weak->steady with the same boot-id) when Database size at last weak checkpoint is large than at last steady checkpoint.
• Fixed operation on systems with unusual small/large page size, including PowerPC (#157).

TODO:

• Engage new terminology (#137).
• Resolve few TODOs (#124, #127, #115).
• Finalize C++ API.
• Packages for ROSA Linux, ALT Linux, Fedora/RHEL, Debian/Ubuntu.

SHA256 checksums

d12bc7189b746beaa85514fcd1fcf26b957bb8feadb11662a0e20c4e79410d3f  libmdbx-amalgamated-0.9.3.tar.gz
f8249209d31f61750c470f042ecb24e5465424a801221473a0eca49b6af69f66  libmdbx-amalgamated-0_9_3.zip
2bae1558c37bd787df40d16c021bd074111aabde5a333b23ea46ba0c2f7fd2ce  v0.9.3.tar.gz
876b820bd7519b7f8942e9fe5ddc88edd5c2bb002e383667aac953de408dfa2b  v0.9.3.zip

Release v0.9.2 (obsolete)

Acknowledgements:

• Jens Alfke (Mobile Architect at Couchbase) for NimDBX.
• Clément Renault (CTO at MeiliSearch) for mdbx-rs.
• Alex Sharov (Go-Lang Teach Lead at TurboGeth/Ethereum) for an extreme test cases and bug reporting.
• George Hazan (CTO at Miranda NG) for bug reporting.
• Positive Technologies for funding and The Standoff.

Added features:

• Provided package for buildroot.
• Binding for Nim is available now by Jens Alfke.
• Added mdbx_env_delete() for deletion an environment files in a proper and multiprocess-safe way.
• Added mdbx_txn_commit_ex() with collecting latency information.
• Fast completion pure nested transactions.
• Added LIBMDBX_INLINE_API macro and inline versions of some API functions.
• Added mdbx_cursor_copy() function.
• Extended tests for checking cursor tracking.
• Added MDBX_SET_LOWERBOUND operation for mdbx_cursor_get().

Fixes:

• Fixed missing installation of mdbx.h++.
• Fixed use of obsolete __noreturn.
• Fixed use of yield instruction on ARM if unsupported.
• Added pthread workaround for buggy toolchain/cmake/buildroot.
• Fixed use of pthread_yield() for non-GLIBC.
• Fixed use of RegGetValueA() on Windows 2000/XP.
• Fixed use of GetTickCount64() on Windows 2000/XP.
• Fixed opening DB on a network shares (in the exclusive mode).
• Fixed copy&paste typos.
• Fixed minor false-positive GCC warning.
• Added workaround for broken DEFINE_ENUM_FLAG_OPERATORS from Windows SDK.
• Fixed cursor state after multimap/dupsort repeated deletes (#121).
• Added SIGPIPE suppression for internal thread during mdbx_env_copy().
• Fixed extra-rare MDBX_KEY_EXIST error during mdbx_commit() (#131).
• Fixed spilled pages checking (#126).
• Fixed mdbx_load for 'plain text' and without -s name cases (#136).
• Fixed save/restore/commit of cursors for nested transactions.
• Fixed cursors state in rare/special cases (move next beyond end-of-data, after deletion and so on).
• Added workaround for MSVC 19.28 (Visual Studio 16.8) (but may still hang during compilation).
• Fixed paranoidal Clang C++ UB for bitwise operations with flags defined by enums.
• Fixed large pages checking (for compatibility and to avoid false-positive errors from mdbx_chk).
• Added workaround for Wine (miranda-ng/miranda-ng#1209).
• Fixed ERROR_NOT_SUPPORTED while opening DB by UNC pathnames (miranda-ng/miranda-ng#2627).
• Added handling EXCEPTION_POSSIBLE_DEADLOCK condition for Windows.

SHA256 checksums

c35cc53d66d74ebfc86e39441ba26276541ac7892bf91dba1e70c83665a02767  libmdbx-amalgamated-0.9.2.tar.gz
82523330f701939325ce96becace35ec739d30f8e98ec776c4d50bc8745297a8  libmdbx-amalgamated-0_9_2.zip
a98382d85a06a551393a89152a50c53fd45abf6bf9f5e01e594bbd799c1352c7  v0.9.2.tar.gz
099b31eef060bd41c35221ba2c805571d173b936075da9a97fcaf4801c8c2ecf  v0.9.2.zip

Release v0.9.1 (obsolete)

Added features:

• Preliminary C++ API with support for C++17 polymorphic allocators.
• Online C++ API reference by Doxygen.
• Quick reference for Insert/Update/Delete operations.
• Explicit MDBX_SYNC_DURABLE to sync modes for API clarity.
• Explicit MDBX_ALLDUPS and MDBX_UPSERT for API clarity.
• Support for read transactions preparation (MDBX_TXN_RDONLY_PREPARE flag).
• Support for cursor preparation/(pre)allocation and reusing (mdbx_cursor_create() and mdbx_cursor_bind() functions).
• Support for checking database using specified meta-page (see mdbx_chk -h).
• Support for turn to the specific meta-page after checking (see mdbx_chk -h).
• Support for explicit reader threads (de)registration.
• The mdbx_txn_break() function to explicitly mark a transaction as broken.
• Improved handling of corrupted databases by mdbx_chk utility and mdbx_walk_tree() function.
• Improved DB corruption detection by checking parent-page-txnid.
• Improved opening large DB (> 4Gb) from 32-bit code.
• Provided pure-function and const-function attributes to C API.
• Support for user-settable context for transactions & cursors.
• Revised API and documentation related to Handle-Slow-Readers callback feature.

Deprecated functions and flags:

• For clarity and API simplification the MDBX_MAPASYNC flag is deprecated.
  Just use MDBX_SAFE_NOSYNC or MDBX_UTTERLY_NOSYNC instead of it.
• MDBX_oom_func, mdbx_env_set_oomfunc() and mdbx_env_get_oomfunc()
  replaced with MDBX_hsr_func, mdbx_env_get_hsr and mdbx_env_get_hsr().

Fixes:

• Fix mdbx_strerror() for MDBX_BUSY error (no error description is returned).
• Fix update internal meta-geo information in read-only mode (EACCESS or EBADFD error).
• Fix mdbx_page_get() null-defer when DB corrupted (crash by SIGSEGV).
• Fix mdbx_env_open() for re-opening after non-fatal errors (mdbx_chk unexpected failures).
• Workaround for MSVC 19.27 static_assert() bug.
• Doxygen descriptions and refinement.
• Update Valgrind's suppressions.
• Workaround to avoid infinite loop of 'nested' testcase on MIPS under QEMU.
• Fix a lot of typos & spelling (Thanks to Josh Soref for PR).
• Fix getopt() messages for Windows (Thanks to Andrey Sporaw for reporting).
• Fix MSVC compiler version requirements (Thanks to Andrey Sporaw for reporting).
• Workarounds for QEMU's bugs to run tests for cross-builded library under QEMU.
• Now C++ compiler optional for building by CMake.

TODO for next version(s):

• Rework/speedup the implementation of the dirty page list (lazy compactification, lazy sorting via merge).
• Finalize C++ API (few typos and trivia bugs are likely for now).
• Packages for ROSA Linux, ALT Linux, Fedora/RHEL, Debian/Ubuntu.

---

SHA256 checksums

c7fb24381eb4d92f2e2edc17e577cb721269683c816c6cca307c58f6f346e786  libmdbx-amalgamated-0.9.1.tar.gz
1938a445a1e1375e1f142f10531a2e31a0525298a39d8d067cd9e145521d97b5  libmdbx-amalgamated-0_9_1.zip
ef34f267f17720b79f8471b63ef3c4d94e110d22ad123ce0b691c1c7cfb077cc  v0.9.1.tar.gz
7829738d1e76dc7873e8a3bb11a05f6b999ecae6102ecd03cc9010eee2bd7c4e  v0.9.1.zip

Release v0.8.2

• Added support multi-opening the same DB in a process with SysV locking (BSD).
• Fixed warnings & minors for LCC compiler (E2K).
• Enabled to simultaneously open the same database from processes with and without the MDBX_WRITEMAP option.
• Added key-to-value, mdbx_get_keycmp() and mdbx_get_datacmp() functions (helpful to avoid using custom comparators).
• Added ENABLE_UBSAN CMake option to enabling the UndefinedBehaviorSanitizer from GCC/CLANG.
• Workaround for CLANG bug https://bugs.llvm.org/show_bug.cgi?id=43275.
• Returning MDBX_CORRUPTED in case all meta-pages are weak and no other error.
• Refined mode bits while auto-creating LCK-file.
• Avoids unnecessary database file re-mapping in case geometry changed by another process(es). From the user's point of view, the MDBX_UNABLE_EXTEND_MAPSIZE error will now be returned less frequently and only when using the DB in the current process really requires it to be reopened.
• Remapping on-the-fly and of the database file was implemented. Now remapping with a change of address is performed automatically if there are no dependent readers in the current process.

Release 0.8.1

• Minor change versioning. The last number in version now mean the number of commits since last release/tag.
• Provide ChangeLog file.
• Fix for using libmdbx as C-only sub-project with CMake.
• Fix mdbx_env_set_geometry() for case it called from opened environment outside of write transaction.
• Add support for huge transactions and MDBX_HUGE_TRANSACTIONS build-option (default OFF).
• Refine LTO (link time optimization) for clang.
• Force enabling exceptions handling for MSVC (/EHsc option).

Release 0.8.0

• Support for Android/Bionic.
• Support for iOS.
• Auto-handling MDBX_NOSUBDIR while opening for any exists database.
• Engage github-actions to make release-assets.
• Clarify API description.
• Extended keygen-cases in stochastic test.
• Fix fetching of first/lower key from LEAF2-page during page merge.
• Fix missing comma in array of error messages.
• Fix div-by-zero while copy-with-compaction for non-resizeable environment.
• Fixes & enhancements for custom-comparators.
• Fix MDBX_AVOID_CRT option and missing ntdll.def.
• Fix mdbx_env_close() to work correctly called concurrently from several threads.
• Fix null-deref in an ASAN-enabled builds while opening environment with error and/or read-only.
• Fix AddressSanitizer errors after closing environment.
• Fix/workaround to avoid GCC 10.x pedantic warnings.
• Fix using ENODATA for FreeBSD.
• Avoid invalidation of DBI-handle(s) when it just closing.
• Avoid using pwritev() for single-writes (up to 10% speedup for some kernels & scenarios).
• Avoiding MDBX_UTTERLY_NOSYNC as result of flags merge.
• Add mdbx_dbi_dupsort_depthmask() function.
• Add MDBX_CP_FORCE_RESIZEABLE option.
• Add deprecated MDBX_MAP_RESIZED for compatibility.
• Add MDBX_BUILD_TOOLS option.
• Refine mdbx_dbi_open_ex() to safe concurrently opening the same handle from difference threads.
• Truncate clk-file during environment closing. So zero-length lck file indicates that environment was closed properly.
• Refine support for huge transactions with small sizes of database page.
• Extends dump/load to support all MDBX attributes.
• Avoid upsertion the same key-value data, fix related assertions.
• Rework min/max length checking for keys & values.
• Checking the order of keys on all pages during checking.
• Support CFLAGS_EXTRA make-option for convenience.
• Preserve last txnid while copy with compactification.
• Auto-reset running transaction in mdbx_txn_renew().
• Automatically abort errored transaction in mdbx_txn_commit().
• Auto-choose pagesize for a large databases.
• Rearrange source files, rework build, options-support by CMake.
• Crutch for WSL1 (Windows subsystem for Linux).
• Refine install/uninstall targets.
• Refine LTO (link time optimization) for clang.
• Support for Valgrind 3.14 and later.
• Add check-analyzer check-ubsan check-asan check-leak targets to Makefile.
• Minor fix/workaround to avoid UBSAN traps for memcpy(ptr, NULL, 0).
• Avoid some GCC-analyzer false-positive warnings.

Release 0.7.0

• Workarounds for Wine (Windows compatibility layer for Linux).
• MDBX_MAP_RESIZED renamed to MDBX_UNABLE_EXTEND_MAPSIZE.
• Clarify API description, fix typos.
• Speedup runtime checks in debug/checked builds.
• Added checking for read/write transactions overlapping for the same thread, added MDBX_TXN_OVERLAPPING error and MDBX_DBG_LEGACY_OVERLAP option.
• Added mdbx_key_from_jsonInteger(), mdbx_key_from_double(), mdbx_key_from_float(), mdbx_key_from_int64() and mdbx_key_from_int32() functions. See mdbx.h for description.
• Fix compatibility (use zero for invalid DBI).
• Refine/clarify error messages.
• Avoids extra error messages "bad txn" from mdbx_chk when DB is corrupted.

Release 0.6.0

• Fix mdbx_load utility for custom comparators.
• Fix checks related to MDBX_APPEND flag inside mdbx_cursor_put().
• Refine/fix dbi_bind() internals.
• Refine/fix handling STATUS_CONFLICTING_ADDRESSES.
• Rework MDBX_DBG_DUMP option to avoid disk I/O performance degradation.
• Add built-in help to test tool.
• Fix mdbx_env_set_geometry() for large page size.
• Fix env_set_geometry() for large pagesize.
• Clarify API description & comments, fix typos.