Garnet PREVIEW v2.0.1-beta.4

Get NuGet binaries at:

• Library: https://www.nuget.org/packages/Microsoft.Garnet
• Tool: https://www.nuget.org/packages/garnet-server

More information at:

• https://microsoft.github.io/garnet
• https://github.com/microsoft/garnet
• https://www.microsoft.com/en-us/research/project/garnet

Changes:

• a81d2f1 Bump version to 2.0.1-beta.4 (#1885)
• 94d6a1f Native storage device: improved error handling (#1884)
• 39fd9d3 [BFTree] Add RangeIndex cluster migration (#1731)
• 1a3d3ee Impose 512M maximum on RESP elements in RespReadUtils (#1883)
• 096731e Fix VectorElementKey.IsPinned and drop_index calls while Vector Set in use (#1871)
• f031f94 Helm chart improvements (#1802)
• f9214f6 Small corner case handling in storage (#1879)
• 275f134 Bump rand 0.9.2 → 0.9.3 in bftree-garnet to fix GHSA-cq8v-f236-94qc (#1878)
• 041d4b1 Bump launch-editor from 2.13.2 to 2.14.1 in /website (#1877)
• 75b8bec Bump @babel/core from 7.29.0 to 7.29.7 in /website (#1876)

See More

• 7b914ef Fix MLPA tail increment; add cmdline options to Garnet BDN (#1872)
• 73ce769 Bump joi from 17.13.3 to 17.13.4 in /website (#1873)
• 7f9f6a3 Tedhar/nightly azurite (#1869)
• 6520b93 Clean TearDown failure behavior (#1870)
• 5fe6e37 Min 4k TKV log page size; revise device sector size setting; DefaultInitialIORecordSize overridable by operation, session, or store (#1853)
• 9a10cf5 More IO optimizations (#1867)
• 358ced7 Simplified latch-free read cache design with eviction improvements (#1860) [ #2 ]
• 2856e79 Add per-name ACL support for custom (extension) commands (#1822)
• ee8efba Add Roaring Bitmap support (issue #1270) (#1741) [ #1820 ]
• 5ec4ced Bump shell-quote from 1.8.3 to 1.8.4 in /website (#1865)
• 0d19ffc Bump version to 2.0.1-beta.3 (#1866)
• 20fec5a Cache DateTime.UtcNow in AAD authenticator hot path (#1855) [ #1859 ]
• c586d51 More IO optimization (#1854)
• ade916b Bugfix: MurmurHash3: 1) wrong suffixLen; 2) should cast to ulong before shift (#1864)
• c0a07db Fix large string handling in CLUSTER|NODES and CLUSTER|SHARDS (#1858) [ #1781 ]
• c5ec666 Add AAD as a first-class OperationParams variant in BDN benchmarks (#1859)
• e410f85 Fix VSIM COUNT when FILTER is set (#1856)
• e5ae3e8 Bump version to 2.0.1-beta.2 (#1850)
• 1bee34e Fix MultiListBlockingPopTest flake on Windows CI (#1851)
• 7ba5cab Test infrastructure fixes and revise InitialIOSize (#1849)
• f2b070a Fix Vector Set Creation Live Lock (#1846)
• 40cea76 Fix ClusterRangeIndexCheckpointSyncWithEviction test: force flush.bftree generation (#1848)
• b315b32 Fix Vector Set Index key corruption (#1845)
• cdc79f7 Bump version to 2.0.1-beta.1 (#1847)
• 3fa30c1 Updates to RecordDataHeader (#1840)
• 91371eb Optimize IO paths in KV (#1837)
• c171934 Fix AOF page/memory size defaults and validation (#1811) (#1838) [ #1749 ]
• 3f627aa Bump dotnet-sdk from 10.0.203 to 10.0.300 in the dotnet-deps group (#1843)
• 19d3962 Bump the website-deps group in /website with 3 updates (#1842)
• c53d7bc Add Vector Sets (Preview) command documentation (#1839)
• e7025a6 docs: Add missing cluster announce/endpoint options to configuration page (#1835) [ #1824 ]
• 89247a6 audit all mutations of TOutput variables, fixing up the set of cases where retries in Tsavorites InitialUpdater would cause incorrect responses (#1836)
• bf4177f Add Support for RangeIndex Diskbased Replication (#1807)
• 97b52bc [Tsavorite] Add native Linux storage backend, harden NativeStorageDevice, refresh storage benchmarks (#1831) [ #4 ]
• b1077c2 Remove EnableFastCommit option (always enabled) (#1829)
• bba9353 Fix missing cluster slot verification for CustomRawStringCmd and CustomObjCmd (#1827) [ #712 ]
• 180f4e6 Set IsReplicating on APPENDLOG init handshake to prevent idle resync loop (#1828)
• 4559e89 Use bulk string response for VGETATTR (#1830)
• d16a93f AOF: Use log addresses for single-physical-log mode and add transaction acquire-barrier (#1803)
• 4d85ab5 Add KV.benchmark: lean Tsavorite KV throughput benchmark (#1823)
• a658d2a Add NotFound callback to CustomRawStringFunctions and CustomObjectFunctions (#1820)
• 42051c1 Bump DiskANN to 1.0.27, bump version to 2.0.0-beta.6 (#1813)
• 808e438 Cleanup VectorSet TODOs (#1810)
• fdd9da7 Update version to 2.0.0-beta.5 (#1809)
• 56e862c Bump webpack-dev-server from 5.2.3 to 5.2.4 in /website (#1808)
• a847079 Rework Vector Set deletion and eviction (#1800)
• 29fad5a Improvements to test workflow (#1804)
• 4cbaa99 Use Stopwatch for LockableContext acquire timeouts (#1772)
• d3677cf Adjust v2 defaults (#1805)
• 5e1c098 Refactor disk-based replication checkpoint shipping and safe hlog segment truncation (#1773)
• 5c78314 Port diskless replication dedup fix to new AofSyncDriver architecture (#1794)
• 8bdea90 Update lifecycle for compaction, truncate, improve bftree file management (#1780) [ microsoft/bf-tree#19, #2, #7, #9, #10, #12, #14 ]
• d6d4888 Fix Allure wiring: remove duplicate attributes and fix CI check for transitive dependencies (#1784)
• 396dba7 Make ValueOverflowThreshold a memory-size string; enforce 512B PageSize minimum (#1799)
• 28ba65e Hold per-DB checkpoint locks until all general-BGSAVE per-DB checkpoints complete (#1796) [ #1767 ]
• 4cc403f Honor configured AOF segment size in TsavoriteLogSettings (#1798)
• a9aa8b7 Avoid tempKv-driven scan iteration in Garnet callers (#1797) [ #482 ]
• 7758c68 Bump version to 2.0.0-beta.4 and scope external-release pipeline to main only (#1793)
• a3e692d Bump rand from 0.8.5 to 0.8.6 in /libs/native/bftree-garnet (#1790)
• 448ea6e Add chunked header indicator to AofHeader (#1782)
• 7b9146e Bump fast-uri from 3.1.0 to 3.1.2 in /website (#1783)
• cdef413 Bump mermaid from 11.14.0 to 11.15.0 in /website (#1789)
• cbd90d4 Bump @babel/plugin-transform-modules-systemjs in /website (#1785)
• 70b8da6 Merge v2 (dev) into main: dev tree wins on all conflicts
• 2bf194e [DEV] Verbatim String Fixes (#1777)
• c927b02 fix: use Stopwatch for INFO durations (#1771) (#1779)
• b0eea3d Add version byte to ClusterConfig and ReplicationHistory serialization (#1778)
• 6bc8124 Fix MultiDatabaseSaveInProgressTest (#1767)
• a47dc58 [Tsavorite] Replace SafeTailAddress background refresh with per-thread inflight publish protocol (#1720)
• 60fe54d Pause VectorManager cleanup before storeWrapper.Reset() + Tsavorite Initialize() epoch-gate (#1775) [ #1765 ]
• 14f01b8 Fix LockSublogs mutual exclusion and GC hole in AofAddress.Span (#1774)
• 33e0303 Improve RecordSizeInfo performance; remove obsolete files (#1769)
• ddd711b Tighten InstanceIndexBuffer GC-safety (#1766)
• d1a9289 Fix two rare CI failures: ListPushPopStressTest host crash and VectorManager cleanup vs Reset() AVE (#1765)
• eaa5734 Reduce AofAddress struct copy overhead on hot paths (#1759)
• 950d976 [DEV] Rework SimpleSetupCluster in cluster tests, and longer timeouts for select tests (#1763)
• 3a325e7 Cherry-pick recent Dependabot updates from main to dev (#1760, #1761) (#1764)
• 4da1ef3 Remove incremental snapshot feature (#1747)
• 9323e37 Clean up BFTree data files on RangeIndex deletion (#1738)
• f77a391 Fix FlagRecovered never cleared on RangeIndex stub after restore (#1746)
• 509f216 Fix BITOP overflow-pointer + epoch tracking, HLL bounds check, sorted-set Memory leaks (#1751)
• d0a93d7 Fix #1749: leaked ephemeral X-lock when AOF Enqueue throws (#1754)
• f06111c Remove unused sizeInfo and other performance tweaks (#1745)
• f174025 [DEV] Block on TLS auth in NetworkHandler (#1750)
• 1c98e5f [dev] Remove sync-over-async where possible, consolidate blocking into helpers, add analyzers (#1730)
• 522b89b Fix TLS blocking issue when buffer is doubled [dev] (#1743)
• 30c6dee Support for Parallel Replication (#1556) [ #1633 ]
• 63582f3 Simplify etags [dev] (#1739)
• 2997b98 Add INFO COMMANDSTATS tracking with per-command success rates (#1728)
• c4df8d0 Bump postcss from 8.5.9 to 8.5.10 in /website (#1736) (#1737)
• e4a2bcd Migrate: Improved Error Handling on Failed SetSlotRange (#1653) (#1735)
• 17bddec Cherry-pick dependency updates from main to dev (#1734) [ #1659, #1705, #1733 ]
• 35d3ee9 Fix unit test for RI (#1732)
• 1de833e Eliminate synthetic RMW for RI.SET/RI.DEL AOF logging (#1725)
• f5d7990 Throw exception when AofSizeLimit is set with AOF disabled (#1721)
• 9a7434f [dev] Wait for Vector Set replay in tests (#1723)
• 6e33956 Add Range Index data type based on Bf-Tree (single instance) (#1613)
• 949e526 Drain deferred DoReadPage callbacks before disposing scan iterator (#1719)
• 045714e Targeted test logging API, BDN cluster improvements, and client/libs cleanup (#1707)
• b86f828 Fix deferred DoReadPage drain callback accessing disposed ScanIteratorBase (#1718)
• 19e7f82 Rewrite ListPushPopStressTest to use dedicated threads (#1717)
• 5036d8b Fix use-after-free in GetAllocationForRetry when page is evicted (#1716)
• 0fb650f Internalize heap-size tracking into Tsavorite (#1712) [ #1695 ]
• 0740ff9 Fix three broken/flaky Tsavorite and Garnet tests (#1711)
• 8113f56 Fix native linux device [dev] (#1710)
• 1737c8a expose VectorSetReplayTaskCount parameter (#1703)
• bd974b5 [DEV] Vector Set Migration Reliability Fixes (#1706)
• 0b5490f Improve Network Resource Cleanup on TLS Disconnect/Fail Paths (#1694) (#1699)
• ce9bd6a IRecordTriggers: per-record lifecycle callbacks for dispose, flush, evict, and disk read (#1695)
• 7b7d6b1 [VectorSets] Update diskann-garnet and wire up metric types (#1688) (#1692)
• 41fc07c Fixes around Vector Set migrations (#1687)
• 952de49 Bugfix: negative return value from SerializeTo/DeserializeFrom (#1690)
• 4520781 Add GarnetRecordDisposer with per-record dispose on page eviction (#1689)
• 078a03e Fix open Dependabot alerts in website dependencies (#1682)
• d29c926 Add vazois to CodeOwners [dev] (#1686)
• 2da89de Fix AOF persistence and WATCH for collection-emptying RMW ops [dev] (#1677) [ #1675 ]
• f0cf816 Move EnableVectorSetPreview option over from main (#1680)
• 1dc10ec Fix snapshot flush and checkpoint exception propagation [dev] (#1679)
• 27e700b [DEV] Improve Failover Restore / Replication Handling (#1674)
• 9793a56 Pull Vector Set implementation into dev (#1652)
• 1cb0a98 [Storage] Fix use-after-free in ProcessResp*Output; use ScratchBufferAllocator for API-returned PinnedSpanByte (#1672)
• e4d3879 Fix heap size double-subtraction causing server crash under low-memory object operations (#1663)
• 3dc3e60 Fix race in ScanIteratorBase.Dispose causing ObjectDisposedException (#1667)
• e8760eb Cherry Pick Commits from Main (#1664) [ #1641, #1645, #1643, #1644, #1642, #1646, #1612, #1649, #1651, #1648, #1657, #1650 ]
• 5b17387 Tedhar/dev fixes (#1662)
• ac72d34 Fix small issues with parse state (#1660)
• 086a064 Fix format on dev (#1661)
• 943bd93 Add LFBP Instrumentation, Server Shutdown Ordering, and Test TearDown Hardening (#1632)
• 44da71b [Docs] Add Copilot skill for implementing new built-in RESP commands (#1637)
• 00ceeb5 Refactor TransactionManager key tracking to use SessionParseState and ScratchBufferAllocator (#1638)
• 9a35733 Use simplified key specs in cluster slot verification (#1640)
• 16d1a6d Bumping beta version (#1627)
• 5ac26bb Cherry-picking latest commits from main into dev (#1624) [ #1584, #1591, #1585, #1583, #1600, #1601, #1592, #1593, #1595, #1599, #1604, #1608, #1614, #1610, #1602, #1389, #1603, #1617, #1621 ]
• c099d93 Update CacheSizeTracker and LogSizeTracker (#1567) [ #1605 ]
• 2eb5b69 [Docs] Add Copilot instructions and pr-finalize skill (#1579)
• 48c6ccf pseudo-cherry pick of ArgSliceVector fixes from 6ef5c5c ; can't do a straight cherry-pick because Namespaces aren't a thing in dev yet (#1594)
• 9ff1233 Cherry-Picking more commits from main into dev (#1581)
• a86c63d Cherry-Picking commits from main into dev (#1578) [ #1548, #1553, #1554, #1555, #1546, #1543, #1562, #1566, #1557, #1565 ]
• 1ffe37f Misc Cleanup & Refactor (#1576) [ #1554 ]
• d7ccc86 Changing main store output type to StringOutput (#1547)
• 7029d23 Merge 'main' to 'dev' (#1550) [ #1473, #1488, #1486, #1483, #1481, #1482, #1464, #1468, #1491, #1492, #1499, #1497, #1502, #1503, #1504, #1507, #1495, #1457, #1498, #1508, #1510, #1511, #1512, #1514, #1515, #1516, #1517, #1518, #1519, #1522, #1532, #1535, #1526, #1527, #1523, #1525, #1528, #1529, #1533, #1536, #1538, #1541, #1542 ]
• 8817463 Misc perf improvements on v2 (#1521)
• c79b33e updating prerelease version (#1501)
• cf387a2 Updating dev with latest main changes (#1500) [ #1473, #1488, #1486, #1483, #1481, #1482, #1464, #1468, #1491, #1492, #1499, #1497 ]
• 08fa597 Define Shared Global Aliases (#1489)
• 977e699 Merge main into dev (#1494) [ #1473, #1488, #1486, #1483, #1481, #1482, #1464, #1468, #1491 ]
• ef08d67 Convert remaining Tsavorite tests to V2 (#1490)
• 04c8fcf Set GitHub release to isPreRelease flag to true if dev branch (#1472)
• fcbed38 LogRecord and SpanByte changes (#1186) [ #1384 ]
• 935cf3f Merge remote-tracking branch 'origin/main' into dev
• 11b03bd merge 'main'
• f7f38ae Update dev from main (#1458) [ #1445, #1449, #1452, #1453, #1454, #1451, #1455 ]
• fd22a74 Merge remote-tracking branch 'origin/main' into dev
• dbae8bd Merge remote-tracking branch 'origin/main' into dev
• 5a500e9 Set up release pipeline to work with Dev branch as well as Main (#1419)

This list of changes was auto generated.