FASTER v2.0.0-preview.1.0

This is a preview release for FASTER v2, based on the v2 branch. Get more details on this preview at #563

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• cc2505b revert windows-2022 in yml
• 170a589 Update azure-pipelines.yml
• bfa2b5f Update azure-pipelines.yml
• 23895e6 more updates
• 2918ed4 Merge branch 'v2' of https://github.com/microsoft/FASTER into v2
• 3d22f3a Update nuspecs
• 34a7576 [C#] Add Status.Record (#659)
• 69f8eda Status naming changes and UpdateInfo structure split for v2 preview (#658)
• 85b174c merge from master
• 3698b24 Wire status into remote v2 (#657)

See More

• f0f826a Merge branch 'master' into v2
• daaccca [C#] Change IFunctions 'address' parameter to UpdateInfo or ReadInfo (#652)
• 5fc8c9d [C#] [WIP] Status return code v2 (#638)
• c63068c do not remove ioPendingRequests in RMWAsync if there was no disk request (#653)
• 6e93921 Update FasterServerBase.cs
• 637ed51 Fix dispose loop
• 0b48e00 fix breaking tests
• 0b204c6 add to FasterLog SpanByte API
• 9975276 [C#] Recover returns version we recovered to (#648)
• f2c025d Correct header offset in FasterLog new API
• 15dd260 Merge branch 'master' into v2
• ba3e38e [C#] IEntry interface for FasterLog (#639)
• 5181a2c nit
• 2687875 [C#] Support int session ID for FasterKV (#641)
• 3df532d [C#] Remove StrictCPR (#636)
• 5f260bf [C#] Various Fixes (#635)
• 54a8581 [C#] Add WriteReason parameter to SingleWriter (#630)
• a92adf0 fix semantic merge conflict in MemoryPageScanIterator (#632)
• de198a0 Merge branch 'master' into v2
• c80f20b [C#] Lockable Unsafe Context (LUC) in FasterKV v2 (WIP) (#605)
• 189da04 Merge branch 'master' into v2
• 55a637c Merge branch 'master' into v2
• 3c15854 Speed up testcases
• b2fe572 Fix logic for directory delete timeouts.
• a6c33b3 [C#] Updated docs for FasterLog v2 (#624)
• 9ebad99 [C#] FasterLog v2 iteration fix (#623)
• 0b1bb63 Maybe fix SVS issue with atomic reads (#622)
• c5b3b7b [C#] FasterLog v2 Add ability to explicitly terminate a log (#620)
• 7cb9f84 Merge branch 'master' into v2
• f7c513b Merge branch 'master' into v2
• c4e3718 Add extensions to enqueue SpanByte to FasterLog, and unsafely iterate without memory copy. (#621)
• b25c4dc [C#] FasterLog V2 Device error handling (#612)
• 8d0c9c9 [C#] Improved FasterKV and FasterLog settings API for v2 (#618)
• ce0f348 [C#] Updating dependent package versions in v2 (#616)
• 90ec7cc [C#] Fixing warnings (#615)
• 4cf3aef Avoid double init of FasterLog
• b6008df [C#] Remove CheckpointType from CheckpointSettings (v2) (#614)
• ff41b9f Merge from master
• 3feedf9 [C#] minor cleanup of fasterlog v2 (#611)
• 014ffb9 Merge branch 'master' into v2
• ef5be45 Code cleanup
• 0cfe372 Cleanup and remove dead code + reuse base provider.
• 640b3f7 Added TentativeHeadAddress - we first shift this, and when all threads agree, we can do some pre-closing work such as eviction. Then we can shift the actual HeadAddress, closing pages when all threads agree on this. (#608)
• 1464025 Create .dockerignore
• 31c49bc Merged PR 59053: Network Stack Refactoring into FASTER
• ed8a1c9 update for code consistency
• ce868bb Merge branch 'master' into v2
• a185839 [C#] Fix v2 CommitPolicy Warnings (#607)
• d64e02e Merge branch 'master' into v2
• 4b7d8c2 [C#] V2 Custom Commit Strategy (#599)
• 925fd91 updates from master.
• 283fad4 Merge branch 'master' into v2
• fe10e51 [C#] Log compaction v2 (#598)
• 5c0ad00 [C#] FasterLog v2: Fix FasterLog missed final commit (#597)
• 84d2724 [C#] v2 pending flush list (#596)
• c7e584c fix alignment of device commit manager
• fcd99ce Merge branch 'master' into v2
• 92a8202 Fix build after merge
• b00969c Merge branch 'master' into v2
• 608b934 [C#] FasterLog v2 - misc changes, removed OverWrite commits (#593)
• 2bf7fe7 Remove legacy local log commit manager
• 6ae6aaf Merge from master
• 6e6cab7 [C#] FasterLog Commit Optimization (v2) (#587)
• b1289d1 [C#] Checkpoint, Recovery, RecordInfo updates (#588)
• b6f2881 Merge branch 'master' into v2
• dea10a2 Add Output parameter to Upsert (#574)
• 5b1131b Merge remote-tracking branch 'origin/master' into v2
• 6c6b2d2 Remove FASTERLegacy (#581)
• 0c7ff6b [C#] RecordInfo v2 (#577)
• 2287004 Merge branch 'master' into v2
• 4465c71 [C#] Merge IAdvancedFunctions into IFunctions (#565)
• a319455 Merge branch 'master' into v2
• f04d924 Merge branch 'master' into v2
• 7c3071a misc
• 10744aa minor
• 03af7ca minor adds
• ffe14a0 Merge from master
• 19eb229 Merge branch 'master' into v2
• a80b077 [C#] Added PostCopyUpdater to IAdvancedFunctions (#561)
• 2e93d9b [C#] Record-expiration support in RMW (#545)
• 0a32f1b various changes from indexing work (#562)

This list of changes was auto generated.

FASTER v1.9.13

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• eea90e6 [C#] bug-fix for publish in websockets (#649)
• 2509672 [C#] Fix RecoverAsync divergence from Recover

This list of changes was auto generated.

FASTER v1.9.12

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• aa44088 Use epochs during CompleteCheckpoint calls to ThreadStateMachine (#644)
• a818e77 Update to 1.9.11

This list of changes was auto generated.

FASTER v1.9.11

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• f8cc6ea [C#] Throw exception on page read/flush error during restore (#642)
• 728c5b6 Fix log addresses returned by SubscribeEvictions (#631)
• 85907e6 [C++] File: Explicitly delete copy ctor and copy-assign (#625)
• c8ca7d6 Bugfix on cleaning hash index buckets (#629)
• 10cdceb [C#] Delete file handles that may not be cached in memory (#627)
• 2f26743 Update to 1.9.10

This list of changes was auto generated.

FASTER v1.9.10

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 104e844 Fix object serialization boundary condition (#619)
• c0409e1 Fix NullRef in RMWAsync in low-memory conditions (found by Netherite) by removing 'readonly' from UpdateAsyncInternal.asyncOperation. Also fix call sequence to complete pending I/O, make CompletionEvent implement IDisposable, and fix the *ClientSession.CompletePendingWithOutput calls (#613)
• 29c8bc6 Update home.md

This list of changes was auto generated.

FASTER v1.9.9

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 92ae4af [C#] Add static option to unpin objects when returning to SectorAlignedMemoryPool (#606)
• 3f0a5b8 Update LogShiftTailStressTest.cs

This list of changes was auto generated.

FASTER v1.9.8

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 03ff6ed [C#] Fix memory leak with bulk flushes during checkpoints. (#604)
• fccfbcf Disable checksum verification in FasterLogIterator.CompleteUntilRecordAt() (#602) [ #601 ]

This list of changes was auto generated.

FASTER v1.9.7

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 4b45c91 Update CMakeLists.txt.in
• 35c4aab [C#] Provider API refactor (#595)
• ef0775a reduce mem size to prevent out of mem error on test machine (#592)
• 1c2a26d [C#] Fix error behavior under frequent commit situations (#590)
• 8d422de Update SerializedFasterWrapper.cs
• 64ca285 Update 51-remote-pubsub.md
• bc365a2 Update navigation.yml
• d61be75 Create 51-remote-pubsub.md
• 1d98667 Fix pub-sub (#580)
• e11b6fb Remove ReusableObject in FASTER remote (#573)

See More

• 28f6034 Update VarLenServer.cs
• b9f4fbe Make provider extensible. (#575)
• 59b316e Fix pub sub bug from recent PR
• a237e4a Update 23-fasterkv-tuning.md
• 1170be7 Update 43-fasterlog-tuning.md
• 2335cf4 Update 43-fasterlog-tuning.md
• d8bee4b [C#] Fixes to non-kv PubSub (#568)
• 28f5494 [C#] Misc remote cleanup (#569)
• e0e148f [C++] Linux liburing based I/O handler. (#387)
• 9fef961 [C#] FasterLogIterator.CompleteUntilRecordAtAsync() (#558)
• 8207000 [C#] Misc warning and code cleanup (#560)
• 7fc497b Pubsub-updates (#559)
• 7eb5df9 Update home.md

This list of changes was auto generated.

FASTER v1.9.6

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 2bbff2f [C#] Stabilize tests (#551)
• 04521f1 Fix typo in 25-fasterkv-recovery.md. (#555)
• e987115 Fix bug in AcquireLatchX (#550)
• bbe8851 fix testcase
• dc674cf [C#] Client-server cleanup (#553)
• 6e13ce3 [C#] Support remote pub-sub and websockets (#543) [ #514, #499, #511, #531, #542, #530, #547 ]
• 0ae0568 MemoryPool-based override for FasterLog.ReadAsync() (#549)
• c93b769 [C#] minor update to spanbyte
• 54d4c83 [C#] Log disposal (#548)
• 3711ef9 Update 80-build-and-test.md

See More

• daa24d1 [C#] Fixing another testcase
• 251b868 [C#] More fixes to testcases
• 6b4c728 Merge branch 'master' of https://github.com/microsoft/FASTER
• 94435dc [C#] Fix dispose in tests, remove console writes from LMD.
• e2b88ac SpanByte improvements (#537)
• 0baf644 [C#] Checkpoint & Versioning Utilities (#535)
• 3a77bc0 [C#] Faster Extensions for DPR Integration (#529)
• bbfd503 [C++] Rmw bugfix (#533)
• 9fb08a2 Pass client serial numbers to remote FASTER instance (#528)
• f29432b [C#] Slight modification in Guid allocator within DeviceLogCommitCheckpointManager (#532)
• 3121b5e Add ReadFlags.MinAddress (#527)
• 2a2bf2f [C#] Fix data races between copy to tail and concurrent upserts (#501)
• 5022cd6 [C#] Multiple device tests (#523) [ #142980, #143432, #143433, #143131, #136259 ]
• a2baf1c Fix failed assertion: add missing merger (#522)
• c57595d minor
• a304574 minor updates.
• 57b17d7 [C#] Support FasterLog commit dir specification in settings (#519)
• 0504248 [C#] SpanByteFasterKVProvider (#520)
• 1b319a5 [C#] Add Output to RMW (#515)
• 0c23a47 [C#] Recovery testcase fixing (#513)
• 6766012 Add a link to the DPR branch (#506)
• ff681b9 [C#] Remote provider enhancements (#503)
• ef016eb [C#] Add infrastructure to support more wire protocols (#496)
• 8c0c6e1 [C#] Update to C#9 (#486)
• b028491 Update 40-fasterlog-basics.md
• bc44597 LogCommitFile is obsolete - commit file naming is handled automatically by default commit manager. (#494)
• 09445f3 add FASTER.benchmark cmdline options: --sd --sm --noaff --chkptms --dumpdist (#485)
• d0a84f6 Update home.md

This list of changes was auto generated.

FASTER v1.9.5

Visit https://microsoft.github.io/FASTER/docs/roadmap/ for release features and project roadmap. Get NuGet binaries at:

• Core: https://www.nuget.org/packages/Microsoft.FASTER.Core
• IDevice for Azure Storage: https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
• Remote Client: https://www.nuget.org/packages/Microsoft.FASTER.Client
• Remote Server: https://www.nuget.org/packages/Microsoft.FASTER.Server

More information at:

• https://microsoft.github.io/FASTER
• https://github.com/microsoft/FASTER
• https://aka.ms/FASTER

Changes:

• 32b3f6e [C++] Fix epoch scan range (#484)
• 1f8b5b0 [C#] Fix read cache boundary condition bug (#483)
• e42fd81 Update home.md

This list of changes was auto generated.