Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* [C#] Expand async session-free API sample in playground (#452) * added sample * cleaned up async stress * Fix memory leak + add serialized wrapper sample * added testcases for concurrency within session in async. * clean up LMD * YCSB improvements to test incr-snapshot (#454) * [C#] minor cleanup * [C#] remote update to latest IFunctions * Update 01-quick-start-guide.md * Update home.md * [C#] update docs * fix(docs): corrects typo in project documentation (#456) * Initial checkin of test suite for remote * updated configs. * validate incoming payload before resuming epoch. (#459) * [C#] Test suite for remote FASTER (#458) * Initial checkin of test suite for remote * updated configs. * fix sln * Update azure-pipelines.yml * Update azure-pipelines.yml * Update 50-remote-basics.md * Update 50-remote-basics.md * [C#] Remote tests disposal (#460) * Initial checkin of test suite for remote * updated configs. * fix sln * Update azure-pipelines.yml * Update azure-pipelines.yml * Ensure correct disposals of server and client. * rename testcase * Update 50-remote-basics.md * Update 50-remote-basics.md * Enable SourceLink integration (#457) * clean sln * update docs * update docs * [C#] update remote testcases to cover varlen * Update 96-slides-videos.md * [C#] Fix double dispose in CompletePendingWithOutputs (#465) * [C#] Fix double dispose in CompletePendingWithOutputs * Update MultiReadSpanByteKey.cs * Cleaned up testcase, merged with other SpanByte test. Co-authored-by: Tim Coleman <timothy.coleman@gmail.com> * [C#] [FasterLog] Create AsyncPool objects on demand (instead of prepopulating) (#455) * don't pre-create 120 read and 120 write file handles. * fix asyncpool semaphore sizing. allow control over LocalStorageNamedDeviceFactory's Device.ThrottleLimit * dispose off the semaphore in AsyncPool.Dispose() * minor fixes to AsyncPool. * Speed up async pool. * Fix ordering of GetOrAdd and wait. Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com> * [C#] Updated SpanByte sample with RMW for ASCII number sums (#462) * Updated SpanByte sample with RMW for ASCII number sums * Sample refactoring as class per sub-sample * Update 20-fasterkv-basics.md * Update 20-fasterkv-basics.md * Update 20-fasterkv-basics.md * Update home.md * [C#] update csproj * Update home.md * Fix typo (#468) * Update 25-fasterkv-recovery.md * Update 23-fasterkv-tuning.md * Update 23-fasterkv-tuning.md * Fix docs typo (#470) * [C#] Support reducing memory footprint of pages in log (#467) * [C#] Support reducing memory footprint of base hlog circular buffer. * Update 23-fasterkv-tuning.md * updates * cleanup * Add Log API to set page count with option to wait for address shift to complete. * [C#] Add testcase: resume iterator with async enumerable (#471) * [C#] Fix timing issue in testcase * Update 23-fasterkv-tuning.md * [C#] benchmark tuning for IOPS * [C#] WaitAsync should return false if iterator has reached end of scan range. * Fix azure blob list contents logic * [C#] Fixes and refactoring of FASTERAsync (#480) * Fix to move await of flushtask to Slow*Async * Fix setting of RecordInfo in ReadAsync * FASTERAsync: do not use CompleteAsync.GetAwaiter() in Complete() * fix asyncOp and asyncOperation usage * Add XML comment for throttleLimit param * Change flushTask to a SemaphoreSlim to avoid GetAwaiter().GetResult() in the sync case * Add AsyncPool.Get() for sync paths and change MLSD to use it instead of GetAwaiter().GetResult() * Add ConfigureAwait(false) to all awaits * Break FASTERAsync out to separate files * Prep for RMW refactor * Rename UpdelAsync -> UpdateAsync * Refactor RMWAsync to use UpdateAsync * Add GetAwaiter().GetResult in one void-returning function where it can't be avoided, * Update AsyncStress to include options for rmw-only, upsert-only, large vs. small memory log, and whether to use Value, Reference, or Span data types * Remove obsolete RecordAccessor.cs * Make IHeapContainer implement IDisposable * Fix the TakeFullCheckpoint overload without CheckpointType to call through to the overload with it * Update session.XxxAsync() doc comments for clarity and to emphasize the need to complete operations to avoid leaks * add raw stddev %s to output * Add -NoLock option to compare_runs * Add comments to IUpdateAsyncOperation; fix comment on ccompare_runs Co-authored-by: TedHartMS <15467143+TedHartMS@users.noreply.github.com> * Update home.md * [C#] Fix read cache boundary condition bug (#483) * [C++] Fix epoch scan range (#484) * [C++] Fix epoch scan range * updates * fix testcase * Update home.md * add FASTER.benchmark cmdline options: --sd --sm --noaff --chkptms --dumpdist (#485) * LogCommitFile is obsolete - commit file naming is handled automatically by default commit manager. (#494) * Update 40-fasterlog-basics.md * [C#] Update to C#9 (#486) * Add <LangVersion>latest to csprojs to pick up C#9; remove "is {}" in favor of "is not null"; use "Type x = new()", which is particularly useful for field definitions * Add net5.0 framework to core component builds; add "|| NET" to "#if NETSTANDARD" where necessary; switch samples to net5.0; add Debug builds to Linux * Update azure-pipelines.yml * Move C# Windows tasks to dotnet; add build/test tasks for Remote to C# pipelines * search for all *.test.csproj in build/test tasks * Restrict Linux to netcoreapp3.1 and net5.0 * remove duplicate langversion Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com> * [C#] Add infrastructure to support more wire protocols (#496) * Add BackendProvider concept to support backend other than FasterKV. Add protocol byte to binary protocol to enable support for more protocols in the future. * Fix some typos and add some comments * add .idea to gitignore * Add constructor overload to avoid API change, tweaks to serialization performance. * remove unused import * Cleanup & minor perf improvements Co-authored-by: Tianyu Li <t-litianyu@microsoft.com> Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com> * [C#] Remote provider enhancements (#503) * Refactor remote provider * Cleanup and speedup * cleanup and updates * Add a link to the DPR branch (#506) Co-authored-by: Tianyu Li <t-litianyu@microsoft.com> * [C#] Recovery testcase fixing (#513) * make error more detailed * try sorting by creation time for linux compat * change test to use specific token, as workaround for linux timestamp sorting granularity issue. * Ignore socket disposal exception in RecvEventArg_Completed * Restore full Azure pipeline * Add dependency bytes parameter to state objects * Partial implementation with new DprFinder * Failure-free coordinator code path * checkpoint * Various client/server side changes to make enhanced DPR work * Remaining Enhanced DPR artifacts * Repurposed DPR finder benchmark for the new implementations * [C#] Add Output to RMW (#515) * Add Output to RMW: - ** BREAKING CHANGE ** I(Advanced)Functions.CopyUpdater, InitialUpdater, InPlaceUpdater, and RMWCompletionCallback now have a ref Output parameter - ** BREAKING CHANGE ** RmwAsyncResult.Complete now returns a (Status, Output) tuple * Fix Remote IFunctions implementations to new RMW signatures * Change RMW callback signature (move Output to end) * Update Remote to new RMW Output signature; add $ReadPercentages to run_benchmark * Add Output to NeedCopyUpdate as well * Propagate RMW Output throughout Remote (ICallbackFunctions etc.); update docs for RMW Output * basic test and some fixes * [C#] SpanByteFasterKVProvider (#520) * Added SpanByteFasterKVProvider, and changed SpanByteSerializer to SpanByteServerSerializer and SpanByteClientSerializer * Removed unnecessary functions / debugs * fixed nit * [C#] Support FasterLog commit dir specification in settings (#519) * Support log commit path specification to FasterLog. * updates * Convert serialized SpanByte into its non-serialized form (safe to heap-copy as long as underlying payload is fixed) * minor updates. * minor * Fixes and Refactors * Code cleanup for EnhancedDprFinder backend * DprFinder benchmark + some fixes for enhanced DPR finder * add no delay * fix race * Code cleanup Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com> Co-authored-by: Jeffrey <61218880+plan-do-break-fix@users.noreply.github.com> Co-authored-by: hiteshmadan <hitesh.madan@microsoft.com> Co-authored-by: Tim Coleman <timothy.coleman@gmail.com> Co-authored-by: David Nepožitek <david@nepozitek.cz> Co-authored-by: TedHartMS <15467143+TedHartMS@users.noreply.github.com> Co-authored-by: Tianyu Li <t-litianyu@microsoft.com> Co-authored-by: rohankadekodi-msr <69916400+rohankadekodi-msr@users.noreply.github.com>
- Loading branch information
9 people
committed
Jul 13, 2021
1 parent
117eb74
commit ffe5dc1