CNDB 1707: Port remote file system abstractions to Stargazer#273
Merged
jasonstack merged 65 commits intods-trunkfrom Nov 9, 2021
Merged
CNDB 1707: Port remote file system abstractions to Stargazer#273jasonstack merged 65 commits intods-trunkfrom
jasonstack merged 65 commits intods-trunkfrom
Conversation
jasonstack
force-pushed
the
CNDB-1707
branch
13 times, most recently
from
598bc86 to
45fb4af
Compare
* LogTransaction: add LogTransactionsFactory to provide custom log transaction
…on remote file cache
* Change Descriptor to use URI and remove usage of fileNameFor * Switch to File for directories in DatabaseDescriptor
jasonstack
changed the title
jacek-lewandowski
left a comment
jacek-lewandowski
left a comment
There was a problem hiding this comment.
I'll continue reviewing but for now I wanted to leave some initial comments
mfleming
reviewed
Nov 2, 2021
jacek-lewandowski
pushed a commit
that referenced
this pull request
Mar 30, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69)
jacek-lewandowski
pushed a commit
that referenced
this pull request
Apr 4, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69)
jacek-lewandowski
pushed a commit
that referenced
this pull request
Apr 19, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69)
jacek-lewandowski
pushed a commit
that referenced
this pull request
May 26, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a)
jacek-lewandowski
pushed a commit
that referenced
this pull request
May 27, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a)
jacek-lewandowski
pushed a commit
that referenced
this pull request
Oct 17, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a) (cherry picked from commit 493bf4c)
jacek-lewandowski
pushed a commit
that referenced
this pull request
Oct 18, 2022
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a) (cherry picked from commit 493bf4c)
mfleming
pushed a commit
that referenced
this pull request
Jul 10, 2023
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a) (cherry picked from commit 493bf4c) (cherry picked from commit 2932216)
djatnieks
pushed a commit
that referenced
this pull request
Jul 24, 2023
* LogTransaction: add ILogTransactionsFactory to provide custom log transaction * UCS: Port CNDB-2134 to disable shards on UCS L0 * UCS: add CompactionAggregatePrioritizer to prioritize sstables based on remote file cache * NativeLibrary: Add INativeLibrary interface to provide custom implementation * SSTableWatcher: to discover custom component before opening sstables * StorageProvider: support custom file system and change Descriptor to use URI * StorageFeatureFlags: disable features that are not supported by custom file system * StorageHandler: to reload sstable from custom file system (cherry picked from commit e27ee69) (cherry picked from commit e98d05a) (cherry picked from commit 493bf4c) (cherry picked from commit 2932216)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
see https://github.com/riptano/cndb/issues/1707#issue-844015299 for the abstractions