Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigating performance of RocksDB Cloud as a KV store #617

Open
jarohen opened this issue Jan 31, 2020 · 0 comments
Open

Investigating performance of RocksDB Cloud as a KV store #617

jarohen opened this issue Jan 31, 2020 · 0 comments
Labels

Comments

@jarohen
Copy link
Member

jarohen commented Jan 31, 2020

On the theme of the separation of storage and compute (likely in combination with extensive use of write-through disk caches).

(from @refset) other options worth thinking about are:

  1. OpenAsSecondary + NFS: https://github.com/facebook/rocksdb/wiki/Secondary-instance + Does RocksDB support multi-process read access? facebook/rocksdb#908 (comment) (and potentially https://aws.amazon.com/blogs/aws/new-a-shared-file-system-for-your-lambda-functions/)
  2. Redis on Flash in the same VPC, via ZRANGEBYLEX (e.g. https://github.com/crux-labs/crux-redis)
  3. CockroachDB - it supports follower reads via AS OF SYSTEM TIME, and CockroachCloud has VPC peering on GCP
  4. DynamoDB+GSI w/ DAX - https://stackoverflow.com/questions/21794945/dynamodb-scan-in-sorted-order/28463257#28463257 (though might be restricted to <10GB https://docs.amazonaws.cn/en_us/amazondynamodb/latest/developerguide/bp-indexes-general.html#bp-indexes-general-expanding-collections)
@jarohen jarohen created this issue from a note in XTDB Development (Sarek) Jan 31, 2020
@jarohen jarohen moved this from Sarek to Needs Spec in XTDB Development Jan 31, 2020
@jarohen jarohen added this to the cupid milestone Jan 31, 2020
@jarohen jarohen moved this from Needs Spec to Selected in XTDB Development Feb 11, 2020
@jarohen jarohen moved this from Selected to Backlog in XTDB Development Feb 12, 2020
@jarohen jarohen removed this from the cupid milestone Apr 2, 2020
@jarohen jarohen removed this from Backlog in XTDB Development Apr 6, 2021
@jarohen jarohen added the 1.x label Apr 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant