Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performant way to extract locality information and shard boundaries #243

Open
panghy opened this issue Apr 24, 2018 · 1 comment
Open

Performant way to extract locality information and shard boundaries #243

panghy opened this issue Apr 24, 2018 · 1 comment

Comments

@panghy
Copy link
Contributor

panghy commented Apr 24, 2018

Currently the only way to get the full picture of where shards are located is to get the shards (that's relatively fast, a single iteration through a system key space) and then ask for the storage servers for each of those shard one-by-one. It doesn't help that asking for IP addresses must be throttled so that you don't cause the responsible stateless processes to become pegged. There should be an easier way to accomplish this.

We need this API mainly to build coprocessors that live on the same machine as the DB and needing to figure out what data is local.

@davidscherer
Copy link

Since the locality API was originally designed, the underlying data in the system keyspace has changed to have more indirection. Possibly we should expose an API that looks more like what is actually there, or that returns boundaries, ids, and addresses for a range in a single query.

sfc-gh-yajin added a commit to sfc-gh-yajin/foundationdb that referenced this issue May 18, 2023
sfc-gh-tclinkenbeard pushed a commit to sfc-gh-tclinkenbeard/foundationdb that referenced this issue May 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants