Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Database sharding #306

Closed
zepatrik opened this issue Nov 11, 2020 · 3 comments
Closed

Database sharding #306

zepatrik opened this issue Nov 11, 2020 · 3 comments
Assignees
Labels
corp/m6 Up for M6 at Ory Corp. feat New feature or request. stale Feedback from one or more authors is required to proceed.

Comments

@zepatrik
Copy link
Member

Is your feature request related to a problem? Please describe.

Zanzibar allows the client to configure database sharding per namespace.
Form §3.1.1:

Our clients configure sharding of a namespace according
to its data pattern. Usually the shard ID is determined solely
by the object ID. In some cases, for example, when a namespace stores groups with very large numbers of members, the
shard ID is computed from both object ID and user.

@zepatrik zepatrik self-assigned this Nov 11, 2020
@zepatrik zepatrik added the corp/m4 Up for M4 at Ory Corp. label Nov 11, 2020
@zepatrik zepatrik added this to the Next Gen Keto milestone Nov 11, 2020
@zepatrik zepatrik added the feat New feature or request. label Nov 11, 2020
@zepatrik zepatrik added corp/m5 Up for M5 at Ory Corp. corp/next and removed corp/m4 Up for M4 at Ory Corp. corp/m5 Up for M5 at Ory Corp. labels Jan 13, 2021
@aeneasr
Copy link
Member

aeneasr commented Jan 25, 2021

Currently, the shardID is default in https://github.com/ory/keto/blob/zanzibar/internal/persistence/sql/relationtuples.go. However, it should be a unique identifier to avoid hot spots. Maybe replace it with a random UUID instead?

@github-actions
Copy link

github-actions bot commented Jan 8, 2023

Hello contributors!

I am marking this issue as stale as it has not received any engagement from the community or maintainers for a year. That does not imply that the issue has no merit! If you feel strongly about this issue

  • open a PR referencing and resolving the issue;
  • leave a comment on it and discuss ideas on how you could contribute towards resolving it;
  • leave a comment and describe in detail why this issue is critical for your use case;
  • open a new issue with updated details and a plan for resolving the issue.

Throughout its lifetime, Ory has received over 10.000 issues and PRs. To sustain that growth, we need to prioritize and focus on issues that are important to the community. A good indication of importance, and thus priority, is activity on a topic.

Unfortunately, burnout has become a topic of concern amongst open-source projects.

It can lead to severe personal and health issues as well as opening catastrophic attack vectors.

The motivation for this automation is to help prioritize issues in the backlog and not ignore, reject, or belittle anyone.

If this issue was marked as stale erroneously you can exempt it by adding the backlog label, assigning someone, or setting a milestone for it.

Thank you for your understanding and to anyone who participated in the conversation! And as written above, please do participate in the conversation if this topic is important to you!

Thank you 🙏✌️

@github-actions github-actions bot added the stale Feedback from one or more authors is required to proceed. label Jan 8, 2023
@zepatrik zepatrik removed the stale Feedback from one or more authors is required to proceed. label Jan 10, 2023
Copy link

Hello contributors!

I am marking this issue as stale as it has not received any engagement from the community or maintainers for a year. That does not imply that the issue has no merit! If you feel strongly about this issue

  • open a PR referencing and resolving the issue;
  • leave a comment on it and discuss ideas on how you could contribute towards resolving it;
  • leave a comment and describe in detail why this issue is critical for your use case;
  • open a new issue with updated details and a plan for resolving the issue.

Throughout its lifetime, Ory has received over 10.000 issues and PRs. To sustain that growth, we need to prioritize and focus on issues that are important to the community. A good indication of importance, and thus priority, is activity on a topic.

Unfortunately, burnout has become a topic of concern amongst open-source projects.

It can lead to severe personal and health issues as well as opening catastrophic attack vectors.

The motivation for this automation is to help prioritize issues in the backlog and not ignore, reject, or belittle anyone.

If this issue was marked as stale erroneously you can exempt it by adding the backlog label, assigning someone, or setting a milestone for it.

Thank you for your understanding and to anyone who participated in the conversation! And as written above, please do participate in the conversation if this topic is important to you!

Thank you 🙏✌️

@github-actions github-actions bot added the stale Feedback from one or more authors is required to proceed. label Jan 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
corp/m6 Up for M6 at Ory Corp. feat New feature or request. stale Feedback from one or more authors is required to proceed.
Projects
None yet
Development

No branches or pull requests

2 participants