Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detect and partition sparse region of UIDs #224

Merged
merged 21 commits into from
Jan 8, 2024
Merged

Conversation

EnricoMi
Copy link
Collaborator

@EnricoMi EnricoMi commented May 3, 2023

Loading data with Dgraph live loader will spread uids across the entire 64-bit unsigned value range. This renders uid partitioning useless.

This fix scans the value range for a sparse region following a dense region at the beginning of the uid range.

@github-actions
Copy link

github-actions bot commented May 3, 2023

Test Results

 2 996 files  +   96   2 996 suites  +96   51m 26s ⏱️ +39s
   485 tests +   27     485 ✅ +   27  0 💤 ±0  0 ❌ ±0 
42 988 runs  +2 592  42 988 ✅ +2 592  0 💤 ±0  0 ❌ ±0 

Results for commit 1bfb1b3. ± Comparison against base commit 990e989.

♻️ This comment has been updated with latest results.

@EnricoMi EnricoMi force-pushed the partition-sparse-uid-range branch 2 times, most recently from dbdbb63 to 0a81722 Compare May 3, 2023 18:27
@EnricoMi EnricoMi marked this pull request as ready for review January 8, 2024 16:29
@EnricoMi EnricoMi merged commit c938f2b into main Jan 8, 2024
159 checks passed
@EnricoMi EnricoMi deleted the partition-sparse-uid-range branch January 8, 2024 20:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant