Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No force shard loading for nodes status API #4424

Merged
merged 2 commits into from
Mar 8, 2024

Conversation

parkerduckworth
Copy link
Member

@parkerduckworth parkerduckworth commented Mar 7, 2024

What's being changed:

Due to the unpredictable number of methods added to LazyLoadShard's and their usage in the nodes status API, we should never attempt to fulfill a full shard status for an unloaded shard. The background here is that the nodes status API will range over all shards in each index, force loading them all in parallel, totally defeating the purpose of the lazy load feature.

Instead, the shard name, class, and queue status can still be returned without loading, alongside a new boolean Loaded field in the nodes status response, indicating that the shard is not yet loaded.

Review checklist

  • Documentation has been updated, if necessary. Link to changed documentation:
  • Chaos pipeline run or not necessary. Link to pipeline:
  • All new code is covered by tests where it is reasonable.
  • Performance tests have been run or not necessary.

Copy link

sonarcloud bot commented Mar 7, 2024

Quality Gate Passed Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

@weaviate-git-bot
Copy link

Great to see you again! Thanks for the contribution.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

@parkerduckworth parkerduckworth merged commit 6aacbf0 into stable/v1.24 Mar 8, 2024
34 of 35 checks passed
@parkerduckworth parkerduckworth deleted the fix/nodes-api-no-force-loading branch March 8, 2024 14:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants