Skip to content

Conversation

@DvirDukhan
Copy link

Describe the changes in the pull request

This PR implements the info and infoIterator capabilities for tiered index
Which issues this PR fixes
MOD-4967

Main objects this PR modified
VecSimIndexInfo now contains commonInfo section and each specilized index holds its own specielized info.

Mark if applicable

  • This PR introduces API changes - Info struct has been changed
  • This PR introduces serialization changes

@DvirDukhan DvirDukhan requested a review from alonre24 May 1, 2023 19:34
@DvirDukhan DvirDukhan changed the title Tiered index info MOD-4967 Tiered index info MOD-4315 May 1, 2023
@DvirDukhan DvirDukhan requested a review from GuyAv46 May 4, 2023 12:40
Copy link
Collaborator

@GuyAv46 GuyAv46 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General comment:
How does the memory is being reported in tiered? 3 parts? Or is there also the sum of the parts?

while (VecSimInfoIterator_HasNextField(infoIter)) {
VecSim_InfoField *infoFiled = VecSimInfoIterator_NextField(infoIter);
if (!strcmp(infoFiled->fieldName, VecSimCommonStrings::ALGORITHM_STRING)) {
VecSim_InfoField *infoField = VecSimInfoIterator_NextField(infoIter);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice catch

DvirDukhan and others added 8 commits May 7, 2023 15:11
Co-authored-by: GuyAv46 <47632673+GuyAv46@users.noreply.github.com>
Co-authored-by: GuyAv46 <47632673+GuyAv46@users.noreply.github.com>
Co-authored-by: GuyAv46 <47632673+GuyAv46@users.noreply.github.com>
info.tieredInfo.frontendCommonInfo = frontendInfo.commonInfo;
info.tieredInfo.bfInfo = frontendInfo.bfInfo;

info.tieredInfo.backgroundIndexing = this->frontendIndex->indexSize() > 0;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should expose the number of zombies in the tiered index info section as well (num marked deleted)

@DvirDukhan DvirDukhan merged commit 00a6157 into feature_HNSW_tiered_index May 8, 2023
@DvirDukhan DvirDukhan deleted the dvirdu_simple_info branch May 8, 2023 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants