Create SettingsDiff
structure and run extractions based on it
#4480
Labels
performance
Related to the performance in term of search/indexation speed or RAM/CPU/Disk consumption
settings diff-indexing
Issues related to settings diff-indexing
v1.8.0
PRs/issues solved in v1.8.0 released on 2024-05-06
Milestone
Related product team resources: PRD (internal only)
Summary
This issue is a subset of the work implementing the settings diff-indexing enhancement.
The current approach of
Settings::execute
is to trigger a full reindexing if at least one setting-change impacts the database.Instead, we should create a structure
SettingsDiff
computing the differences between the old and the new version of theSettings
, then send theSettingsDiff
everywhere in the indexing process, allowing each part to react depending on the changes.Additionally, the
Documents
shouldn't be sent to the database writer if there is no document addition/modification/deletion.Structure example
TODO
Settings::execute
methodsSettingsDiff
structureSettingsDiff
searchable
pipeline only if neededfacet
pipeline only if neededvector
pipeline only if neededdocuments
database writing if only the settings have been changedThe text was updated successfully, but these errors were encountered: