Skip to content

Conversation

@cherep58
Copy link
Collaborator

@cherep58 cherep58 commented Oct 2, 2025

Refactored relabler code

@cherep58 cherep58 requested review from gshigin and u-veles-a October 2, 2025 14:58
@cherep58 cherep58 self-assigned this Oct 2, 2025
@cherep58 cherep58 requested a review from vporoshok as a code owner October 2, 2025 14:58
@vporoshok vporoshok added this to the release-0.7 milestone Oct 9, 2025
@u-veles-a u-veles-a merged commit 1f1acf5 into rebuild_heads_container Oct 9, 2025
26 checks passed
@u-veles-a u-veles-a deleted the stalenan_inner_series branch October 9, 2025 10:17
vporoshok pushed a commit that referenced this pull request Oct 23, 2025
* for save

* for save

* for save

* for save

* for save

* for save

* for save

* for save

* fix after merge

* rebuild querier, shard

* for save

* fix head

* add PerGoroutineRelabeler

* refactoring PerGoroutineRelabeler

* state and StatelessRelabeler

* add catalog appender

* add ready notifier

* add builder

* for save

* for save

* for save

* add chunkqurier

* rebuild

* fix fatal

* for save

* for save

* for save

* for save

* for save

* fix merge

* manager, mediator and minor edits

* adapter

* adapter

* fix walreader

* rebuild sreader

* for save

* for save

* rebuild state

* some fix

* add test

* add test

* add test

* add wal reader test

* for save

* Head keeper (#154)

* created HeadConvertingQueue

* added timeInterval cache for HeadDataStorage

* rewrite Keeper

* changes in cppbridge/relabeler

* added data loading/unloading

* created unit tests for block/writer

* created persistener

* fixed data race in LoadAndQuerySeriesDataTask

* fixed compilation error

* added mock

* fixed compilation error

* fix adapter

* prototype, for save

* debug

* add log, letrics

* smal fix

* small fix

* small fix

* some fix

* fix metrics

* fix state

* smal fix

* for save

* some fix

* some rebuild

* for save

* some fix

* for save

* add notify to catalogGC

* for save

* added unit test for skip empty block

* Rebuild head container lss snapshot copy (#161)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* add go CopyAddedSeries

* fix check new head

* add trigger with reset timer

* fix samples

* fix test

* add test state

* fix linter

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>

* add test

* fix test

* fix test

* add test state

* add test head wal

* add test PerGoroutineRelabeler

* add twst wal

* add descriptions

* add test querier

* for save

* add test head

* for save

* fix test mediator

* fix types

* add commiter test

* add merger test

* for save

* Lss snapshot copy (#145)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* fix types

* add commiter test

* add merger test

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>

* Refactored relabeler classes (#162)

* fixed roaring include error in CLion

* fixed linter warnings

* refactored tests for relabeler

* refactored stateless relabeler

* renamed LabelsBuilderStateMap to LabelsBuilder

* refactored relabeler tests

* rewritten test for PerGoroutineRelabelerFixture

* refactored PerGoroutineRelabeler

* fixed clang-tidy warning

* used std::string instead of std::ostringstream

* optimized hard_validate function

* fixed bug

* used reserve_and_write

* fixed bug in RelabelConfig with mutable variable

* fix after merge

* add rotator test

* some fix

* fix test

* fix review

* add wal metrics

* fix wal notifier

* fix test

* fix after review

* fix review

* for save

* fix after review

---------

Co-authored-by: cherep58 <cherep@sura.ru>
Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>
vporoshok added a commit that referenced this pull request Oct 24, 2025
* for save

* for save

* for save

* for save

* for save

* for save

* for save

* for save

* fix after merge

* rebuild querier, shard

* for save

* fix head

* add PerGoroutineRelabeler

* refactoring PerGoroutineRelabeler

* state and StatelessRelabeler

* add catalog appender

* add ready notifier

* add builder

* for save

* for save

* for save

* add chunkqurier

* rebuild

* fix fatal

* for save

* for save

* for save

* for save

* for save

* fix merge

* manager, mediator and minor edits

* adapter

* adapter

* fix walreader

* rebuild sreader

* for save

* for save

* rebuild state

* some fix

* add test

* add test

* add test

* add wal reader test

* for save

* Head keeper (#154)

* created HeadConvertingQueue

* added timeInterval cache for HeadDataStorage

* rewrite Keeper

* changes in cppbridge/relabeler

* added data loading/unloading

* created unit tests for block/writer

* created persistener

* fixed data race in LoadAndQuerySeriesDataTask

* fixed compilation error

* added mock

* fixed compilation error

* fix adapter

* prototype, for save

* debug

* fixed roaring include error in CLion

* fixed linter warnings

* add log, letrics

* smal fix

* small fix

* small fix

* some fix

* fix metrics

* fix state

* smal fix

* for save

* some fix

* some rebuild

* for save

* some fix

* refactored tests for relabeler

* for save

* add notify to catalogGC

* for save

* added unit test for skip empty block

* refactored stateless relabeler

* renamed LabelsBuilderStateMap to LabelsBuilder

* refactored relabeler tests

* rewritten test for PerGoroutineRelabelerFixture

* refactored PerGoroutineRelabeler

* fixed clang-tidy warning

* used std::string instead of std::ostringstream

* optimized hard_validate function

* Rebuild head container lss snapshot copy (#161)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* add go CopyAddedSeries

* fix check new head

* add trigger with reset timer

* fix samples

* fix test

* add test state

* fix linter

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>

* add test

* fixed bug

* fix test

* fix test

* used reserve_and_write

* add test state

* add test head wal

* add test PerGoroutineRelabeler

* add twst wal

* add descriptions

* extracted stale nan tracking into separate method from relabeling process

* add test querier

* for save

* add test head

* fixed bug in RelabelConfig with mutable variable

* for save

* fix test mediator

* fix types

* fixed unit tests

* add commiter test

* add merger test

* for save

* Lss snapshot copy (#145)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* fix types

* add commiter test

* add merger test

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>

* Refactored relabeler classes (#162)

* fixed roaring include error in CLion

* fixed linter warnings

* refactored tests for relabeler

* refactored stateless relabeler

* renamed LabelsBuilderStateMap to LabelsBuilder

* refactored relabeler tests

* rewritten test for PerGoroutineRelabelerFixture

* refactored PerGoroutineRelabeler

* fixed clang-tidy warning

* used std::string instead of std::ostringstream

* optimized hard_validate function

* fixed bug

* used reserve_and_write

* fixed bug in RelabelConfig with mutable variable

* fix after merge

* fixed state destruction at GC

* add rotator test

* some fix

* fix test

* fix review

* add wal metrics

* fix wal notifier

* fix test

* fix after review

* fix review

* for save

* fix after review

---------

Co-authored-by: Alexandr Yudin <alexandr.yudin@flant.com>
Co-authored-by: Alexander Yudin <57181751+u-veles-a@users.noreply.github.com>
Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>
Co-authored-by: Bastrykov Evgeniy <vporoshok@gmail.com>
vporoshok added a commit that referenced this pull request Oct 27, 2025
* for save

* for save

* for save

* for save

* for save

* for save

* for save

* for save

* fix after merge

* rebuild querier, shard

* for save

* fix head

* add PerGoroutineRelabeler

* refactoring PerGoroutineRelabeler

* state and StatelessRelabeler

* add catalog appender

* add ready notifier

* add builder

* for save

* for save

* for save

* add chunkqurier

* rebuild

* fix fatal

* for save

* for save

* for save

* for save

* for save

* fix merge

* manager, mediator and minor edits

* adapter

* adapter

* fix walreader

* rebuild sreader

* for save

* for save

* rebuild state

* some fix

* add test

* add test

* add test

* add wal reader test

* for save

* Head keeper (#154)

* created HeadConvertingQueue

* added timeInterval cache for HeadDataStorage

* rewrite Keeper

* changes in cppbridge/relabeler

* added data loading/unloading

* created unit tests for block/writer

* created persistener

* fixed data race in LoadAndQuerySeriesDataTask

* fixed compilation error

* added mock

* fixed compilation error

* fix adapter

* prototype, for save

* debug

* fixed roaring include error in CLion

* fixed linter warnings

* add log, letrics

* smal fix

* small fix

* small fix

* some fix

* fix metrics

* fix state

* smal fix

* for save

* some fix

* some rebuild

* for save

* some fix

* refactored tests for relabeler

* for save

* add notify to catalogGC

* for save

* added unit test for skip empty block

* refactored stateless relabeler

* renamed LabelsBuilderStateMap to LabelsBuilder

* refactored relabeler tests

* rewritten test for PerGoroutineRelabelerFixture

* refactored PerGoroutineRelabeler

* fixed clang-tidy warning

* used std::string instead of std::ostringstream

* optimized hard_validate function

* Rebuild head container lss snapshot copy (#161)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* add go CopyAddedSeries

* fix check new head

* add trigger with reset timer

* fix samples

* fix test

* add test state

* fix linter

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>

* add test

* fixed bug

* fix test

* fix test

* used reserve_and_write

* add test state

* add test head wal

* add test PerGoroutineRelabeler

* add twst wal

* add descriptions

* extracted stale nan tracking into separate method from relabeling process

* add test querier

* for save

* add test head

* fixed bug in RelabelConfig with mutable variable

* for save

* fix test mediator

* fix types

* fixed unit tests

* add commiter test

* add merger test

* for save

* Lss snapshot copy (#145)

* add patch to btree

* tracy headers update

* lss copy benchmark

* update benchmark

* remove bool pointer comparator hack

* count a total sum in benchmark

* benchmark fix

* fancy benchmark

* snug reserve method fix

* benchmark fix

* relabler reserve method fix

* entrypoint integration

* fixes over tests

* bitset copy fix + tests

* MemoryControlBlockWithItemCount copy test

* SliceControlBlock fix

* DecodingTable reserve fix

* tidy fix

* tidy fix

* review fixes

* template name fix

* remove entrypoint from benchmark

* lss copy keeps label set order test

* fix types

* add commiter test

* add merger test

---------

Co-authored-by: glebshigin <gleb.shigin@flant.com>

* Refactored relabeler classes (#162)

* fixed roaring include error in CLion

* fixed linter warnings

* refactored tests for relabeler

* refactored stateless relabeler

* renamed LabelsBuilderStateMap to LabelsBuilder

* refactored relabeler tests

* rewritten test for PerGoroutineRelabelerFixture

* refactored PerGoroutineRelabeler

* fixed clang-tidy warning

* used std::string instead of std::ostringstream

* optimized hard_validate function

* fixed bug

* used reserve_and_write

* fixed bug in RelabelConfig with mutable variable

* export dst_src label set ids mapping from QueryableEncodingBimapCopier into Go

* export dst_src label set ids mapping from QueryableEncodingBimapCopier into Go

* fix after merge

* fixed state destruction at GC

* created prompp_remap_stale_nans_state GO-binding

* add rotator test

* some fix

* fix test

* added stalenan state remapping

* fixed compilation error

* fixed comment

* fix review

* add wal metrics

* fix wal notifier

* fix test

* fix after review

* fix review

* for save

* fix after review

* fixed dst_src_ids_mapping generation

* review fixes

---------

Co-authored-by: Alexandr Yudin <alexandr.yudin@flant.com>
Co-authored-by: Alexander Yudin <57181751+u-veles-a@users.noreply.github.com>
Co-authored-by: glebshigin <gleb.shigin@flant.com>
Co-authored-by: Gleb Shigin <gleb.shigin@gmail.com>
Co-authored-by: Bastrykov Evgeniy <vporoshok@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants