Skip to content

Feature/index optimisation#753

Merged
billettc merged 17 commits intodevelopfrom
feature/index_optimisation
Apr 30, 2026
Merged

Feature/index optimisation#753
billettc merged 17 commits intodevelopfrom
feature/index_optimisation

Conversation

@billettc
Copy link
Copy Markdown
Contributor

No description provided.

billettc added 8 commits April 7, 2026 09:19
…ut for which we can validate we can skip this block.

Migrate `ClockDistributor` implementation to `pipeline/distributor`, refactor pipeline integration, and introduce `ExecutorPath` for enhanced module execution tracking.
…` for clarity and consistency across pipeline components.
…per cleanup of WASM modules, and update `tier1` and `tier2` services for compatibility.
@billettc billettc requested a review from sduchesneau April 13, 2026 12:07
…e accurate block skipping based on input sources, stores, and executer indices.
Comment thread pipeline/cache/module.go Outdated
Comment thread pipeline/cache/module.go
Comment thread pipeline/cache/module.go
Comment thread pipeline/distributor/clock_distributor.go Outdated
Comment thread pipeline/pipeline.go Outdated
Comment thread service/tier2.go Outdated
Comment thread service/tier2.go Outdated
…erval validation, and update `tier1` and `tier2` services to handle disabled cache scenarios
Copy link
Copy Markdown
Contributor

@sduchesneau sduchesneau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just a few cosmetics suggested

Comment thread app/tier2.go
}

func (a *Tier2App) Run() error {
ctx := context.Background()
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This context is only given to the moduleCache, but nothing cancels it or anything.
Why is it declared here ?

Comment thread pipeline/pipeline.go
key := moduleKey{binaryIndex: module.BinaryIndex, binaryType: code.Type}

moduleHashStart := time.Now()
moduleHash := p.execGraph.ModuleHashes()[module.Name]
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems weird to ask specifically for '[module.Name]' but then discard it.
These 2 lines would be more readable with:
_ = p.execGraph.ModuleHashes() // memoize

Comment thread service/tier1.go
return strings.TrimPrefix(out, protoPkfPrefix), nil
}
func NewTier1(
ctx context.Context,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same comment as for Tier2: passing a ctx here and not using it (dead code, misleading)
either the app has a context that it will cancel, either we don't pass down the context and we have a context.Background() used directly inside the cache.

billettc and others added 7 commits April 14, 2026 14:55
…orage` to v1.59.1; use `zapx.HumanDuration` for improved logging in `tier2`
…ier2, because of how tier1's loadbalancer selector sends tcp opens
…t`, ensure accurate TTL-based evictions, and update access timestamps on cache hits.
…nd `tier2` services; simplify WASM module management and update dependencies.
@billettc billettc merged commit c3cbf96 into develop Apr 30, 2026
7 checks passed
@billettc billettc deleted the feature/index_optimisation branch April 30, 2026 12:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants