External media-driver mode with per-profile tuning#38
Merged
Conversation
Adds TRANSPORT_DRIVER_MODE=external: nodes launch Archive + ConsensusModule + ClusteredServiceContainer only and connect to a standalone media driver (deploy/media-driver/launch-driver.sh, C driver preferred, Java fallback) over shared-memory IPC. Embedded mode stays the dev default. - TransportConfig (new, match-common): driver mode, aeron dir, idle-strategy supplier (busy-spin prod / backoff dev), channel URIs with TRANSPORT_MTU, external-driver await with actionable timeout. - AeronCluster: split embedded/external launch paths; in external mode a FATAL Aeron error (dead driver) signals shutdown and halts the JVM after a 5s grace so the process manager can restart it (non-daemon threads would otherwise keep a driverless JVM alive). - ClusterConfig.idleStrategySupplier: one supplier for driver (embedded only), consensus module and service containers. - deploy/tuning/system-tuning.sh + make tune / tune-report: idempotent transport-critical OS tuning with before/after report. - docs/kernel-bypass.md: transport architecture reference. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
emrebulutlar
force-pushed
the
feat/external-media-driver
branch
from
July 3, 2026 17:24
bd29ee9 to
9fccdc5
Compare
This was referenced Jul 3, 2026
10 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Lands the transport half of the deployed-and-validated 2026-07-02 ops session work (running on the dev cluster since; external drivers are the default deploy mode). Follow-up PRs land the gateway WS backpressure and the perf/incident docs.
TRANSPORT_DRIVER_MODE=externalruns Archive/ConsensusModule/container against a standalone driver process over shared-memory IPC (C driver preferred, Java fallback); embedded stays the dev default. Includes fatal-error fail-fast so a node cannot outlive a dead driver, idle-strategy profiles (busy-spin prod / backoff dev),deploy/media-driver+deploy/tuningwithmake tune, anddocs/kernel-bypass.md.Note: squash-merged because GitHub refuses rebase merges into a signature-required base (verified today); split into single-commit PRs to keep granular linear history.
🤖 Generated with Claude Code