Bug description
iggy-server will not start on macOS (arm64). Every shard panics immediately:
thread 'shard-4' panicked at compio-driver-0.12.4/src/asyncify.rs:118:25:
the thread pool is needed but no worker thread is running
All 8 shards fail the same way, which kills tcp_server, websocket_server and
http_server and shuts the process down.
Reproduce:
cargo run --bin iggy-server -- --with-default-root-credentials --fresh
Not a recent regression. server-0.8.1-edge.1 fails identically at
compio-driver-0.11.4/src/asyncify.rs:114, and master (0.8.2-edge.1) fails at
compio-driver-0.12.4/src/asyncify.rs:118.
#3047 reports the same panic on Windows, at the same file and line as the
0.8.1-edge.1 build here. Filing separately since fixing Windows may not necessarily
fix this.
Affected area / component
Iggy server
Deployment
Compiled from source
Versions
server-0.8.1-edge.1 0.8.2-edge.1
Hardware / environment
MacOS
Sample code
N/A
Logs
Running `target/debug/iggy-server --with-default-root-credentials --fresh`
|_ |_ _ __ _ _ _ / | ___ _ ____ _____ _ __
| |/ |/ _ | | | | _ \ / _ \ '\ \ / / _ \ '|
| | (| | (| | || | ) | _/ | \ V / / |
|_, |_, |_, | |___/ _|| _/ ___||
|/ |/ |___/
2026-08-01T04:24:09.960012Z INFO main server::log::logger: It seems that you are a developer. Environment variable IGGY_CI_BUILD is not set to 'true', skipping build info print.
2026-08-01T04:24:09.966755Z INFO main configs::configs_impl::file_provider: Loading config from path: 'core/server/config.toml'...
2026-08-01T04:24:09.971004Z INFO main configs::configs_impl::file_provider: Found configuration file at path: 'core/server/config.toml'.
2026-08-01T04:24:09.987089Z INFO main configs::configs_impl::file_provider: Config loaded successfully.
2026-08-01T04:24:09.987558Z INFO main configs::configs_impl::file_provider: Using Config: { consumer_group: { rebalancing_timeout: 30s, rebalancing_check_interval: 5s }, data_maintenance: { messages: { cleaner_enabled: false, interval: 1m } }, message_saver: { enabled: true, enforce_fsync: true, interval: 30s }, heartbeat: { enabled: false, interval: 5s }, system: { path: local_data, logging: { path: logs, level: info, file_enabled: true, max_file_size: 500.00 MB, max_total_size: 4.00 GB, rotation_check_interval: 1h, retention: 7days }, stream: { path: streams }, topic: { path: topics, max_size: unlimited, message_expiry: never_expire }, partition: { path: partitions, messages_required_to_save: 1024, size_of_messages_required_to_save: 1.05 MB, enforce_fsync: false, validate_checksum: false }, segment: { size_bytes: 1.07 GB, cache_indexes: OpenSegment, archive_expired: false }, encryption: { enabled: false }, state: { enforce_fsync: false, max_file_operation_retries: 1, retry_delay: 1s } }, quic: { enabled: true, address: 127.0.0.1:8080, max_concurrent_bidi_streams: 10000, datagram_send_buffer_size: 100.00 KB, initial_mtu: 8.00 KB, send_window: 100.00 KB, receive_window: 100.00 KB, keep_alive_interval: 5s, max_idle_timeout: 10s, certificate: { self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, tcp: { enabled: true, address: 127.0.0.1:8090, ipv6: false, tls: { enabled: false, self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem }, socket: { override defaults: false, recv buffer size: 100.00 KB, send buffer size 100.00 KB, keepalive: false, nodelay: false, linger: 0s }, socket_migration: true }, http: { enabled: true, address: 127.0.0.1:3000, max_request_size: 2.00 MB, web_ui: false, cors: { enabled: true, allowed_methods: ["GET", "POST", "PUT", "DELETE"], allowed_origins: ["*"], allowed_headers: ["content-type", "authorization"], exposed_headers: [""], allow_credentials: false, allow_private_network: false }, jwt: { algorithm: HS256, audience: iggy.apache.org, access_token_expiry: 1h, use_base64_secret: false }, metrics: { enabled: true, endpoint: /metrics }, tls: { enabled: false, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, telemetry: { enabled: false, service_name: iggy, logs: { transport: grpc, endpoint: http://localhost:7281/v1/logs }, traces: { transport: grpc, endpoint: http://localhost:7281/v1/traces } } }
2026-08-01T04:24:09.988674Z WARN main iggy_server: Removing system path at: local_data because --fresh flag was set
2026-08-01T04:24:09.992022Z INFO main server::bootstrap: Initializing system, data will be stored at: local_data
2026-08-01T04:24:09.998960Z INFO main server::log::logger: Logging initialized, logs will be stored at: "local_data/logs". Logs will be rotated based on size. Log filter: info.
2026-08-01T04:24:09.999308Z INFO main iggy_server: Using default root credentials (username: iggy, password: iggy) - FOR DEVELOPMENT ONLY! If root user already exists, existing credentials will be reused.
2026-08-01T04:24:10.000738Z INFO main iggy_common::alloc::memory_pool: Initializing MemoryPool with 28 buckets, each will have capacity: 8192.
2026-08-01T04:24:10.001073Z INFO main iggy_server: Current semantic version: SemanticVersion { major: 0, minor: 8, patch: 1, prerelease: Some("edge.1") }
2026-08-01T04:24:10.001485Z INFO main iggy_server: System info not found, creating...
2026-08-01T04:24:10.002576Z INFO main server::shard::system::storage: Saved system info, system info, version: 0.8.1-edge.1
2026-08-01T04:24:10.002815Z INFO main iggy_server: Loaded system info, version: 0.8.1-edge.1.
2026-08-01T04:24:10.003111Z INFO main iggy_server: System version 0.8.1-edge.1 is up to date.
2026-08-01T04:24:10.003204Z INFO main iggy_server: Server-side encryption is disabled.
2026-08-01T04:24:10.004138Z INFO main server::state::file: State file is empty
2026-08-01T04:24:10.004293Z INFO main server::state::system: No users found, creating the root user...
2026-08-01T04:24:10.004350Z INFO main server::bootstrap: Using the custom root user credentials.
2026-08-01T04:24:10.032227Z INFO main server::state::file: Loading state, file size: 192 B
2026-08-01T04:24:10.034514Z INFO main server::state::file: Loaded 1 state entries, current index: 0
2026-08-01T04:24:10.035802Z INFO main server::bootstrap: Building metadata: 1 users, 0 personal access tokens
2026-08-01T04:24:10.036056Z INFO main server::bootstrap: Built metadata: 0 streams, 0 topics, 0 partitions, 0 consumer groups
2026-08-01T04:24:10.041253Z INFO main server::shard_allocator: Using 8 shards with 1 NUMA node, 8 cores per node, and avoid hyperthread true
2026-08-01T04:24:10.041394Z INFO main iggy_server: Using mimalloc allocator
2026-08-01T04:24:10.041488Z INFO main iggy_server: Enable TCP socket migration across shards: true.
2026-08-01T04:24:10.041708Z INFO main iggy_server: Starting 8 shard(s)
2026-08-01T04:24:10.043717Z ERROR shard-4 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043572Z ERROR shard-1 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043800Z ERROR shard-7 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044046Z ERROR shard-6 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043987Z ERROR shard-5 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043925Z ERROR shard-0 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044617Z ERROR shard-5 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.043865Z ERROR shard-2 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044585Z ERROR shard-0 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044656Z ERROR shard-2 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044535Z ERROR shard-7 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044521Z ERROR shard-1 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044887Z ERROR shard-4 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044790Z INFO main iggy_server: Iggy server is running. Press Ctrl+C or send SIGTERM to shutdown.
2026-08-01T04:24:10.043639Z ERROR shard-3 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.045050Z ERROR shard-3 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.045264Z ERROR shard-6 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.046943Z INFO shard-4 server::shard: Starting...
2026-08-01T04:24:10.046958Z INFO shard-6 server::shard: Starting...
2026-08-01T04:24:10.047017Z INFO shard-3 server::shard: Starting...
2026-08-01T04:24:10.047086Z INFO shard-0 server::shard: Starting...
2026-08-01T04:24:10.047102Z INFO shard-5 server::shard: Starting...
2026-08-01T04:24:10.047184Z INFO shard-7 server::shard: Starting...
2026-08-01T04:24:10.047284Z INFO shard-2 server::shard: Starting...
2026-08-01T04:24:10.047615Z INFO shard-1 server::shard: Starting...
2026-08-01T04:24:10.048003Z INFO shard-3 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048017Z INFO shard-7 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048094Z INFO shard-0 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048155Z INFO shard-2 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048185Z INFO shard-1 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048239Z INFO shard-5 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048358Z INFO shard-4 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048436Z INFO shard-6 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048941Z INFO shard-2 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048967Z INFO shard-5 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048954Z INFO shard-0 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048992Z INFO shard-4 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049066Z INFO shard-3 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049084Z INFO shard-7 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049115Z INFO shard-6 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049239Z INFO shard-1 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049458Z INFO shard-0 server::shard::tasks::periodic::personal_access_token_cleaner: Personal access token cleaner is enabled, expired tokens will be deleted every: 60s.
2026-08-01T04:24:10.049607Z INFO shard-6 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049629Z INFO shard-1 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049713Z INFO shard-4 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049721Z INFO shard-2 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049765Z INFO shard-3 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049918Z INFO shard-0 server::shard::tasks::periodic::revocation_timeout: Pending partition revocations will be checked every: 5s. Timeout: 30s.
2026-08-01T04:24:10.049985Z INFO shard-7 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.050229Z INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: System info logger is enabled, OS info will be printed every: 10s
2026-08-01T04:24:10.050269Z INFO shard-0 server::shard: Initialized in 3 ms.
2026-08-01T04:24:10.050664Z INFO shard-5 server::shard: Initialized in 3 ms.
2026-08-01T04:24:10.051600Z INFO shard-4 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.051659Z INFO shard-0 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.051725Z INFO shard-3 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052398Z INFO shard-1 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052539Z INFO shard-5 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052716Z INFO shard-7 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052893Z INFO shard-2 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.053028Z INFO shard-6 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.054527Z INFO shard-3 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054622Z INFO shard-4 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054718Z INFO shard-5 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054932Z INFO shard-6 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055016Z INFO shard-2 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055093Z INFO shard-7 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055174Z INFO shard-1 server::tcp::tcp_server: Initializing Iggy TCP server...
thread 'shard-7' (6842997) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
thread 'shard-2' (6842992) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-1' (6842991) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-6' (6842996) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-4' (6842994) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-5' (6842995) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-3' (6842993) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.058132Z INFO shard-0 server::tcp::tcp_server: Initializing Iggy TCP server...
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063601Z ERROR shard-6 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 6: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063670Z ERROR shard-2 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 2: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063747Z ERROR shard-3 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 3: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063970Z ERROR shard-1 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 1: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063990Z ERROR shard-7 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 7: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064011Z ERROR shard-5 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 5: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064121Z ERROR shard-4 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 4: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064219Z ERROR shard-0 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064968Z ERROR shard-3 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 3, triggering shutdown for all shards
2026-08-01T04:24:10.064984Z ERROR shard-2 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 2, triggering shutdown for all shards
2026-08-01T04:24:10.065050Z ERROR shard-6 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 6, triggering shutdown for all shards
2026-08-01T04:24:10.065120Z ERROR shard-5 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 5, triggering shutdown for all shards
2026-08-01T04:24:10.065228Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.065293Z ERROR shard-1 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 1, triggering shutdown for all shards
2026-08-01T04:24:10.065410Z ERROR shard-4 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 4, triggering shutdown for all shards
2026-08-01T04:24:10.065487Z ERROR shard-7 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 7, triggering shutdown for all shards
2026-08-01T04:24:10.067259Z INFO shard-5 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 5...
2026-08-01T04:24:10.067274Z INFO shard-1 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 1...
2026-08-01T04:24:10.067305Z INFO shard-2 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 2...
2026-08-01T04:24:10.067333Z INFO shard-6 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 6...
2026-08-01T04:24:10.067344Z INFO shard-4 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 4...
2026-08-01T04:24:10.067499Z INFO shard-3 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 3...
2026-08-01T04:24:10.067540Z INFO shard-7 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 7...
thread 'shard-5' (6842995) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-1' (6842991) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.068733Z INFO shard-0 server::shard::tasks::continuous::http_server: Starting HTTP server on shard: 0
thread 'shard-6' (6842996) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-2' (6842992) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-7' (6842997) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-3' (6842993) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-4' (6842994) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.070906Z ERROR shard-7 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 7: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.070987Z ERROR shard-5 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 5: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071006Z WARN shard-0 server::http::http_server: JWT encoding and decoding secrets are not configured - generated a random secret: wcz***. JWT tokens will be invalidated on server restart. Set 'encoding_secret' and 'decoding_secret' in the config to use persistent secrets.
2026-08-01T04:24:10.071104Z ERROR shard-2 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 2: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071148Z ERROR shard-4 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 4: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071172Z ERROR shard-3 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 3: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071200Z ERROR shard-1 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 1: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071223Z ERROR shard-6 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 6: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071570Z ERROR shard-7 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 7, triggering shutdown for all shards
2026-08-01T04:24:10.071655Z ERROR shard-5 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 5, triggering shutdown for all shards
2026-08-01T04:24:10.071753Z ERROR shard-4 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 4, triggering shutdown for all shards
2026-08-01T04:24:10.071808Z ERROR shard-2 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 2, triggering shutdown for all shards
2026-08-01T04:24:10.071840Z ERROR shard-1 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 1, triggering shutdown for all shards
2026-08-01T04:24:10.071885Z ERROR shard-3 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 3, triggering shutdown for all shards
2026-08-01T04:24:10.071926Z ERROR shard-6 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 6, triggering shutdown for all shards
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.079067Z ERROR shard-1 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079119Z ERROR shard-3 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079308Z ERROR shard-1 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079378Z ERROR shard-7 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079405Z ERROR shard-7 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079450Z ERROR shard-3 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079195Z ERROR shard-4 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079484Z ERROR shard-4 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079118Z ERROR shard-6 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079584Z ERROR shard-6 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079634Z ERROR shard-2 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079658Z ERROR shard-2 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079696Z ERROR shard-5 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079717Z ERROR shard-5 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.083173Z WARN shard-7 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 7 in 5.71475ms
2026-08-01T04:24:10.083180Z WARN shard-3 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 3 in 5.327875ms
2026-08-01T04:24:10.083265Z WARN shard-1 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 1 in 5.924417ms
2026-08-01T04:24:10.083307Z WARN shard-2 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 2 in 5.568542ms
2026-08-01T04:24:10.083335Z WARN shard-6 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 6 in 5.091208ms
2026-08-01T04:24:10.083478Z WARN shard-4 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 4 in 6.164541ms
2026-08-01T04:24:10.083505Z WARN shard-5 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 5 in 6.283792ms
2026-08-01T04:24:10.084466Z INFO shard-1 iggy_server: Shard 1 run completed
2026-08-01T04:24:10.084487Z INFO shard-2 iggy_server: Shard 2 run completed
2026-08-01T04:24:10.084530Z INFO shard-4 iggy_server: Shard 4 run completed
2026-08-01T04:24:10.084552Z INFO shard-5 iggy_server: Shard 5 run completed
2026-08-01T04:24:10.084601Z INFO shard-3 iggy_server: Shard 3 run completed
2026-08-01T04:24:10.084713Z INFO shard-6 iggy_server: Shard 6 run completed
2026-08-01T04:24:10.084855Z INFO shard-7 iggy_server: Shard 7 run completed
2026-08-01T04:24:10.085890Z INFO main iggy_server: Shard 4 exited successfully
2026-08-01T04:24:10.085923Z INFO main iggy_server: Shard 3 exited successfully
2026-08-01T04:24:10.085937Z INFO main iggy_server: Shard 7 exited successfully
2026-08-01T04:24:10.085947Z INFO main iggy_server: Shard 5 exited successfully
2026-08-01T04:24:10.085959Z INFO main iggy_server: Shard 6 exited successfully
2026-08-01T04:24:10.086216Z INFO main iggy_server: Shard 1 exited successfully
2026-08-01T04:24:10.086347Z INFO main iggy_server: Shard 2 exited successfully
2026-08-01T04:24:10.086578Z ERROR shard-0 server::shard::task_registry::registry: continuous 'http_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.086923Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'http_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.088300Z INFO shard-0 server::quic::quic_server: Initializing Iggy QUIC server on shard 0 for address 127.0.0.1:8080
2026-08-01T04:24:10.090749Z INFO shard-0 server::quic::quic_server: Iggy QUIC server has started on: 127.0.0.1:8080
2026-08-01T04:24:10.090952Z INFO shard-0 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 0...
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.091072Z ERROR shard-0 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.091093Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.091912Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.091941Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'http_server' of kind Continuous failed: Error
2026-08-01T04:24:10.091969Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.093384Z WARN shard-0 server::shard::tasks::oneshot::config_writer: config_writer: shutdown triggered before all servers bound, skipping config write
2026-08-01T04:24:10.094827Z WARN shard-0 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 0 in 2.944125ms
2026-08-01T04:24:10.094884Z INFO shard-0 iggy_server: Shard 0 run completed
2026-08-01T04:24:10.094997Z INFO main iggy_server: Shard 0 exited successfully
2026-08-01T04:24:10.095518Z INFO main iggy_server: All shards have shut down. Iggy server is exiting.
Iggy server config
Default config
Reproduction
On MacOS run:
cargo run --bin iggy-server -- --with-default-root-credentials --fresh
Contribution
Good first issue
Bug description
iggy-serverwill not start on macOS (arm64). Every shard panics immediately:All 8 shards fail the same way, which kills
tcp_server,websocket_serverandhttp_serverand shuts the process down.Reproduce:
Not a recent regression.
server-0.8.1-edge.1fails identically atcompio-driver-0.11.4/src/asyncify.rs:114, and master (0.8.2-edge.1) fails atcompio-driver-0.12.4/src/asyncify.rs:118.#3047 reports the same panic on Windows, at the same file and line as the
0.8.1-edge.1 build here. Filing separately since fixing Windows may not necessarily
fix this.
Affected area / component
Iggy server
Deployment
Compiled from source
Versions
server-0.8.1-edge.1 0.8.2-edge.1
Hardware / environment
MacOS
Sample code
N/A
Logs
|_ |_ _ __ _ _ _ / | ___ _ ____ _____ _ __
| |/
|/ _| | | | _ \ / _ \ '\ \ / / _ \ '|| | (| | (| | || | ) | _/ | \ V / / |
|_, |_, |_, | |___/ _|| _/ ___||
|/ |/ |___/
2026-08-01T04:24:09.960012Z INFO main server::log::logger: It seems that you are a developer. Environment variable IGGY_CI_BUILD is not set to 'true', skipping build info print.
2026-08-01T04:24:09.966755Z INFO main configs::configs_impl::file_provider: Loading config from path: 'core/server/config.toml'...
2026-08-01T04:24:09.971004Z INFO main configs::configs_impl::file_provider: Found configuration file at path: 'core/server/config.toml'.
2026-08-01T04:24:09.987089Z INFO main configs::configs_impl::file_provider: Config loaded successfully.
2026-08-01T04:24:09.987558Z INFO main configs::configs_impl::file_provider: Using Config: { consumer_group: { rebalancing_timeout: 30s, rebalancing_check_interval: 5s }, data_maintenance: { messages: { cleaner_enabled: false, interval: 1m } }, message_saver: { enabled: true, enforce_fsync: true, interval: 30s }, heartbeat: { enabled: false, interval: 5s }, system: { path: local_data, logging: { path: logs, level: info, file_enabled: true, max_file_size: 500.00 MB, max_total_size: 4.00 GB, rotation_check_interval: 1h, retention: 7days }, stream: { path: streams }, topic: { path: topics, max_size: unlimited, message_expiry: never_expire }, partition: { path: partitions, messages_required_to_save: 1024, size_of_messages_required_to_save: 1.05 MB, enforce_fsync: false, validate_checksum: false }, segment: { size_bytes: 1.07 GB, cache_indexes: OpenSegment, archive_expired: false }, encryption: { enabled: false }, state: { enforce_fsync: false, max_file_operation_retries: 1, retry_delay: 1s } }, quic: { enabled: true, address: 127.0.0.1:8080, max_concurrent_bidi_streams: 10000, datagram_send_buffer_size: 100.00 KB, initial_mtu: 8.00 KB, send_window: 100.00 KB, receive_window: 100.00 KB, keep_alive_interval: 5s, max_idle_timeout: 10s, certificate: { self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, tcp: { enabled: true, address: 127.0.0.1:8090, ipv6: false, tls: { enabled: false, self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem }, socket: { override defaults: false, recv buffer size: 100.00 KB, send buffer size 100.00 KB, keepalive: false, nodelay: false, linger: 0s }, socket_migration: true }, http: { enabled: true, address: 127.0.0.1:3000, max_request_size: 2.00 MB, web_ui: false, cors: { enabled: true, allowed_methods: ["GET", "POST", "PUT", "DELETE"], allowed_origins: ["*"], allowed_headers: ["content-type", "authorization"], exposed_headers: [""], allow_credentials: false, allow_private_network: false }, jwt: { algorithm: HS256, audience: iggy.apache.org, access_token_expiry: 1h, use_base64_secret: false }, metrics: { enabled: true, endpoint: /metrics }, tls: { enabled: false, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, telemetry: { enabled: false, service_name: iggy, logs: { transport: grpc, endpoint: http://localhost:7281/v1/logs }, traces: { transport: grpc, endpoint: http://localhost:7281/v1/traces } } }
2026-08-01T04:24:09.988674Z WARN main iggy_server: Removing system path at: local_data because
--freshflag was set2026-08-01T04:24:09.992022Z INFO main server::bootstrap: Initializing system, data will be stored at: local_data
2026-08-01T04:24:09.998960Z INFO main server::log::logger: Logging initialized, logs will be stored at: "local_data/logs". Logs will be rotated based on size. Log filter: info.
2026-08-01T04:24:09.999308Z INFO main iggy_server: Using default root credentials (username: iggy, password: iggy) - FOR DEVELOPMENT ONLY! If root user already exists, existing credentials will be reused.
2026-08-01T04:24:10.000738Z INFO main iggy_common::alloc::memory_pool: Initializing MemoryPool with 28 buckets, each will have capacity: 8192.
2026-08-01T04:24:10.001073Z INFO main iggy_server: Current semantic version: SemanticVersion { major: 0, minor: 8, patch: 1, prerelease: Some("edge.1") }
2026-08-01T04:24:10.001485Z INFO main iggy_server: System info not found, creating...
2026-08-01T04:24:10.002576Z INFO main server::shard::system::storage: Saved system info, system info, version: 0.8.1-edge.1
2026-08-01T04:24:10.002815Z INFO main iggy_server: Loaded system info, version: 0.8.1-edge.1.
2026-08-01T04:24:10.003111Z INFO main iggy_server: System version 0.8.1-edge.1 is up to date.
2026-08-01T04:24:10.003204Z INFO main iggy_server: Server-side encryption is disabled.
2026-08-01T04:24:10.004138Z INFO main server::state::file: State file is empty
2026-08-01T04:24:10.004293Z INFO main server::state::system: No users found, creating the root user...
2026-08-01T04:24:10.004350Z INFO main server::bootstrap: Using the custom root user credentials.
2026-08-01T04:24:10.032227Z INFO main server::state::file: Loading state, file size: 192 B
2026-08-01T04:24:10.034514Z INFO main server::state::file: Loaded 1 state entries, current index: 0
2026-08-01T04:24:10.035802Z INFO main server::bootstrap: Building metadata: 1 users, 0 personal access tokens
2026-08-01T04:24:10.036056Z INFO main server::bootstrap: Built metadata: 0 streams, 0 topics, 0 partitions, 0 consumer groups
2026-08-01T04:24:10.041253Z INFO main server::shard_allocator: Using 8 shards with 1 NUMA node, 8 cores per node, and avoid hyperthread true
2026-08-01T04:24:10.041394Z INFO main iggy_server: Using mimalloc allocator
2026-08-01T04:24:10.041488Z INFO main iggy_server: Enable TCP socket migration across shards: true.
2026-08-01T04:24:10.041708Z INFO main iggy_server: Starting 8 shard(s)
2026-08-01T04:24:10.043717Z ERROR shard-4 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043572Z ERROR shard-1 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043800Z ERROR shard-7 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044046Z ERROR shard-6 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043987Z ERROR shard-5 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.043925Z ERROR shard-0 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044617Z ERROR shard-5 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.043865Z ERROR shard-2 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.044585Z ERROR shard-0 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044656Z ERROR shard-2 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044535Z ERROR shard-7 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044521Z ERROR shard-1 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044887Z ERROR shard-4 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.044790Z INFO main iggy_server: Iggy server is running. Press Ctrl+C or send SIGTERM to shutdown.
2026-08-01T04:24:10.043639Z ERROR shard-3 server::shard_allocator: Failed to bind memory Rust(Unsupported)
2026-08-01T04:24:10.045050Z ERROR shard-3 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.045264Z ERROR shard-6 iggy_server: Failed to bind memory: BindingFailed
2026-08-01T04:24:10.046943Z INFO shard-4 server::shard: Starting...
2026-08-01T04:24:10.046958Z INFO shard-6 server::shard: Starting...
2026-08-01T04:24:10.047017Z INFO shard-3 server::shard: Starting...
2026-08-01T04:24:10.047086Z INFO shard-0 server::shard: Starting...
2026-08-01T04:24:10.047102Z INFO shard-5 server::shard: Starting...
2026-08-01T04:24:10.047184Z INFO shard-7 server::shard: Starting...
2026-08-01T04:24:10.047284Z INFO shard-2 server::shard: Starting...
2026-08-01T04:24:10.047615Z INFO shard-1 server::shard: Starting...
2026-08-01T04:24:10.048003Z INFO shard-3 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048017Z INFO shard-7 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048094Z INFO shard-0 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048155Z INFO shard-2 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048185Z INFO shard-1 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048239Z INFO shard-5 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048358Z INFO shard-4 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048436Z INFO shard-6 server::shard: Initialized 1 user(s).
2026-08-01T04:24:10.048941Z INFO shard-2 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048967Z INFO shard-5 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048954Z INFO shard-0 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.048992Z INFO shard-4 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049066Z INFO shard-3 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049084Z INFO shard-7 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049115Z INFO shard-6 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049239Z INFO shard-1 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
2026-08-01T04:24:10.049458Z INFO shard-0 server::shard::tasks::periodic::personal_access_token_cleaner: Personal access token cleaner is enabled, expired tokens will be deleted every: 60s.
2026-08-01T04:24:10.049607Z INFO shard-6 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049629Z INFO shard-1 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049713Z INFO shard-4 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049721Z INFO shard-2 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049765Z INFO shard-3 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.049918Z INFO shard-0 server::shard::tasks::periodic::revocation_timeout: Pending partition revocations will be checked every: 5s. Timeout: 30s.
2026-08-01T04:24:10.049985Z INFO shard-7 server::shard: Initialized in 2 ms.
2026-08-01T04:24:10.050229Z INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: System info logger is enabled, OS info will be printed every: 10s
2026-08-01T04:24:10.050269Z INFO shard-0 server::shard: Initialized in 3 ms.
2026-08-01T04:24:10.050664Z INFO shard-5 server::shard: Initialized in 3 ms.
2026-08-01T04:24:10.051600Z INFO shard-4 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.051659Z INFO shard-0 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.051725Z INFO shard-3 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052398Z INFO shard-1 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052539Z INFO shard-5 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052716Z INFO shard-7 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.052893Z INFO shard-2 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.053028Z INFO shard-6 server::shard::tasks::continuous::message_pump: Starting message passing task
2026-08-01T04:24:10.054527Z INFO shard-3 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054622Z INFO shard-4 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054718Z INFO shard-5 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.054932Z INFO shard-6 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055016Z INFO shard-2 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055093Z INFO shard-7 server::tcp::tcp_server: Initializing Iggy TCP server...
2026-08-01T04:24:10.055174Z INFO shard-1 server::tcp::tcp_server: Initializing Iggy TCP server...
thread 'shard-7' (6842997) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
note: run with
RUST_BACKTRACE=1environment variable to display a backtracethread 'shard-2' (6842992) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-1' (6842991) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-6' (6842996) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-4' (6842994) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-5' (6842995) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-3' (6842993) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.058132Z INFO shard-0 server::tcp::tcp_server: Initializing Iggy TCP server...
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063601Z ERROR shard-6 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 6: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063670Z ERROR shard-2 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 2: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063747Z ERROR shard-3 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 3: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063970Z ERROR shard-1 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 1: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.063990Z ERROR shard-7 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 7: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064011Z ERROR shard-5 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 5: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064121Z ERROR shard-4 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 4: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064219Z ERROR shard-0 server::shard::task_registry::registry: continuous 'tcp_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.064968Z ERROR shard-3 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 3, triggering shutdown for all shards
2026-08-01T04:24:10.064984Z ERROR shard-2 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 2, triggering shutdown for all shards
2026-08-01T04:24:10.065050Z ERROR shard-6 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 6, triggering shutdown for all shards
2026-08-01T04:24:10.065120Z ERROR shard-5 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 5, triggering shutdown for all shards
2026-08-01T04:24:10.065228Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.065293Z ERROR shard-1 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 1, triggering shutdown for all shards
2026-08-01T04:24:10.065410Z ERROR shard-4 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 4, triggering shutdown for all shards
2026-08-01T04:24:10.065487Z ERROR shard-7 server::shard::task_registry::registry: Critical task 'tcp_server' failed on shard 7, triggering shutdown for all shards
2026-08-01T04:24:10.067259Z INFO shard-5 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 5...
2026-08-01T04:24:10.067274Z INFO shard-1 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 1...
2026-08-01T04:24:10.067305Z INFO shard-2 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 2...
2026-08-01T04:24:10.067333Z INFO shard-6 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 6...
2026-08-01T04:24:10.067344Z INFO shard-4 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 4...
2026-08-01T04:24:10.067499Z INFO shard-3 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 3...
2026-08-01T04:24:10.067540Z INFO shard-7 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 7...
thread 'shard-5' (6842995) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-1' (6842991) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.068733Z INFO shard-0 server::shard::tasks::continuous::http_server: Starting HTTP server on shard: 0
thread 'shard-6' (6842996) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-2' (6842992) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-7' (6842997) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-3' (6842993) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
thread 'shard-4' (6842994) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.070906Z ERROR shard-7 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 7: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.070987Z ERROR shard-5 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 5: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071006Z WARN shard-0 server::http::http_server: JWT encoding and decoding secrets are not configured - generated a random secret: wcz***. JWT tokens will be invalidated on server restart. Set 'encoding_secret' and 'decoding_secret' in the config to use persistent secrets.
2026-08-01T04:24:10.071104Z ERROR shard-2 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 2: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071148Z ERROR shard-4 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 4: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071172Z ERROR shard-3 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 3: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071200Z ERROR shard-1 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 1: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071223Z ERROR shard-6 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 6: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.071570Z ERROR shard-7 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 7, triggering shutdown for all shards
2026-08-01T04:24:10.071655Z ERROR shard-5 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 5, triggering shutdown for all shards
2026-08-01T04:24:10.071753Z ERROR shard-4 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 4, triggering shutdown for all shards
2026-08-01T04:24:10.071808Z ERROR shard-2 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 2, triggering shutdown for all shards
2026-08-01T04:24:10.071840Z ERROR shard-1 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 1, triggering shutdown for all shards
2026-08-01T04:24:10.071885Z ERROR shard-3 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 3, triggering shutdown for all shards
2026-08-01T04:24:10.071926Z ERROR shard-6 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 6, triggering shutdown for all shards
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.079067Z ERROR shard-1 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079119Z ERROR shard-3 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079308Z ERROR shard-1 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079378Z ERROR shard-7 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079405Z ERROR shard-7 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079450Z ERROR shard-3 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079195Z ERROR shard-4 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079484Z ERROR shard-4 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079118Z ERROR shard-6 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079584Z ERROR shard-6 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079634Z ERROR shard-2 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079658Z ERROR shard-2 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079696Z ERROR shard-5 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.079717Z ERROR shard-5 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.083173Z WARN shard-7 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 7 in 5.71475ms
2026-08-01T04:24:10.083180Z WARN shard-3 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 3 in 5.327875ms
2026-08-01T04:24:10.083265Z WARN shard-1 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 1 in 5.924417ms
2026-08-01T04:24:10.083307Z WARN shard-2 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 2 in 5.568542ms
2026-08-01T04:24:10.083335Z WARN shard-6 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 6 in 5.091208ms
2026-08-01T04:24:10.083478Z WARN shard-4 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 4 in 6.164541ms
2026-08-01T04:24:10.083505Z WARN shard-5 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 5 in 6.283792ms
2026-08-01T04:24:10.084466Z INFO shard-1 iggy_server: Shard 1 run completed
2026-08-01T04:24:10.084487Z INFO shard-2 iggy_server: Shard 2 run completed
2026-08-01T04:24:10.084530Z INFO shard-4 iggy_server: Shard 4 run completed
2026-08-01T04:24:10.084552Z INFO shard-5 iggy_server: Shard 5 run completed
2026-08-01T04:24:10.084601Z INFO shard-3 iggy_server: Shard 3 run completed
2026-08-01T04:24:10.084713Z INFO shard-6 iggy_server: Shard 6 run completed
2026-08-01T04:24:10.084855Z INFO shard-7 iggy_server: Shard 7 run completed
2026-08-01T04:24:10.085890Z INFO main iggy_server: Shard 4 exited successfully
2026-08-01T04:24:10.085923Z INFO main iggy_server: Shard 3 exited successfully
2026-08-01T04:24:10.085937Z INFO main iggy_server: Shard 7 exited successfully
2026-08-01T04:24:10.085947Z INFO main iggy_server: Shard 5 exited successfully
2026-08-01T04:24:10.085959Z INFO main iggy_server: Shard 6 exited successfully
2026-08-01T04:24:10.086216Z INFO main iggy_server: Shard 1 exited successfully
2026-08-01T04:24:10.086347Z INFO main iggy_server: Shard 2 exited successfully
2026-08-01T04:24:10.086578Z ERROR shard-0 server::shard::task_registry::registry: continuous 'http_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.086923Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'http_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.088300Z INFO shard-0 server::quic::quic_server: Initializing Iggy QUIC server on shard 0 for address 127.0.0.1:8080
2026-08-01T04:24:10.090749Z INFO shard-0 server::quic::quic_server: Iggy QUIC server has started on: 127.0.0.1:8080
2026-08-01T04:24:10.090952Z INFO shard-0 server::websocket::websocket_server: Starting WebSocket server on: 127.0.0.1:8092 for shard: 0...
thread 'shard-0' (6842990) panicked at /Users/justinmclean/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/compio-driver-0.11.4/src/asyncify.rs:114:25:
the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.091072Z ERROR shard-0 server::shard::task_registry::registry: continuous 'websocket_server' panicked on shard 0: the thread pool is needed but no worker thread is running
2026-08-01T04:24:10.091093Z ERROR shard-0 server::shard::task_registry::registry: Critical task 'websocket_server' failed on shard 0, triggering shutdown for all shards
2026-08-01T04:24:10.091912Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'tcp_server' of kind Continuous failed: Error
2026-08-01T04:24:10.091941Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'http_server' of kind Continuous failed: Error
2026-08-01T04:24:10.091969Z ERROR shard-0 trace_shutdown: server::shard::task_registry::registry: task 'websocket_server' of kind Continuous failed: Error
2026-08-01T04:24:10.093384Z WARN shard-0 server::shard::tasks::oneshot::config_writer: config_writer: shutdown triggered before all servers bound, skipping config write
2026-08-01T04:24:10.094827Z WARN shard-0 trace_shutdown: server::shard::task_registry::registry: Graceful shutdown completed with failures on shard 0 in 2.944125ms
2026-08-01T04:24:10.094884Z INFO shard-0 iggy_server: Shard 0 run completed
2026-08-01T04:24:10.094997Z INFO main iggy_server: Shard 0 exited successfully
2026-08-01T04:24:10.095518Z INFO main iggy_server: All shards have shut down. Iggy server is exiting.
Iggy server config
Default config
Reproduction
On MacOS run:
cargo run --bin iggy-server -- --with-default-root-credentials --fresh
Contribution
Good first issue