Repository navigation
v0.11.0
One Go binary, blobs, replaces api-service and the substreams-sink-kv deployment it read from. It writes the map_blobs output to an object store and serves the Beacon blob endpoints from there. Image: ghcr.io/pinax-network/eth-blobs:v0.11.0.
| Command | Does |
|---|---|
blobs sink <endpoint> <spkg> [<start>:<stop>] |
streams map_blobs into the store and handles every reorg itself |
blobs api --config config.yaml |
serves /eth/v1/beacon/blob_sidecars/{block_id}, /eth/v1/beacon/blobs/{block_id} and /health; same routes and responses as api-service |
blobs migrate-kv <kv-serve-addr> [<from>:<to>] |
copies history out of a running substreams-sink-kv serve |
The store is a dstore URL (--store-url, store.url): S3-compatible endpoints (Ceph RGW, MinIO), AWS S3, GCS, Azure (prefix required) or a local directory. Credentials come from each backend's standard environment. See blobs/README.md for the object layout and AGENTS.md for the invariants.
Breaking changes
api-service/is gone. The image's entrypoint is now/app/blobsand takes a subcommand (api,sinkormigrate-kv); the old/app/blob-serviceentrypoint no longer exists.- API config:
sink.addressis replaced bystore.url(plus optionalstore.timeoutandstore.head_ttl).application.grpc_hostis removed; that gRPC server only exposed health and reflection. - The Go module is
github.com/pinax-network/blob-service/blobs.
Migrating an existing deployment
- Run
blobs migrate-kvagainst the existingsubstreams-sink-kv serveto copy history into the store. It is rerunnable: slots already present are skipped and their root index checked, and every KV read and store operation is retried (--retries, default 8). - Start
blobs sinkwith a start block of the migrated range's end + 1, one writer id per sink. - Point
blobs apiat the same store.
Also in this release
HexBytesis encoded straight into the JSON output: about 18% less CPU and 2.5× fewer allocated bytes on fullblob_sidecarsresponses.- Slot objects are zstd-compressed (
slots/<slot>.pb.zst), about 20% smaller on mainnet. - Every sink store write (batch, head, cursor, undo deletes) is retried with backoff before the sink exits.
- For
s3://URLs the SDK computes and validates checksums only when required, which S3-compatible servers need.
The Substreams package is unchanged: eth-blobs-v0.10.0.spkg remains current.