Skip to content

v0.11.0

Choose a tag to compare

@YaroShkvorets YaroShkvorets released this 09 Nov 19:00
· 2 commits to main since this release
d619c94

One Go binary, blobs, replaces api-service and the substreams-sink-kv deployment it read from. It writes the map_blobs output to an object store and serves the Beacon blob endpoints from there. Image: ghcr.io/pinax-network/eth-blobs:v0.11.0.

Command Does
blobs sink <endpoint> <spkg> [<start>:<stop>] streams map_blobs into the store and handles every reorg itself
blobs api --config config.yaml serves /eth/v1/beacon/blob_sidecars/{block_id}, /eth/v1/beacon/blobs/{block_id} and /health; same routes and responses as api-service
blobs migrate-kv <kv-serve-addr> [<from>:<to>] copies history out of a running substreams-sink-kv serve

The store is a dstore URL (--store-url, store.url): S3-compatible endpoints (Ceph RGW, MinIO), AWS S3, GCS, Azure (prefix required) or a local directory. Credentials come from each backend's standard environment. See blobs/README.md for the object layout and AGENTS.md for the invariants.

Breaking changes

  • api-service/ is gone. The image's entrypoint is now /app/blobs and takes a subcommand (api, sink or migrate-kv); the old /app/blob-service entrypoint no longer exists.
  • API config: sink.address is replaced by store.url (plus optional store.timeout and store.head_ttl). application.grpc_host is removed; that gRPC server only exposed health and reflection.
  • The Go module is github.com/pinax-network/blob-service/blobs.

Migrating an existing deployment

  1. Run blobs migrate-kv against the existing substreams-sink-kv serve to copy history into the store. It is rerunnable: slots already present are skipped and their root index checked, and every KV read and store operation is retried (--retries, default 8).
  2. Start blobs sink with a start block of the migrated range's end + 1, one writer id per sink.
  3. Point blobs api at the same store.

Also in this release

  • HexBytes is encoded straight into the JSON output: about 18% less CPU and 2.5× fewer allocated bytes on full blob_sidecars responses.
  • Slot objects are zstd-compressed (slots/<slot>.pb.zst), about 20% smaller on mainnet.
  • Every sink store write (batch, head, cursor, undo deletes) is retried with backoff before the sink exits.
  • For s3:// URLs the SDK computes and validates checksums only when required, which S3-compatible servers need.

The Substreams package is unchanged: eth-blobs-v0.10.0.spkg remains current.