What's Changed
- runtime: periodically store primary FSMHints of V2 shards by @williamhbaker in #3027
- mise build:flowctl for a local flowctl binary by @mdibaiee in #3031
- go.mod: bump gazette to latest by @williamhbaker in #3033
- data-plane-controller: dns and s3 passthroughs by @qaoj in #3022
- Self-service private-link configuration by @jshearer in #2944
- supabase: scoped refresh tokens so CI writes via PostgREST instead of direct psql by @skord in #3013
- docs: Describe SQL Server replica suport by @willdonnelly in #3040
- proto-gazette: regenerate to pick up SUSPEND_KEEP by @williamhbaker in #3041
- docs: correct custom-column-types backfill behavior for DDL changes by @jwhartley in #3036
- Refresh token GraphQL operations and token exchange endpoint by @GregorShear in #3020
- docs: shopify stream & resource config additions by @Alex-Bair in #3034
- validation/collection: exclude
flow://inferred-schemafrom the managed-defs redact check by @jshearer in #3046 - docs: update Bigtable connector permissions example by @mwillman-estuary in #3045
- docs: disable auto-discover for multi-binding file source captures by @jwhartley in #3037
- docs: add streams and API pinning details to stripe-native by @nicolaslazo in #3055
- data-plane-controller: restart setting by @qaoj in #3048
- deploy: route control-plane services through the VPC NAT for a stable egress IP by @skord in #3044
- docs: document the Exclude Flow Document (no_flow_document) materialization option by @jwhartley in #3018
- oidc-discovery-server: survive direct VPC egress cold-start on deploy by @skord in #3062
- docs: clarify retain_existing_data_on_backfill requires allow_existing_tables_for_new_bindings by @jwhartley in #3049
- data-plane-controller: restart on ansiblehost by @qaoj in #3066
- flow-web: Bump version to release by @jshearer in #3068
- ops-catalog: misc updates by @williamhbaker in #3067
- proto-flow: tolerate unknown JSON fields in connector protocols by @williamhbaker in #3059
- flowctl: add raw split-shards to scale out V2 tasks by @williamhbaker in #3021
- supabase: qualify replace_data_plane_releases DELETE for PostgREST by @skord in #3076
- docs: kcat recipes for testing a Dekaf topic by @jwhartley in #3072
- Docs: document per-prefix alert scoping and configurable thresholds by @jwhartley in #3039
- notifications: trial bucket retention is 20 days, not 30 by @jwhartley in #3074
- runtime/container: use ops::decode::Decoder for log lines by @williamhbaker in #3091
- data-plane-controller: remove restart flag by @qaoj in #3087
- runtime-next: durably seed initial connector state as {} to match V1 by @williamhbaker in #3081
- runtime-next: don't abandon the final capture transaction on connector EOF by @jgraettinger in #3090
- Docs: Remove an IP address from GCP allowed list by @jwhartley in #3080
- docs: remove static data plane IP list, reference dashboard by @jwhartley in #3097
- dekaf: improve logging by @williamhbaker in #3078
- agent: make startup logging consistent by @williamhbaker in #3098
- shuffle: make the shuffle disk limit configurable per-task by @jgraettinger in #3096
- runtime-next: automatically split journals under sustained append-rate throttling by @dgreer-dev in #3029
- billing: add tenant billing contact fields and per-tenant controller by @jshearer in #2902
- flowctl-go(api test): raise test-shard readiness window from ~3s to ~30s by @jshearer in #3101
- runtime: strip the V2 committed-close marker for derivations by @williamhbaker in #3100
- deps: bump aws-lc-sys and lz4_flex for security advisories by @skord in #2875
- data-plane-controller: fix db timeout by @qaoj in #3105
- agent-api: survive direct VPC egress cold-start on instance startup by @skord in #3109
- docs: avoiding backfills during a database failover or host change by @jwhartley in #3086
- docs: clarify column-level SELECT grants unsupported for MySQL/MariaDB CDC by @jwhartley in #3085
- json: require RFC3339 'T' separator in date-time format validator by @jacobmarble in #3116
- control-plane: reserve privileged tenant names by @jwhartley in #3083
- agent-api: harden startup and shutdown on Cloud Run by @skord in #3114
- Incidental fixes: gazette Append retry, connector-init image, materialize tear-down by @jgraettinger in #3121
- agent: flag to create new captures as runtime-v2 by @williamhbaker in #3107
- runtime-next: add minimum interval for post-txn triggers by @dgreer-dev in #3110
- flowctl: chunk API requests by url size rather than fixed count by @mdibaiee in #3123
- dekaf: use projection_constraints only, no constraints by @mdibaiee in #3124
- flowctl: normalize --prefix trailing slash to avoid misleading PermissionDenied by @GregorShear in #3075
- docs: retain_existing_data_on_backfill no longer requires allow_existing_tables_for_new_bindings by @jwhartley in #3125
- Restart Materializations sessions before IAM token expiry by @dgreer-dev in #3130
- docs: add "bring your own app" instructions for source-quickbooks by @nicolaslazo in #3135
- flowctl: re-tool
previewon the runtime-next stack by @jgraettinger in #3117 - Adding support for updating the quotas when payment info changes by @bbartman in #3127
- control-plane-api: add unauthenticated publicDataPlanes GraphQL query by @GregorShear in #3129
- go/bindings: update snapshots for materialize-sqlite ser_policy by @dgreer-dev in #3142
- Revert "flowctl: replace
previewwith the runtime-next implementation" by @jgraettinger in #3141 - local: per-checkout stacks — every checkout runs its own isolated stack by @jgraettinger in #3137
- dekaf: log tls handshake eof instead of returning as error by @danielnelson in #3143
- Updating migrations to better support testing. by @bbartman in #3146
- shuffle: raise causal-hint stall timeout to 15m; lower prune horizon to 2GB by @jgraettinger in #3148
- ci: fix Platform Build by packaging Go binaries from per-checkout $GOBIN by @jgraettinger in #3149
- capture+materialize: Support Nonsensitive Field Overlays by @willdonnelly in #3119
- Docs: The Great Description-ing by @aeluce in #3057
- runtime: fix recursive read-lock deadlock in capture-v2 buildJoin by @jgraettinger in #3156
- validation: surface write-schema redact annotations on projections of split-schema collections by @GregorShear in #3147
- control-plane-api: retry Stripe customer search on index-lag misses by @jgraettinger in #3157
- flowctl: multi-shard --fixture for raw preview-next by @mdibaiee in #3154
- dekaf: prevent cached
TimeoutNoDatafetch responses from incorrectly signaling EOF by @jshearer in #3153 - mise: remove Lima VM host share and other VM tweaks by @jgraettinger in #3163
- docs: document connecting Azure Private Link to native Azure resources by @jwhartley in #3138
- docs: explain why exclusiveCollectionFilter needs few enabled bindings by @jwhartley in #3126
New Contributors
Full Changelog: v0.6.10...v0.6.11