Skip to content

v0.1.4

Choose a tag to compare

View all tags
@rahulv8 rahulv8 released this 21 Sep 19:27
· 7 commits to main since this release
v0.1.4
dd78a83
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Everything since v0.1.3: a one-command Kubernetes installer, a multi-arch chart, and a round of change-data-capture, security and interface fixes. Images are published for linux/amd64 and linux/arm64.

Install

Docker (Compose)

curl -sSL https://raw.githubusercontent.com/rsync-ai/rsync/v0.1.4/install.sh | bash

Kubernetes (Helm) — one command; it sizes the install to your cluster:

curl -sSL https://raw.githubusercontent.com/rsync-ai/rsync/v0.1.4/install-k8s.sh | RSYNC_CHART_VERSION=0.1.4 bash

The chart is also available directly: helm pull oci://ghcr.io/rsync-ai/charts/rsync-ai --version 0.1.4. install-k8s.sh at this tag still defaults to chart 0.1.3, so pass RSYNC_CHART_VERSION=0.1.4 as above; the next commit on main moves that default.

What changed

Kubernetes

  • One-command installer (install-k8s.sh) that fits the cluster it lands on, waits for a
    slow image pull instead of failing, and keeps Kafka Connect credentials across a pod
    restart. The chart's default image tag is multi-arch (amd64 and arm64).

Change data capture

  • Auto-pickup: a new source table joins a running "whole database" CDC pipeline.
  • MongoDB: a stalled source now fails loudly instead of reporting healthy; the heartbeat
    topic is named with the key Debezium reads; editing a pipeline's tables updates
    collection.include.list; a standalone mongod is refused before start_sync; MongoDB
    CDC/streaming runs that carry an enabled mask_pii are refused.
  • Fixes for wrong row counts, counters that reset on restart, and cooldowns that never blocked.
  • The assessor warns about PostgreSQL tables without a primary key that sit outside a CDC pipeline.

Connections and storage

  • A Scope step, server-level MySQL, MongoDB and ClickHouse connections, multi-database CDC and
    mirror mapping; namespace listing (GET /connections/:id/namespaces).
  • Table discovery lists up to 5000 tables with totals.
  • Object-storage layout v2 for GCS, S3 and Azure Blob (no pipeline id in the path).
  • Deleting a pipeline closes six cleanup gaps and no longer un-owns destination data.

Security

  • Plain-http OAuth token endpoints are refused for Kafka in all four runtimes.
  • The connector deploy gate fails closed when ENVIRONMENT is unset; MongoDB URI aliases are masked.
  • Compose Kafka Connect honours KAFKA_* security settings.

Interface

  • Monitoring Overview shows freshness, backlog, Kafka lag and failures; the pipeline page has an
    Assessment tab; Activity replaces Trace and Live events; Data flow reads top-down.
  • Explorer: a model page shows its lineage graph, its schedule in words and who runs it.
  • Stage durations come from one formatter, so a single transition no longer reads as a retry.

Removed

  • The bundled observability-backend stack. Telemetry still exports over OTLP to whichever
    collector you configure; the seeded sentinel_config keys are now backend-neutral
    (migration 100).
Assets 5
Loading