Flowgen

Flowgen is a configuration-based data activation workflow application written in Rust.

Overview

Flowgen executes data activation workflows defined in YAML configuration files. A flow consists of sequential tasks with support for error handling and retries. The system supports integrations with object stores, HTTP APIs, Salesforce, and other data sources.

Deployment

Kubernetes

Install using Helm:

helm repo add connve https://helm.connve.com
helm repo update
helm install flowgen connve/flowgen --namespace flowgen --create-namespace

Chart configuration options are documented in charts/flowgen/values.yaml.

Docker

docker pull ghcr.io/connve-labs/flowgen:latest

docker run \
  -v $(pwd)/config.yaml:/etc/app/config.yaml \
  -v $(pwd)/flows:/etc/app/flows \
  ghcr.io/connve-labs/flowgen:latest

Local Development

1. Copy config.example.yaml to config.yaml and configure as needed
2. Create flow definitions in the flows directory
3. Update the flow path in config.yaml
4. Run with cargo run

Configuration

• config.yaml: Application configuration
• Flow files: YAML files defining workflow tasks

See config.example.yaml for configuration reference.

Examples

Example flow configurations are available in the examples/ directory.

License

Licensed under the Mozilla Public License 2.0.