Skip to content

Latest commit

 

History

History
45 lines (33 loc) · 2.19 KB

datamon.md

File metadata and controls

45 lines (33 loc) · 2.19 KB
Raw

Version: dev

datamon

Datamon helps build ML pipelines

Synopsis

Datamon helps build ML pipelines by adding versioning, auditing and lineage tracking to cloud storage tools (e.g. Google GCS, AWS S3).

This is not a replacement for these tools, but rather a way to manage their inputs and outputs.

Datamon works by providing a git like interface to manage data efficiently: your data buckets are organized in repositories of versioned and tagged bundles of files.

Options

      --config string             Set the config backend store to use (bucket name: do not set the scheme, e.g. 'gs://')
      --context string            Set the context for datamon (default "dev")
      --force                     Forces upgrade even if the current version is not a released version
  -h, --help                      help for datamon
      --loglevel string           The logging level. Levels by increasing order of verbosity: none, error, warn, info, debug (default "info")
      --metrics                   Toggle telemetry and metrics collection
      --metrics-password string   Password to connect to the metrics collector backend. Overrides any password set in URL
      --metrics-url string        Fully qualified URL to an influxdb metrics collector, with optional user and password
      --metrics-user string       User to connect to the metrics collector backend. Overrides any user set in URL
      --upgrade                   Upgrades the current version then carries on with the specified command

SEE ALSO