Skip to content

gekatateam/neptunus

Repository files navigation

Neptunus

Neptunus is a data processing engine for consuming, transforming and producing events. Originally conceived as a central unit of a mediation platform, Neptunus may:

  • receive data from a number of different sources, either from message brokers or by acting as a server
  • manage event streams based on filtering rules
  • transform, enrich and create new events
  • deliver events to consumers in various formats and protocols

Neptunus is based on data processing pipelines - a compositions of six types of plugins:

  • Inputs consume events from external sources
  • Processors transform events
  • Outputs produce events to external systems
  • Filters route events in pipeline by conditions
  • Parsers convert raw data into events
  • Serializers convert events into data formats for external systems

Configuration

Neptunus configuration has two parts - daemon config and pipelines.

See more in our documentation.

Getting Started

Get help:

neptunus --help

Run daemon:

neptunus run --config config.toml

Test pipelines configuration:

neptunus test --config config.toml

Get help about cli tool usage:

neptunus pipeline --help