-
Notifications
You must be signed in to change notification settings - Fork 11
SourcesAvro
Joseph Glanville edited this page Feb 11, 2019
·
8 revisions
The avro source accepts avro encoded events. This source will listen on both IPv4 and IPv6 TCP sockets with a configurable port.
Each accepted connection receives its own dedicated thread which:
- Decodes the given payload's header, ensuring the payload is valid Avro.
- Records the payload, as published, as metric::event::Raw types into Hopper queues for later processing.
-
enabled
:: whether the source is enabled [default: true] -
host
:: the hostname to accept connections on [default: localhost] -
port
:: the port for the source to listen on, both IPv4 and IPv6 [default: 2002] -
forwards
:: the filters and/or sinks to forward into [default: []]
The forward concept is described in detail here.
You may configure multiple avro sources.
[sources]
[sources.avro.primary]
enabled = true
port = 2002
forwards = []
[sources.avro.secondary]
enabled = true
port = 2003
forwards = []
[sources.avro.disabled]
enabled = false
port = 2004
forwards = []
Version prefixed headers control which publication features are available to a client.
The following versions are currently supported:
- pycernan.avro.Client (Python)
A Postmates Project
Tech Blog | Twitter @PostmatesDev | Jobs