No description, website, or topics provided.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
Godeps switch back to Shopifys fixed sarama, simplify the failure handling w… Jul 9, 2014
.gitignore
LICENSE reformat May 4, 2015
deliver.go switch back to Shopifys fixed sarama, simplify the failure handling w… Jul 9, 2014
deliver_test.go use sclasen fork of sarama May 21, 2014
event-shuttle.go cleanup May 30, 2014
exhibitor.go cleanup May 30, 2014
exhibitor_test.go cleanup May 30, 2014
http.go cleanup May 30, 2014
readme.md usage Jul 9, 2014
store.go remove unused code Jul 9, 2014
store_test.go update readme, use proper methods for getting writePointer in tests May 21, 2014

readme.md

event-shuttle

goal: unix system service that collects events and reliably delivers them to kafka, relieving other services on the same system from having to do so.

journals events through bolt-db so that in the event of an kafka outage, events can still be accepted, and will be delivered when kafka becomes available.

  • listens on 127.0.0.1:3887, rest-api is POST /:topic -d message
  • journals events to bolt db.
  • discovers brokers via netflix exhibitor, or a seed broker list.
  • delivers events to kafka.
 event-shuttle --help
Usage of event-shuttle:
  -brokers="": comma seperated list of ip:port to use as seed brokers
  -db="events.db": name of the boltdb database file
  -debug=false: start a pprof http server on 6060
  -exhibitor=false: use EXHIBITOR_URL from env to lookup seed brokers
  -port="3887": port on which to listen for events

using a broker list

event-shuttle -brokers 1.2.3.4:9092,1.2.3.5:9092

using netflix exhibitor to find brokers

EXHIBITOR_URL=<some httpsUrl with creds> event-shuttle -exhibitor=true