a go daemon that syncs mongodb to elasticsearch in realtime
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docker new release Feb 12, 2019
monstachemap Attempt to handle relates of deleted docs. Allow overriding the _id of Jan 2, 2019
.dockerignore add module build Dec 4, 2018
.gitignore add swap files Nov 19, 2016
.travis.yml travis docker build test May 17, 2018
Dockerfile bump docker versions Jan 24, 2019
LICENSE fix golint warnings Sep 17, 2017
Makefile docker ideas May 5, 2018
README.md add go report card May 17, 2018
go.mod upgrade gtm Feb 14, 2019
go.sum upgrade gtm Feb 14, 2019
monstache.go normalize timestamp if it is seconds only Feb 14, 2019
monstache_test.go add tests May 16, 2018

README.md

monstache

a go daemon that syncs mongodb to elasticsearch in realtime

Build Status Go Report Card

Features

  • Supports up to and including the latest versions of Elasticsearch and MongoDB

  • Single binary with a light footprint

  • Optionally filter the set of collections to sync

  • Advanced support for sharded MongoDB clusters including auto-detection of new shards

  • Direct read mode to do a full sync of collections in addition to tailing the oplog

  • Transform and filter documents before indexing using Golang plugins or JavaScript

  • Index the content of GridFS files

  • Support for hard and soft deletes in MongoDB

  • Support for propogating database and collection drops

  • Optional custom document routing in Elasticsearch

  • Stateful resume feature

  • Worker and Clustering modes for High Availability

  • Support for rfc7396 JSON merge patches

  • Systemd support

  • Optional http server to get access to liveness, stats, etc

Documentation

See the monstache site for information on configuration and usage.