kilebeat

filebeat in java using AKKA

For the first release with support only two connector

• generic http POST
• kafka

We also support stop and resume of endpoint connector (losing all messages in the period when server connector's was down). Before considering a failed connection, up to 3 tests are performed (it will become a configuration).

Example configuration and usage:

exports = [
    {
        path = "/Users/power/Tmp/a" 		
        http {
            url = "http://localhost:55555/testA"
        }
    }
    {
        path = "/Users/power/Tmp/*.log"
        http {
            url = "http://localhost:55555/log"
        }
    }
    {
        path = "/Users/power/Tmp/q"        
        kafka {
            host = "localhost:44444"
            queue = "testQ"
        }
    }
]

Any export Object should contain some behaviour config

bulk {
	size = X (number of in memory lines) (mandatory)
	timeout = Y (number of in seconds before is forced to send messages to connectors) (optional)
}

send-if-match = "^\\d.*" (it's clear)

send-if-not-match = ".*[1-9].*"	(it's clear)

An example of json sent to the connector is

{ "line":"test 123", "ts":1511043044203, "path":"/Users/power/Tmp/9cd29f449df8192c2d0de449e1e7583f" }