Test suite for Kafka Connect connectors based on Landoop's Coyote and docker.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
fast-data-demo fast-data-demo: fix influxdb and rethink-source connectors Jan 21, 2018
helpers Update helper script to also provide results in a JSON file (new capa… Mar 10, 2017
kafka-connect-blockchain Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-cassandra Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-coap Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-couchbase couchbase test: quote pipe key.separator to fix yml parsing by avro c… Sep 6, 2018
kafka-connect-dbvisitreplicate Revert "there is more that needs to be done for ftp, check mqtt coyot… May 31, 2018
kafka-connect-elastic Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-elastic5 Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-elastic6 elastic6: add test for HTTP port of ES (in addition to transport port… Sep 18, 2018
kafka-connect-elasticsearch Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-hazelcast Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-hbase Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-hdfs Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-influxdb Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-jms Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-kudu Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-mongodb Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-mqtt kafka-connect-mqtt: adjust kafka-console-consumer for Kafka 2.0 Aug 27, 2018
kafka-connect-pulsar Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-redis Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-rethink Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-voltdb Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
kafka-connect-yahoo Add a command to build fast-data-dev build info on all tests so we ca… May 15, 2018
.gitignore Add helper script to run test from jenkins and provide jenkins job re… Oct 7, 2016
LICENSE Add business source license. Oct 10, 2016
README.md Add link to most recent test reports. Oct 10, 2016

README.md

Kafka Connectors Tests

An independent set of tests for various Kafka Connect connectors.

Most recent test reports are available at https://coyote.landoop.com/connect/


Introduction

We setup and test various connectors in a pragmatic environment. That is we spawn at least a broker, a zookeeper instance, a schema registry, a connect distributed instance and any other software needed (e.g elasticsearch, redis, cassandra) in docker containers and then perform tests using standard tools. This practice permits us to verify that a connector does work, as well as provide a basic example of how to setup and test it. Advanced tests verify how the connector performs in special cases.

To achieve this we use our in-house developed —open source— tools coupled with docker-compose. The main testing tool is Coyote, which takes yml files describing the test process and performs each step logging output, errors and other information. Our fast-data-dev docker image is used as a reference Confluent Platform installation.

Run the tests

To run the tests on your computer you need coyote, docker and docker-compose. You can grab coyote from our release page or built it yourself via go get github.com/landoop/coyote. For the installation of docker and docker-compose we will have to refer you to docker's and docker-compose's documentation.

Once you install all the tools, just enter into a test directory and run:

coyote

Wait a few minutes for coyote to finish and it will produce a coyote.html file with the test's report. Coyote uses its exit code to indicate the numbers of tests that failed, thus an error code from coyote doesn't usually show a problem into coyote itself.