Skip to content

Latest commit

 

History

History
111 lines (61 loc) · 4.79 KB

io-connectors.adoc

File metadata and controls

111 lines (61 loc) · 4.79 KB
Raw

Luna Streaming IO connectors

When you have Luna Streaming installed and running, add IO connectors to connect your deployment to external systems like Apache Cassandra, ElasticSearch, and more.

This doc lists the connectors supported by Luna Streaming.

Sink Connectors

Sink connectors read messages from Pulsar topics and persist the messages to external systems.

The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.

DataStax enhanced Cassandra sink connector

To configure, deploy, and use the DataStax enhanced Cassandra sink connector, see the DataStax Pulsar connector documentation.

The DataStax enhanced Cassandra sink connector offers the following advantages over the OSS Pulsar Cassandra sink connector:

  • Flexibility in mapping Apache Pulsar™ messages to DSE and Cassandra tables.

  • Enterprise grade security support including built-in SSL, and LDAP integration.

  • Consumes all Apache Pulsar™ primitives including primitives, JSON and Avro formats.

  • Flexible time/date formatting.

  • Configurable consistency level.

  • Row-level Time-to-Live (TTL).

  • Distributed mode, high availability (HA) support.

  • Standalone mode support for development.

ElasticSearch sink

To configure, deploy, and use the ElasticSearch sink connector, see the Elasticsearch sink connector documentation.

JDBC-Clickhouse sink

To configure, deploy, and use the JDBC-Clickhouse sink connector, see the Pulsar documentation.

JDBC-MariaDB sink

To configure, deploy, and use the JDBC-MariaDB sink connector, see the Pulsar documentation.

JDBC-PostgreSQL sink

To configure, deploy, and use the JDBC-PostgreSQL connector, see the Pulsar documentation.

Kafka sink

To configure, deploy, and use the Kafka sink connector, see the Pulsar documentation.

Kinesis sink

To configure, deploy, and use the Kinesis sink connector, see the Pulsar documentation.

Source Connectors

Source connectors read messages from external topics and persist the messages to Pulsar topics.

The following sink connectors are included in the <luna-streaming-all> deployment and are supported by DataStax Luna Streaming.

Debezium MongoDB source

To configure, deploy, and use the Debezium MongoDB source connector, see the Pulsar documentation.

Debezium MySQL source

To configure, deploy, and use the Debezium MySQL source connector, see the Pulsar documentation.

Debezium Postgres source

To configure, deploy, and use the Debezium PostgreSQL source connector, see the Pulsar documentation.

Kafka source

To configure, deploy, and use the Kafka source connector, see the Pulsar documentation.

Kinesis source

To configure, deploy, and use the Kinesis source connector, see the Pulsar documentation.

What’s next?

For more on Pulsar IO connectors, see the Pulsar documentation.