Skip to content
Permalink
Browse files
AWS2-Examples: Moved to 0.6.1
  • Loading branch information
oscerd committed Dec 3, 2020
1 parent 62efdc4 commit 551d775c2b1ad871b065d62d5e779db5ccad8399
Show file tree
Hide file tree
Showing 15 changed files with 80 additions and 80 deletions.
@@ -24,8 +24,8 @@ Download the connector package zip and extract the content to a directory. In th
[source]
----
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.0/camel-aws2-iam-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.1/camel-aws2-iam-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.1-package.zip
----

=== Configuring Kafka Connect
@@ -24,8 +24,8 @@ Download the connector package zip and extract the content to a directory. In th
[source]
----
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.0/camel-aws2-iam-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.1/camel-aws2-iam-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.1-package.zip
----

=== Configuring Kafka Connect
@@ -25,8 +25,8 @@ Download the connector package zip and extract the content to a directory. In th
[source]
----
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.0/camel-aws2-iam-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.1/camel-aws2-iam-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.1-package.zip
----

=== Configuring Kafka Connect
@@ -25,8 +25,8 @@ Download the connector package zip and extract the content to a directory. In th
[source]
----
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.0/camel-aws2-iam-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-iam-kafka-connector/0.6.1/camel-aws2-iam-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-iam-kafka-connector-0.6.1-package.zip
----

=== Configuring Kafka Connect
@@ -30,8 +30,8 @@ In this example we'll use `/home/oscerd/connectors/`

```
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-kinesis-firehose-kafka-connector/0.6.0/camel-aws2-kinesis-firehose-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-kinesis-firehose-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-kinesis-firehose-kafka-connector/0.6.1/camel-aws2-kinesis-firehose-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-kinesis-firehose-kafka-connector-0.6.1-package.zip
```

On AWS console create a Kinesis firehose delivery stream named firehose-stream and choose to send it to an S3 bucket from the available list (in the same region)
@@ -146,8 +146,8 @@ So we need to do something like this:

```
> cd my-connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-kinesis-firehose-kafka-connector/0.6.0/camel-aws2-kinesis-firehose-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-kinesis-firehose-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-kinesis-firehose-kafka-connector/0.6.1/camel-aws2-kinesis-firehose-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-kinesis-firehose-kafka-connector-0.6.1-package.zip
```

Now we can start the build
@@ -172,7 +172,7 @@ You should see something like this:

[source,json,options="nowrap"]
----
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2kinesisfirehose.CamelAws2kinesisfirehoseSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2kinesisfirehose.CamelAws2kinesisfirehoseSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
----

### Set the AWS credential as secret (optional)
@@ -29,8 +29,8 @@ In this example we'll use `/home/oscerd/connectors/`

```
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-lambda-kafka-connector/0.6.0/camel-aws2-lambda-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-sns-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-lambda-kafka-connector/0.6.1/camel-aws2-lambda-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-sns-kafka-connector-0.6.1-package.zip
```

### Deploying the AWS Lambda function
@@ -161,8 +161,8 @@ So we need to do something like this:

```
> cd my-connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-lambda-kafka-connector/0.6.0/camel-aws2-lambda-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-lambda-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-lambda-kafka-connector/0.6.1/camel-aws2-lambda-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-lambda-kafka-connector-0.6.1-package.zip
```

Now we can start the build
@@ -187,7 +187,7 @@ You should see something like this:

[source,json,options="nowrap"]
----
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2lambda.CamelAws2lambdaSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2lambda.CamelAws2lambdaSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
----

### Set the AWS credential as secret (optional)
@@ -29,8 +29,8 @@ In this example we'll use `/home/oscerd/connectors/`

```
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.0/camel-aws2-s3-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.1/camel-aws2-s3-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.1-package.zip
```

Now we need to setup a MinIO instance
@@ -28,8 +28,8 @@ In this example we'll use `/home/oscerd/connectors/`

```
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.0/camel-aws2-s3-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.1/camel-aws2-s3-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.1-package.zip
```

Now it's time to setup the connectors
@@ -145,8 +145,8 @@ So we need to do something like this:

```
> cd my-connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.0/camel-aws2-s3-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.1/camel-aws2-s3-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.1-package.zip
```

Now we can start the build
@@ -171,7 +171,7 @@ You should see something like this:

[source,json,options="nowrap"]
----
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
----

### Set the AWS credential as secret (optional)
@@ -28,8 +28,8 @@ In this example we'll use `/home/oscerd/connectors/`

```
> cd /home/oscerd/connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.0/camel-aws2-s3-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.1/camel-aws2-s3-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.1-package.zip
```

Now it's time to setup the connectors
@@ -157,8 +157,8 @@ So we need to do something like this:

```
> cd my-connectors/
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.0/camel-aws2-s3-kafka-connector-0.6.0-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.0-package.zip
> wget https://repo1.maven.org/maven2/org/apache/camel/kafkaconnector/camel-aws2-s3-kafka-connector/0.6.1/camel-aws2-s3-kafka-connector-0.6.1-package.zip
> unzip camel-aws2-s3-kafka-connector-0.6.1-package.zip
```

Now we can start the build
@@ -183,7 +183,7 @@ You should see something like this:

[source,json,options="nowrap"]
----
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector","type":"sink","version":"0.6.0"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector","type":"source","version":"0.6.0"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
[{"class":"org.apache.camel.kafkaconnector.CamelSinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.CamelSourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector","type":"sink","version":"0.6.1"},{"class":"org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SourceConnector","type":"source","version":"0.6.1"},{"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"2.5.0"},{"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"2.5.0"},{"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},{"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}]
----

### Set the AWS credential as secret (optional)

0 comments on commit 551d775

Please sign in to comment.