We want to create an Azure VNet peered to a CC cluster and interact with it.
- Create a Confluent Cloud Network on Azure
- Use the Azure portal to create a virtual network
- Use VNet Peering on Azure
- Create a dedicated CC cluster in the created network
We try to create a topic from a local (not-peered) network via
kafka-topics
command
kafka-topics --bootstrap-server <cc-bootstrap-server> --create --topic test --command-config client.properties
- Confluent CLI
confluent kafka topic create test
Both are not working and fail with a timeout exception.
We first create a virtual machine in the above created Azure virtual network (be aware that they both need to be in the same region). We connect into the VM using SSH (how to is well explained in the Azure portal).
We need to download and install
- Confluent CLI
- Confluent Platform
- Java
We can now create a topic in the CLI and produce/consume messages via
kafka-console-producer --bootstrap-server <cc-bootstrap-server> --producer.config client.properties --topic test
kafka-console-consumer --bootstrap-server <cc-bootstrap-server> --consumer.config client.properties --topic test --from-beginning