Skip to content

[Examples] bulk/kafka #489

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Anaethelion merged 4 commits into from
May 2, 2022
Merged

[Examples] bulk/kafka #489

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a63e8d5
Update go dependencies
Anaethelion Apr 29, 2022
7db8636
Disable Elasticsearch security for kafka demo
Anaethelion Apr 29, 2022
46aca37
Remove apm-server for now, reintegrate with fleet later
Anaethelion May 2, 2022
89f83a3
Remove APM direct reference from readme
Anaethelion May 2, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 1 addition & 3 deletions _examples/bulk/kafka/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,7 @@ Then, launch the Kafka producers and consumers and the Elasticsearch indexer:
make run

Open the [_Kibana_ dashboard](http://localhost:5601/app/kibana#/dashboard/140b5490-5fce-11ea-a238-bf5970186390) to see
the results, the [_
Kibana_ APM application](http://localhost:5601/app/apm#/services/kafka/transactions?rangeFrom=now-15m&rangeTo=now&refreshPaused=true&refreshInterval=0&transactionType=indexing)
to see the indexer metrics, and [_Confluent Control Center_](http://localhost:9021/) to inspect the Kafka cluster and
the results and [_Confluent Control Center_](http://localhost:9021/) to inspect the Kafka cluster and
see details about the topic and performance of consumers.

See the [`producer/producer.go`](producer/producer.go) file for the Kafka
Expand Down
15 changes: 2 additions & 13 deletions _examples/bulk/kafka/docker-compose.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,8 @@ services:
- network.host=elasticsearch,_local_
- network.publish_host=elasticsearch
- bootstrap.memory_lock=true
- xpack.security.enabled=false
- xpack.security.http.ssl.enabled=false
- ES_JAVA_OPTS=-Xms${ES_MEMORY} -Xmx${ES_MEMORY}
ulimits: { nofile: { soft: 65535, hard: 65535 }, memlock: -1 }
healthcheck:
Expand All @@ -107,19 +109,6 @@ services:
healthcheck:
test: curl --max-time 120 --retry 120 --retry-delay 1 --show-error --silent http://localhost:5601

apm_server:
container_name: apm_server
image: docker.elastic.co/apm/apm-server:${ELASTIC_VERSION}
depends_on: [ 'elasticsearch', 'kibana' ]
command: -e --strict.perms=false
networks:
- elasticsearch
ports:
- 8200:8200
restart: on-failure
healthcheck:
test: curl --max-time 120 --retry 120 --retry-delay 1 --show-error --silent http://localhost:8200

networks:
kafka:
elasticsearch:
Expand Down
Loading