Ratings not flowing - how to start? #131

surfdog · 2020-07-14T20:35:41Z

Working through the demo script at: https://github.com/confluentinc/demo-scene/blob/master/build-a-streaming-pipeline/demo_build-a-streaming-pipeline.adoc

=============
Waiting for Kafka Connect to start listening on localhost ⏳
=============

Tue Jul 14 13:30:10 PDT 2020 

--------------
\o/ Kafka Connect is ready! Listener HTTP state:  200 

curl -s localhost:8083/connector-plugins|jq '.[].class'|egrep 'DatagenConnector|MySqlConnector|ElasticsearchSinkConnector'

"io.confluent.connect.elasticsearch.ElasticsearchSinkConnector"
"io.confluent.kafka.connect.datagen.DatagenConnector"
"io.debezium.connector.mysql.MySqlConnector"

ksql> SHOW TOPICS;

 Kafka Topic                           | Partitions | Partition Replicas 
-------------------------------------------------------------------------
 confluent_rmoff_01ksql_processing_log | 1          | 1                  
 ratings                               | 1          | 1                  
-------------------------------------------------------------------------
ksql> 

ksql> CREATE SINK CONNECTOR SINK_ES_RATINGS WITH (
>    'connector.class' = 'io.confluent.connect.elasticsearch.ElasticsearchSinkConnector',
>    'topics'          = 'ratings',
>    'connection.url'  = 'http://elasticsearch:9200',
>    'type.name'       = '_doc',
>    'key.ignore'      = 'false',
>    'schema.ignore'   = 'true',
>    'transforms'= 'ExtractTimestamp',
>    'transforms.ExtractTimestamp.type'= 'org.apache.kafka.connect.transforms.InsertField$Value',
>    'transforms.ExtractTimestamp.timestamp.field' = 'RATING_TS'
>);

 Error                                                    
----------------------------------------------------------
 {
  "error_code" : 409,
  "message" : "Connector SINK_ES_RATINGS already exists"
} 
----------------------------------------------------------
ksql>

Print ratings just sits there....

ksql> PRINT 'ratings';

Press CTRL-C to interrupt

The text was updated successfully, but these errors were encountered:

rmoff · 2020-07-14T20:43:42Z

What's the output of SHOW CONNECTORS;?

surfdog · 2020-07-14T20:54:26Z

SHOW CONNECTORS;

 Connector Name    | Type   | Class                                                         | Status                      
--------------------------------------------------------------------------------
 source-datagen-01 | SOURCE | io.confluent.kafka.connect.datagen.DatagenConnector           | WARNING (0/1 tasks RUNNING) 
 SINK_ES_RATINGS   | SINK   | io.confluent.connect.elasticsearch.ElasticsearchSinkConnector | RUNNING (1/1 tasks RUNNING) 
--------------------------------------------------------------------------------
ksql>

rmoff · 2020-07-14T20:57:51Z

If you run docker logs kafka-connect-01 you'll get the output from the Kafka Connect worker log. In this, have a look for the ERROR that shows why the connector has failed. Can you post that here.

surfdog · 2020-07-14T21:02:35Z

Two files- log output + grep for error.
robin.txt
robin_ERROR.txt

surfdog · 2020-07-14T21:04:27Z

docker-compose ps
      Name                    Command                  State                     Ports              
----------------------------------------------------------------------------------------------------
elasticsearch      /usr/local/bin/docker-entr ...   Up             0.0.0.0:9200->9200/tcp, 9300/tcp 
kafka              bash -c echo '127.0.0.1 ka ...   Up             0.0.0.0:9092->9092/tcp           
kafka-connect-01   bash -c # Nasty hack for E ...   Up (healthy)   0.0.0.0:8083->8083/tcp, 9092/tcp 
kafkacat           /bin/sh -c apk add jq;           Up                                              
                   wh ...                                                                           
kibana             /usr/local/bin/dumb-init - ...   Up             0.0.0.0:5601->5601/tcp           
ksqldb             /usr/bin/docker/run              Up             0.0.0.0:8088->8088/tcp           
mysql              docker-entrypoint.sh bash  ...   Up             0.0.0.0:3306->3306/tcp, 33060/tcp
schema-registry    /etc/confluent/docker/run        Exit 1           // this doesn't look good <<<<<========                               
zookeeper          /etc/confluent/docker/run        Up             2181/tcp, 2888/tcp, 3888/tcp     
A11981IT:build-a-streaming-pipeline mtibbitts$

surfdog · 2020-07-14T21:06:29Z

 docker logs schema-registry
===> ENV Variables ...
ALLOW_UNSIGNED=false
COMPONENT=schema-registry
CONFLUENT_DEB_VERSION=1
CONFLUENT_PLATFORM_LABEL=
CONFLUENT_VERSION=5.5.0
CUB_CLASSPATH=/etc/confluent/docker/docker-utils.jar
HOME=/root
HOSTNAME=d6baab48bc72
KAFKA_VERSION=
LANG=C.UTF-8
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PWD=/
PYTHON_PIP_VERSION=8.1.2
PYTHON_VERSION=2.7.9-1
SCALA_VERSION=2.12
SCHEMA_REGISTRY_HOST_NAME=schema-registry
SCHEMA_REGISTRY_KAFKASTORE_CONNECTION_URL=zookeeper:2181
SHLVL=1
ZULU_OPENJDK_VERSION=8=8.38.0.13
_=/usr/bin/env
===> User
uid=0(root) gid=0(root) groups=0(root)
===> Configuring ...
===> Running preflight checks ... 
===> Check if Zookeeper is healthy ...
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=d6baab48bc72
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_212
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Azul Systems, Inc.
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/zulu-8-amd64/jre
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/etc/confluent/docker/docker-utils.jar
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.19.76-linuxkit
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=117MB
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=1771MB
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=121MB
[main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=zookeeper:2181 sessionTimeout=40000 watcher=io.confluent.admin.utils.ZookeeperConnectionWatcher@cc34f4d
[main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
[main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
[main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper/172.18.0.3:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket error occurred: zookeeper/172.18.0.3:2181: Connection refused
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper/172.18.0.3:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket error occurred: zookeeper/172.18.0.3:2181: Connection refused
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper/172.18.0.3:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /172.18.0.7:35390, server: zookeeper/172.18.0.3:2181
[main] ERROR io.confluent.admin.utils.ClusterStatus - Timed out waiting for connection to Zookeeper server [zookeeper:2181].
[main-SendThread(zookeeper:2181)] WARN org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 40005ms for sessionid 0x0
[main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x0
[main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x0 closed
A11981IT:build-a-streaming-pipeline mtibbitts$

surfdog · 2020-07-14T21:30:37Z

docker logs zookeeper
===> ENV Variables ...
ALLOW_UNSIGNED=false
COMPONENT=zookeeper
CONFLUENT_DEB_VERSION=1
CONFLUENT_PLATFORM_LABEL=
CONFLUENT_VERSION=5.5.0
CUB_CLASSPATH=/etc/confluent/docker/docker-utils.jar
HOME=/root
HOSTNAME=1634ad3a3bbd
KAFKA_VERSION=
LANG=C.UTF-8
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PWD=/
PYTHON_PIP_VERSION=8.1.2
PYTHON_VERSION=2.7.9-1
SCALA_VERSION=2.12
SHLVL=1
ZOOKEEPER_CLIENT_PORT=2181
ZOOKEEPER_TICK_TIME=2000
ZULU_OPENJDK_VERSION=8=8.38.0.13
_=/usr/bin/env
===> User
uid=0(root) gid=0(root) groups=0(root)
===> Configuring ...
===> Running preflight checks ... 
===> Check if /var/lib/zookeeper/data is writable ...
===> Check if /var/lib/zookeeper/log is writable ...
===> Launching ... 
===> Launching zookeeper ... 
[2020-07-14 16:48:47,738] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:47,809] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:47,810] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:47,837] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)
[2020-07-14 16:48:47,837] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)
[2020-07-14 16:48:47,846] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)
[2020-07-14 16:48:47,846] WARN Either no config or no quorum defined in config, running  in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2020-07-14 16:48:47,855] INFO Log4j found with jmx enabled. (org.apache.zookeeper.jmx.ManagedUtil)
[2020-07-14 16:48:47,990] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:47,996] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:47,997] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2020-07-14 16:48:48,002] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)
[2020-07-14 16:48:48,020] INFO zookeeper.snapshot.trust.empty : false (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2020-07-14 16:48:48,106] INFO Server environment:zookeeper.version=3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,106] INFO Server environment:host.name=1634ad3a3bbd (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,107] INFO Server environment:java.version=1.8.0_212 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,107] INFO Server environment:java.vendor=Azul Systems, Inc. (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,108] INFO Server environment:java.home=/usr/lib/jvm/zulu-8-amd64/jre (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,108] INFO Server environment:java.class.path=/usr/bin/../share/java/kafka/connect-basic-auth-extension-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/jetty-http-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-io-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/commons-cli-1.4.jar:/usr/bin/../share/java/kafka/jakarta.annotation-api-1.3.4.jar:/usr/bin/../share/java/kafka/osgi-resource-locator-1.0.1.jar:/usr/bin/../share/java/kafka/jetty-server-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/netty-resolver-4.1.45.Final.jar:/usr/bin/../share/java/kafka/jackson-module-jaxb-annotations-2.10.2.jar:/usr/bin/../share/java/kafka/jackson-jaxrs-json-provider-2.10.2.jar:/usr/bin/../share/java/kafka/zstd-jni-1.4.4-7.jar:/usr/bin/../share/java/kafka/netty-transport-4.1.45.Final.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs-scaladoc.jar:/usr/bin/../share/java/kafka/jakarta.ws.rs-api-2.1.5.jar:/usr/bin/../share/java/kafka/jetty-client-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/validation-api-2.0.1.Final.jar:/usr/bin/../share/java/kafka/connect-file-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/jakarta.xml.bind-api-2.3.2.jar:/usr/bin/../share/java/kafka/jersey-container-servlet-2.28.jar:/usr/bin/../share/java/kafka/slf4j-api-1.7.30.jar:/usr/bin/../share/java/kafka/maven-artifact-3.6.3.jar:/usr/bin/../share/java/kafka/aopalliance-repackaged-2.5.0.jar:/usr/bin/../share/java/kafka/netty-transport-native-epoll-4.1.45.Final.jar:/usr/bin/../share/java/kafka/slf4j-log4j12-1.7.30.jar:/usr/bin/../share/java/kafka/kafka.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs-javadoc.jar:/usr/bin/../share/java/kafka/rocksdbjni-5.18.3.jar:/usr/bin/../share/java/kafka/connect-transforms-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/commons-compress-1.19.jar:/usr/bin/../share/java/kafka/reflections-0.9.12.jar:/usr/bin/../share/java/kafka/jackson-jaxrs-base-2.10.2.jar:/usr/bin/../share/java/kafka/jackson-module-scala_2.12-2.10.2.jar:/usr/bin/../share/java/kafka/audience-annotations-0.5.0.jar:/usr/bin/../share/java/kafka/support-metrics-client-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-scala_2.12-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/javassist-3.22.0-CR2.jar:/usr/bin/../share/java/kafka/connect-mirror-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/jersey-container-servlet-core-2.28.jar:/usr/bin/../share/java/kafka/scala-java8-compat_2.12-0.9.0.jar:/usr/bin/../share/java/kafka/httpclient-4.5.11.jar:/usr/bin/../share/java/kafka/jersey-server-2.28.jar:/usr/bin/../share/java/kafka/jakarta.inject-2.5.0.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs-sources.jar:/usr/bin/../share/java/kafka/zookeeper-jute-3.5.7.jar:/usr/bin/../share/java/kafka/javax.servlet-api-3.1.0.jar:/usr/bin/../share/java/kafka/commons-lang3-3.8.1.jar:/usr/bin/../share/java/kafka/netty-handler-4.1.45.Final.jar:/usr/bin/../share/java/kafka/commons-logging-1.2.jar:/usr/bin/../share/java/kafka/support-metrics-common-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/jackson-dataformat-csv-2.10.2.jar:/usr/bin/../share/java/kafka/jersey-common-2.28.jar:/usr/bin/../share/java/kafka/connect-json-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs-test-sources.jar:/usr/bin/../share/java/kafka/jetty-servlet-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs-test.jar:/usr/bin/../share/java/kafka/httpcore-4.4.13.jar:/usr/bin/../share/java/kafka/jackson-core-2.10.2.jar:/usr/bin/../share/java/kafka/jackson-datatype-jdk8-2.10.2.jar:/usr/bin/../share/java/kafka/jetty-continuation-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jopt-simple-5.0.4.jar:/usr/bin/../share/java/kafka/zookeeper-3.5.7.jar:/usr/bin/../share/java/kafka/javassist-3.26.0-GA.jar:/usr/bin/../share/java/kafka/hk2-api-2.5.0.jar:/usr/bin/../share/java/kafka/jetty-servlets-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jakarta.activation-api-1.2.1.jar:/usr/bin/../share/java/kafka/paranamer-2.8.jar:/usr/bin/../share/java/kafka/scala-collection-compat_2.12-2.1.3.jar:/usr/bin/../share/java/kafka/metrics-core-2.2.0.jar:/usr/bin/../share/java/kafka/kafka-streams-examples-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka-clients-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/scala-library-2.12.10.jar:/usr/bin/../share/java/kafka/avro-1.9.2.jar:/usr/bin/../share/java/kafka/connect-runtime-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/javax.ws.rs-api-2.1.1.jar:/usr/bin/../share/java/kafka/scala-reflect-2.12.10.jar:/usr/bin/../share/java/kafka/jaxb-api-2.3.0.jar:/usr/bin/../share/java/kafka/jackson-module-paranamer-2.10.2.jar:/usr/bin/../share/java/kafka/hk2-utils-2.5.0.jar:/usr/bin/../share/java/kafka/jetty-security-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/netty-transport-native-unix-common-4.1.45.Final.jar:/usr/bin/../share/java/kafka/jersey-client-2.28.jar:/usr/bin/../share/java/kafka/netty-common-4.1.45.Final.jar:/usr/bin/../share/java/kafka/jackson-annotations-2.10.2.jar:/usr/bin/../share/java/kafka/jersey-media-jaxb-2.28.jar:/usr/bin/../share/java/kafka/argparse4j-0.7.0.jar:/usr/bin/../share/java/kafka/jackson-databind-2.10.2.jar:/usr/bin/../share/java/kafka/commons-codec-1.11.jar:/usr/bin/../share/java/kafka/kafka-tools-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/lz4-java-1.7.1.jar:/usr/bin/../share/java/kafka/netty-codec-4.1.45.Final.jar:/usr/bin/../share/java/kafka/connect-mirror-client-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/activation-1.1.1.jar:/usr/bin/../share/java/kafka/connect-api-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/scala-logging_2.12-3.9.2.jar:/usr/bin/../share/java/kafka/httpmime-4.5.11.jar:/usr/bin/../share/java/kafka/plexus-utils-3.2.1.jar:/usr/bin/../share/java/kafka/netty-buffer-4.1.45.Final.jar:/usr/bin/../share/java/kafka/log4j-1.2.17.jar:/usr/bin/../share/java/kafka/jetty-util-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jersey-hk2-2.28.jar:/usr/bin/../share/java/kafka/kafka_2.12-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-test-utils-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/kafka-log4j-appender-5.5.0-ccs.jar:/usr/bin/../share/java/kafka/hk2-locator-2.5.0.jar:/usr/bin/../share/java/kafka/snappy-java-1.1.7.3.jar:/usr/bin/../support-metrics-client/build/dependant-libs-2.12/*:/usr/bin/../support-metrics-client/build/libs/*:/usr/share/java/support-metrics-client/* (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,113] INFO Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,114] INFO Server environment:java.io.tmpdir=/tmp (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,114] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,116] INFO Server environment:os.name=Linux (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,116] INFO Server environment:os.arch=amd64 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,117] INFO Server environment:os.version=4.19.76-linuxkit (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,117] INFO Server environment:user.name=root (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,117] INFO Server environment:user.home=/root (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,118] INFO Server environment:user.dir=/ (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,118] INFO Server environment:os.memory.free=498MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,118] INFO Server environment:os.memory.max=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,119] INFO Server environment:os.memory.total=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,124] INFO minSessionTimeout set to 4000 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,130] INFO maxSessionTimeout set to 40000 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,131] INFO Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/lib/zookeeper/log/version-2 snapdir /var/lib/zookeeper/data/version-2 (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 16:48:48,231] INFO Logging initialized @3242ms to org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log)
[2020-07-14 16:48:49,023] WARN o.e.j.s.ServletContextHandler@3b088d51{/,null,UNAVAILABLE} contextPath ends with /* (org.eclipse.jetty.server.handler.ContextHandler)
[2020-07-14 16:48:49,023] WARN Empty contextPath (org.eclipse.jetty.server.handler.ContextHandler)
[2020-07-14 16:48:49,119] INFO jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 1.8.0_212-b04 (org.eclipse.jetty.server.Server)
[2020-07-14 16:48:49,569] INFO DefaultSessionIdManager workerName=node0 (org.eclipse.jetty.server.session)
[2020-07-14 16:48:49,569] INFO No SessionScavenger set, using defaults (org.eclipse.jetty.server.session)
[2020-07-14 16:48:49,586] INFO node0 Scavenging every 660000ms (org.eclipse.jetty.server.session)
[2020-07-14 16:48:49,707] INFO Started o.e.j.s.ServletContextHandler@3b088d51{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler)
[2020-07-14 16:48:49,830] INFO Started ServerConnector@2038ae61{HTTP/1.1,[http/1.1]}{0.0.0.0:8080} (org.eclipse.jetty.server.AbstractConnector)
[2020-07-14 16:48:49,832] INFO Started @4842ms (org.eclipse.jetty.server.Server)
[2020-07-14 16:48:49,833] INFO Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands (org.apache.zookeeper.server.admin.JettyAdminServer)
[2020-07-14 16:48:49,870] INFO Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory (org.apache.zookeeper.server.ServerCnxnFactory)
[2020-07-14 16:48:49,888] INFO Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 4 worker threads, and 64 kB direct buffers. (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2020-07-14 16:48:49,934] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2020-07-14 16:48:50,038] WARN Exception causing close of session 0x0: ZooKeeperServer not running (org.apache.zookeeper.server.NIOServerCnxn)
[2020-07-14 16:48:50,040] WARN Unexpected exception (org.apache.zookeeper.server.WorkerService)
java.lang.NullPointerException
	at org.apache.zookeeper.server.ZooKeeperServer.removeCnxn(ZooKeeperServer.java:135)
	at org.apache.zookeeper.server.NIOServerCnxn.close(NIOServerCnxn.java:602)
	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:375)
	at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:530)
	at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:155)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
[2020-07-14 16:48:50,120] INFO zookeeper.snapshotSizeFactor = 0.33 (org.apache.zookeeper.server.ZKDatabase)
[2020-07-14 16:48:50,145] INFO Snapshotting: 0x0 to /var/lib/zookeeper/data/version-2/snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2020-07-14 16:48:50,171] INFO Snapshotting: 0x0 to /var/lib/zookeeper/data/version-2/snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2020-07-14 16:48:50,354] INFO Using checkIntervalMs=60000 maxPerMinute=10000 (org.apache.zookeeper.server.ContainerManager)
[2020-07-14 16:48:51,582] INFO Creating new log file: log.1 (org.apache.zookeeper.server.persistence.FileTxnLog)
[2020-07-14 19:03:39,664] INFO Expiring session 0x1000008581a0001, timeout of 18000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
[2020-07-14 19:03:39,886] WARN Unable to read additional data from client sessionid 0x1000008581a0001, likely client has closed socket (org.apache.zookeeper.server.NIOServerCnxn)
[2020-07-14 19:03:43,176] INFO Invalid session 0x1000008581a0001 for client /172.18.0.5:46214, probably expired (org.apache.zookeeper.server.ZooKeeperServer)
A11981IT:build-a-streaming-pipeline mtibbitts$

rmoff · 2020-07-15T09:20:20Z

Please use code formatting - I've edited your comments so far to fix them but would be great if you can in future - see https://guides.github.com/features/mastering-markdown/
Have you allocated sufficient memory to Docker (I use 8GB)?
Try docker-compose restart schema-registry, make sure it comes up, and then docker-compose restart kafka-connect-01 and see how that goes

surfdog · 2020-07-15T14:10:57Z

Please use code formatting - I've edited your comments so far to fix them but would be great if you can in future - see https://guides.github.com/features/mastering-markdown/

Thank you, much better.

Have you allocated sufficient memory to Docker (I use 8GB)?

Yes, but only 2 CPUs. I have 6 so maybe 3 would be better in the future.

Try docker-compose restart schema-registry, make sure it comes up, and then docker-compose restart kafka-connect-01 and see how that goes

Bingo. That worked. Thanks again.

rmoff · 2020-07-15T14:31:56Z

👍 glad it's working!

surfdog closed this as completed Jul 15, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Ratings not flowing - how to start? #131

Ratings not flowing - how to start? #131

surfdog commented Jul 14, 2020 •

edited by rmoff

rmoff commented Jul 14, 2020

surfdog commented Jul 14, 2020 •

edited by rmoff

rmoff commented Jul 14, 2020

surfdog commented Jul 14, 2020

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff

rmoff commented Jul 15, 2020

surfdog commented Jul 15, 2020

rmoff commented Jul 15, 2020

Ratings not flowing - how to start? #131

Ratings not flowing - how to start? #131

Comments

surfdog commented Jul 14, 2020 • edited by rmoff

rmoff commented Jul 14, 2020

surfdog commented Jul 14, 2020 • edited by rmoff

rmoff commented Jul 14, 2020

surfdog commented Jul 14, 2020

surfdog commented Jul 14, 2020 • edited by rmoff

surfdog commented Jul 14, 2020 • edited by rmoff

surfdog commented Jul 14, 2020 • edited by rmoff

rmoff commented Jul 15, 2020

surfdog commented Jul 15, 2020

rmoff commented Jul 15, 2020

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff

surfdog commented Jul 14, 2020 •

edited by rmoff