Skip to content
This repository has been archived by the owner on Jan 17, 2024. It is now read-only.

Update readme to have a more complete compose file #5

Closed
wants to merge 1 commit into from

Conversation

edbo
Copy link

@edbo edbo commented Oct 31, 2016

I changed the docker-compose a bit so you can also see the ui and it includes a fix that allows for uploading to the cluster more easily.

command: storm supervisor
command: >
storm supervisor
-c storm.zookeeper.servers="[\"zookeeper\"]"
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is done by default if no config provided. Please see https://github.com/31z4/storm-docker/blob/master/1.0.2/docker-entrypoint.sh#L15-L16

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice didn't spot that.

-c nimbus.seeds="[\"nimbus\"]"
depends_on:
- nimbus
- zookeeper
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think the UI depends on Zookeeper.

- zookeeper
links:
- nimbus
- zookeeper
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Linking with Zookeeper is unnecessary.

@31z4
Copy link
Owner

31z4 commented Nov 1, 2016

@edbo could you please clarify on this

it includes a fix that allows for uploading to the cluster more easily

What exactly do you mean?

@edbo
Copy link
Author

edbo commented Nov 1, 2016

I wasn't able to upload a topology to the storm cluster without setting a storm.local.hostname

@31z4
Copy link
Owner

31z4 commented Nov 5, 2016

@edbo could you please create an issue for this describing all the details? Or do it right here.

@edbo
Copy link
Author

edbo commented Nov 5, 2016

I get the error when using a command like tihs:

storm  jar target/file-1.0-SNAPSHOT-jar-with-dependencies.jar com.somecompany.TestTopology test
448  [main] INFO  o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -7340068425218594486:-5911778086654076904
501  [main] INFO  o.a.s.s.a.AuthUtils - Got AutoCreds []
Exception in thread "main" java.lang.RuntimeException: org.apache.storm.thrift.transport.TTransportException: java.net.UnknownHostException: ee3f313730d9
    at org.apache.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:64)
    at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:56)
    at org.apache.storm.security.auth.ThriftClient.reconnect(ThriftClient.java:99)
    at org.apache.storm.security.auth.ThriftClient.<init>(ThriftClient.java:69)
    at org.apache.storm.utils.NimbusClient.<init>(NimbusClient.java:106)
    at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:78)
    at org.apache.storm.StormSubmitter.topologyNameExists(StormSubmitter.java:371)
    at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:233)
    at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311)
    at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157)
    at com.bitgamelabs.LiveTransactionTopology.main(LiveTransactionTopology.java:29)
Caused by: org.apache.storm.thrift.transport.TTransportException: java.net.UnknownHostException: ee3f313730d9
    at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:226)
    at org.apache.storm.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
    at org.apache.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:103)
    at org.apache.storm.security.auth.TBackoffConnect.doConnectWithRetry(TBackoffConnect.java:53)
    ... 9 more
Caused by: java.net.UnknownHostException: ee3f313730d9
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at org.apache.storm.thrift.transport.TSocket.open(TSocket.java:221)

Setting the hostname to nimbus gets it working. I'm about to tweak it a bit to see if I can drop the other bits.

@edbo
Copy link
Author

edbo commented Nov 5, 2016

I realised after your message about the config settings you were setting that I was running your new docker compose file against your old docker image that didn't have those values set. Was confusing the hell out of me.

Anyway, I'm closing this now in favour of two simpler ones that separate the changes (#6 & #7).

@edbo edbo closed this Nov 5, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants