Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Newer
Older
100644 108 lines (94 sloc) 3.845 kb
9d91adb @nathanmarz release commit
authored
1 ########### These all have default values as shown
2 ########### Additional configuration goes into storm.yaml
3
4 java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"
5
6 ### storm.* configs are general configurations
7 # the local dir is where jars are kept
295816d @nathanmarz fix UI, fix remaining issues with multiple tasks / executor
authored
8 storm.local.dir: "storm-local"
62db063 @nathanmarz starting on dev-zookeeper storm task
authored
9 storm.zookeeper.servers:
10 - "localhost"
9d91adb @nathanmarz release commit
authored
11 storm.zookeeper.port: 2181
12 storm.zookeeper.root: "/storm"
e1bbcd8 @nathanmarz increase zookeeper timeout
authored
13 storm.zookeeper.session.timeout: 20000
eaf2755 @nathanmarz make zookeeper connection timeout configurable
authored
14 storm.zookeeper.connection.timeout: 15000
de3de42 @killme2008 Adds storm.zookeeper.retry.times and storm.zookeeper.retry.interval conf...
killme2008 authored
15 storm.zookeeper.retry.times: 5
16 storm.zookeeper.retry.interval: 1000
9d91adb @nathanmarz release commit
authored
17 storm.cluster.mode: "distributed" # can be distributed or local
f775c09 @nathanmarz initial implementation of messaging abstraction
authored
18 storm.local.mode.zmq: false
9d91adb @nathanmarz release commit
authored
19
20 ### nimbus.* configs are for the master
62db063 @nathanmarz starting on dev-zookeeper storm task
authored
21 nimbus.host: "localhost"
9d91adb @nathanmarz release commit
authored
22 nimbus.thrift.port: 6627
23 nimbus.childopts: "-Xmx1024m"
24 nimbus.task.timeout.secs: 30
25 nimbus.supervisor.timeout.secs: 60
26 nimbus.monitor.freq.secs: 10
64a686b @nathanmarz update changelog for 0.6.2
authored
27 nimbus.cleanup.inbox.freq.secs: 600
5046c24 @trevorsummerssmith Delete nimbus inbox jars with a simple scheduled delete jars job
trevorsummerssmith authored
28 nimbus.inbox.jar.expiration.secs: 3600
302cc08 @nathanmarz turn down task launch timeout
authored
29 nimbus.task.launch.secs: 120
9d91adb @nathanmarz release commit
authored
30 nimbus.reassign: true
31 nimbus.file.copy.expiration.secs: 600
a3650ef @nathanmarz added ability to set business-specific topology validators, bumped to 0....
authored
32 nimbus.topology.validator: "backtype.storm.nimbus.DefaultTopologyValidator"
9d91adb @nathanmarz release commit
authored
33
502902c * Added ui.childopts to conf/defaults.yaml
Dan Dillinger authored
34 ### ui.* configs are for the master
ccbf578 @nathanmarz make storm ui port configurable
authored
35 ui.port: 8080
502902c * Added ui.childopts to conf/defaults.yaml
Dan Dillinger authored
36 ui.childopts: "-Xmx768m"
ccbf578 @nathanmarz make storm ui port configurable
authored
37
92174d8 @nathanmarz simplified drpc to make the drpc server a spout
authored
38 drpc.port: 3772
d0e6831 @nathanmarz fix hanging problem with too many concurrent requests to drpc server
authored
39 drpc.invocations.port: 3773
9066481 @nathanmarz make request timeout within drpc server configurable
authored
40 drpc.request.timeout.secs: 600
92174d8 @nathanmarz simplified drpc to make the drpc server a spout
authored
41
38bae17 @nathanmarz added component specific confs to drpc and transactional builders, progr...
authored
42 transactional.zookeeper.root: "/transactional"
9c3a4b7 @nathanmarz make zookeeper cluster used for transactional state customizable
authored
43 transactional.zookeeper.servers: null
44 transactional.zookeeper.port: null
38bae17 @nathanmarz added component specific confs to drpc and transactional builders, progr...
authored
45
9d91adb @nathanmarz release commit
authored
46 ### supervisor.* configs are for node supervisors
47 # Define the amount of workers that can be run on this machine. Each worker is assigned a port to use for communication
48 supervisor.slots.ports:
49 - 6700
50 - 6701
51 - 6702
52 - 6703
53 supervisor.childopts: "-Xmx1024m"
54 #how long supervisor will wait to ensure that a worker process is started
8d651da @nathanmarz lower supervisor worker start timeout to 120 seconds
authored
55 supervisor.worker.start.timeout.secs: 120
9d91adb @nathanmarz release commit
authored
56 #how long between heartbeats until supervisor considers that worker dead and tries to restart it
3cee68b @nathanmarz increase default start timeouts
authored
57 supervisor.worker.timeout.secs: 30
9d91adb @nathanmarz release commit
authored
58 #how frequently the supervisor checks on the status of the processes it's monitoring and restarts if necessary
59 supervisor.monitor.frequency.secs: 3
60 #how frequently the supervisor heartbeats to the cluster state (for nimbus)
61 supervisor.heartbeat.frequency.secs: 5
62 supervisor.enable: true
63
64 ### worker.* configs are for task workers
65 worker.childopts: "-Xmx768m"
66 worker.heartbeat.frequency.secs: 1
67
68 task.heartbeat.frequency.secs: 3
69 task.refresh.poll.secs: 10
70
71 zmq.threads: 1
72 zmq.linger.millis: 5000
bcd775b @nathanmarz set a high water mark that defaults to 10K messages on 0mq sockets
authored
73 zmq.hwm: 10000
9d91adb @nathanmarz release commit
authored
74
75 ### topology.* configs are for specific executing storms
2892dd8 @nathanmarz disable timeouts by default to prevent it from affecting tests
authored
76 topology.enable.message.timeouts: true
9d91adb @nathanmarz release commit
authored
77 topology.debug: false
78 topology.optimize: true
79 topology.workers: 1
896c0ea @nathanmarz eliminate explicit storage of task->component
authored
80 topology.acker.executors: 1
81 topology.acker.tasks: null
82 topology.tasks: null
9d91adb @nathanmarz release commit
authored
83 # maximum amount of time a message has to complete before it's considered failed
84 topology.message.timeout.secs: 30
3539864 @nathanmarz replaced storm's serialization system with kryo serialiation
authored
85 topology.skip.missing.kryo.registrations: false
9d91adb @nathanmarz release commit
authored
86 topology.max.task.parallelism: null
87 topology.max.spout.pending: null
88 topology.state.synchronization.timeout.secs: 60
89 topology.stats.sample.rate: 0.05
51e784c @nathanmarz added fallback to java serialization feature
authored
90 topology.fall.back.on.java.serialization: true
83e2eec @nathanmarz implemented configurable high water mark for zmq
authored
91 topology.worker.childopts: null
1ff1af8 @nathanmarz change default buffer sizes to work better in local mode and have less l...
authored
92 topology.executor.receive.buffer.size: 1024 #batched
93 topology.executor.send.buffer.size: 1024 #individual messages
8db1634 @nathanmarz optimize the receive buffer size
authored
94 topology.receiver.buffer.size: 8 # setting it too high causes a lot of problems (heartbeat thread gets starved, throughput plummets)
1ff1af8 @nathanmarz change default buffer sizes to work better in local mode and have less l...
authored
95 topology.transfer.buffer.size: 1024 # batched
dadb794 @nathanmarz Add definition of system component and tick stream, integrate with Topol...
authored
96 topology.tick.tuple.freq.secs: null
1e70817 @nathanmarz implemented framework for shared worker resources. created default execu...
authored
97 topology.worker.shared.thread.pool.size: 4
0036e90 @nathanmarz make disruptor wait strategy configurable
authored
98 topology.disruptor.wait.strategy: "com.lmax.disruptor.BlockingWaitStrategy"
ecd26e5 @nathanmarz Implemented pluggable spout wait strategies
authored
99 topology.spout.wait.strategy: "backtype.storm.spout.SleepSpoutWaitStrategy"
100 topology.sleep.spout.wait.strategy.time.ms: 1
4710bfe @nathanmarz implement automatic throttling of reportError -> zookeeper / storm UI
authored
101 topology.error.throttle.interval.secs: 10
102 topology.max.error.report.per.interval: 5
dbe98d4 @nathanmarz implemented plgguable Kryo factories
authored
103 topology.kryo.factory: "backtype.storm.serialization.DefaultKryoFactory"
daf930d @nathanmarz added config to control how often a batch can be emitted in a Trident to...
authored
104 topology.trident.batch.emit.interval.millis: 500
105
11862aa @nathanmarz optimize map usage in tasks-fn by using HashMap
authored
106
49cd5cd @nathanmarz fix conflicts
authored
107 dev.zookeeper.path: "/tmp/dev-storm-zookeeper"
Something went wrong with that request. Please try again.