-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Storm-166: Nimbus HA design doc and implementation. #354
Commits on Sep 12, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 2b8dade - Browse repository at this point
Copy the full SHA 2b8dadeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e1f474 - Browse repository at this point
Copy the full SHA 4e1f474View commit details -
Configuration menu - View commit details
-
Copy full SHA for 670ad01 - Browse repository at this point
Copy the full SHA 670ad01View commit details
Commits on Sep 14, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 9280afb - Browse repository at this point
Copy the full SHA 9280afbView commit details
Commits on Sep 22, 2014
-
Configuration menu - View commit details
-
Copy full SHA for d0aa8ff - Browse repository at this point
Copy the full SHA d0aa8ffView commit details
Commits on Sep 23, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 4cb2eee - Browse repository at this point
Copy the full SHA 4cb2eeeView commit details
Commits on Sep 24, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 4d0c650 - Browse repository at this point
Copy the full SHA 4d0c650View commit details
Commits on Oct 6, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 50c4c34 - Browse repository at this point
Copy the full SHA 50c4c34View commit details
Commits on Oct 7, 2014
-
Configuration menu - View commit details
-
Copy full SHA for f5ac420 - Browse repository at this point
Copy the full SHA f5ac420View commit details -
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: storm-core/test/clj/backtype/storm/supervisor_test.clj
Configuration menu - View commit details
-
Copy full SHA for b074843 - Browse repository at this point
Copy the full SHA b074843View commit details
Commits on Oct 8, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 0e24a43 - Browse repository at this point
Copy the full SHA 0e24a43View commit details -
BugFix: bittorrent code was downloaded in wrong folder. Fixed in heck…
…y way. All tests pass now and was able to run wordcount and excalmation topologies.
Configuration menu - View commit details
-
Copy full SHA for 050e8fd - Browse repository at this point
Copy the full SHA 050e8fdView commit details
Commits on Oct 9, 2014
-
Making the code distributor injectable via strom configs. Changes to …
…HDFSCodeDistributor. Working version of HDFSCodeDistributor.
Configuration menu - View commit details
-
Copy full SHA for 932cecf - Browse repository at this point
Copy the full SHA 932cecfView commit details
Commits on Oct 22, 2014
-
Adding the auto discovery of nimbuses for all clients. Modified UI to…
… display list of nimbus hosts and current leader.
Configuration menu - View commit details
-
Copy full SHA for 16a3ce4 - Browse repository at this point
Copy the full SHA 16a3ce4View commit details -
Configuration menu - View commit details
-
Copy full SHA for fbb326b - Browse repository at this point
Copy the full SHA fbb326bView commit details -
Removing NIMBUS_HOST config values, updated unit tests so they can su…
…cceed in absence of the NIMBUS-CONF value.
Configuration menu - View commit details
-
Copy full SHA for f0701b3 - Browse repository at this point
Copy the full SHA f0701b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 046262a - Browse repository at this point
Copy the full SHA 046262aView commit details
Commits on Dec 1, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 11aadf5 - Browse repository at this point
Copy the full SHA 11aadf5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 728b35a - Browse repository at this point
Copy the full SHA 728b35aView commit details -
Implemented leader latch listener that relinquishes lock if it does n…
…ot have all the active topology code locally, keeps the lock if it can verify all active topology code exists locally.
Configuration menu - View commit details
-
Copy full SHA for 771f6a9 - Browse repository at this point
Copy the full SHA 771f6a9View commit details
Commits on Dec 2, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 609f569 - Browse repository at this point
Copy the full SHA 609f569View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50a33ac - Browse repository at this point
Copy the full SHA 50a33acView commit details -
Adding wait loop in master nimbus to allow for desired code replicati…
…on to be achieved before the topology is activated.
Configuration menu - View commit details
-
Copy full SHA for 522696c - Browse repository at this point
Copy the full SHA 522696cView commit details -
Configuration menu - View commit details
-
Copy full SHA for e037d3b - Browse repository at this point
Copy the full SHA e037d3bView commit details -
Configuration menu - View commit details
-
Copy full SHA for e5c14e2 - Browse repository at this point
Copy the full SHA e5c14e2View commit details
Commits on Dec 3, 2014
-
Configuration menu - View commit details
-
Copy full SHA for c684939 - Browse repository at this point
Copy the full SHA c684939View commit details
Commits on Dec 5, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 32d7838 - Browse repository at this point
Copy the full SHA 32d7838View commit details -
Configuration menu - View commit details
-
Copy full SHA for dda2ee1 - Browse repository at this point
Copy the full SHA dda2ee1View commit details
Commits on Dec 8, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 4e35c1a - Browse repository at this point
Copy the full SHA 4e35c1aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d198242 - Browse repository at this point
Copy the full SHA d198242View commit details -
Configuration menu - View commit details
-
Copy full SHA for 62ee10b - Browse repository at this point
Copy the full SHA 62ee10bView commit details -
Added security login for HDFSCodeDistributor so it would work with se…
…cure and non secure HDFS. Removed couple of TODOs from BitTorrentCodeDistributor.
Configuration menu - View commit details
-
Copy full SHA for 635c9b2 - Browse repository at this point
Copy the full SHA 635c9b2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6468058 - Browse repository at this point
Copy the full SHA 6468058View commit details
Commits on Dec 9, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 7f9c7db - Browse repository at this point
Copy the full SHA 7f9c7dbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b63019 - Browse repository at this point
Copy the full SHA 2b63019View commit details -
Configuration menu - View commit details
-
Copy full SHA for 49680fd - Browse repository at this point
Copy the full SHA 49680fdView commit details
Commits on Dec 11, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 00300ae - Browse repository at this point
Copy the full SHA 00300aeView commit details
Commits on Dec 12, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 678afed - Browse repository at this point
Copy the full SHA 678afedView commit details
Commits on Dec 16, 2014
-
Configuration menu - View commit details
-
Copy full SHA for fa69f2a - Browse repository at this point
Copy the full SHA fa69f2aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 02c27a9 - Browse repository at this point
Copy the full SHA 02c27a9View commit details
Commits on Dec 17, 2014
-
Configuration menu - View commit details
-
Copy full SHA for 88e70a8 - Browse repository at this point
Copy the full SHA 88e70a8View commit details -
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: conf/defaults.yaml pom.xml storm-core/src/clj/backtype/storm/cluster.clj storm-core/src/clj/backtype/storm/daemon/nimbus.clj storm-core/src/clj/backtype/storm/thrift.clj storm-core/src/clj/backtype/storm/ui/core.clj storm-core/src/jvm/backtype/storm/Config.java storm-core/src/jvm/backtype/storm/utils/NimbusClient.java storm-core/test/clj/backtype/storm/nimbus_test.clj storm-core/test/clj/backtype/storm/security/auth/auth_test.clj storm-core/test/clj/backtype/storm/utils_test.clj
Configuration menu - View commit details
-
Copy full SHA for 6b0da16 - Browse repository at this point
Copy the full SHA 6b0da16View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1dccc1b - Browse repository at this point
Copy the full SHA 1dccc1bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8241146 - Browse repository at this point
Copy the full SHA 8241146View commit details
Commits on Dec 18, 2014
-
Configuration menu - View commit details
-
Copy full SHA for df4d8c2 - Browse repository at this point
Copy the full SHA df4d8c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 366130e - Browse repository at this point
Copy the full SHA 366130eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 256c35a - Browse repository at this point
Copy the full SHA 256c35aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e5a96f4 - Browse repository at this point
Copy the full SHA e5a96f4View commit details
Commits on Dec 19, 2014
-
defaulting to LocalFileSystemCodeDistributor, moving all code distrib…
…utors to their own packages.
Configuration menu - View commit details
-
Copy full SHA for 547ed49 - Browse repository at this point
Copy the full SHA 547ed49View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50fdcee - Browse repository at this point
Copy the full SHA 50fdceeView commit details -
Configuration menu - View commit details
-
Copy full SHA for d0bb383 - Browse repository at this point
Copy the full SHA d0bb383View commit details -
STORM-166: fixing a bug where the leader lock was not queued due to i…
…ncorrect latch state being used
Configuration menu - View commit details
-
Copy full SHA for dd991e5 - Browse repository at this point
Copy the full SHA dd991e5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 07b69b7 - Browse repository at this point
Copy the full SHA 07b69b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for e05d666 - Browse repository at this point
Copy the full SHA e05d666View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9cd52c8 - Browse repository at this point
Copy the full SHA 9cd52c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for c82482d - Browse repository at this point
Copy the full SHA c82482dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2954eae - Browse repository at this point
Copy the full SHA 2954eaeView commit details -
Configuration menu - View commit details
-
Copy full SHA for a92a1e9 - Browse repository at this point
Copy the full SHA a92a1e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for a75c72c - Browse repository at this point
Copy the full SHA a75c72cView commit details -
STORM-166: modifed some config key names to match the convention, add…
…ed the documentation for configuration.
Configuration menu - View commit details
-
Copy full SHA for 27d6b4c - Browse repository at this point
Copy the full SHA 27d6b4cView commit details -
STORM-166: deleting the bittorrent code distributor as the ttorent li…
…brary does not support Distrubted hash table for trackerless torrents.
Configuration menu - View commit details
-
Copy full SHA for dc24e44 - Browse repository at this point
Copy the full SHA dc24e44View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb242e0 - Browse repository at this point
Copy the full SHA eb242e0View commit details
Commits on Dec 20, 2014
-
Configuration menu - View commit details
-
Copy full SHA for a17167e - Browse repository at this point
Copy the full SHA a17167eView commit details
Commits on Jan 8, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 7681686 - Browse repository at this point
Copy the full SHA 7681686View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5658bbb - Browse repository at this point
Copy the full SHA 5658bbbView commit details -
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: storm-core/src/jvm/backtype/storm/Config.java
Configuration menu - View commit details
-
Copy full SHA for 58667be - Browse repository at this point
Copy the full SHA 58667beView commit details
Commits on Jan 9, 2015
-
Configuration menu - View commit details
-
Copy full SHA for c1e8782 - Browse repository at this point
Copy the full SHA c1e8782View commit details
Commits on Jan 23, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 27a381a - Browse repository at this point
Copy the full SHA 27a381aView commit details
Commits on Feb 3, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 01eee7a - Browse repository at this point
Copy the full SHA 01eee7aView commit details
Commits on Feb 4, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 1b6491f - Browse repository at this point
Copy the full SHA 1b6491fView commit details
Commits on Feb 12, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 4502bff - Browse repository at this point
Copy the full SHA 4502bffView commit details -
Configuration menu - View commit details
-
Copy full SHA for aa24375 - Browse repository at this point
Copy the full SHA aa24375View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7cae523 - Browse repository at this point
Copy the full SHA 7cae523View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0b454e8 - Browse repository at this point
Copy the full SHA 0b454e8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 27ad1fb - Browse repository at this point
Copy the full SHA 27ad1fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 726ce80 - Browse repository at this point
Copy the full SHA 726ce80View commit details
Commits on Feb 13, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 63f29f3 - Browse repository at this point
Copy the full SHA 63f29f3View commit details -
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: storm-core/src/clj/backtype/storm/daemon/nimbus.clj storm-core/src/clj/backtype/storm/ui/core.clj
Configuration menu - View commit details
-
Copy full SHA for 23ed537 - Browse repository at this point
Copy the full SHA 23ed537View commit details -
Configuration menu - View commit details
-
Copy full SHA for a8aacca - Browse repository at this point
Copy the full SHA a8aaccaView commit details
Commits on Feb 17, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 8d4e561 - Browse repository at this point
Copy the full SHA 8d4e561View commit details
Commits on Mar 2, 2015
-
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: STORM-UI-REST-API.md pom.xml storm-core/src/clj/backtype/storm/daemon/nimbus.clj storm-core/src/clj/backtype/storm/daemon/supervisor.clj storm-core/src/clj/backtype/storm/ui/core.clj storm-core/src/jvm/backtype/storm/generated/ClusterSummary.java storm-core/src/jvm/backtype/storm/generated/TopologyInfo.java storm-core/src/jvm/backtype/storm/generated/TopologySummary.java storm-core/src/py/storm/ttypes.py storm-core/test/clj/backtype/storm/nimbus_test.clj
Configuration menu - View commit details
-
Copy full SHA for 85e4d5e - Browse repository at this point
Copy the full SHA 85e4d5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f7205d2 - Browse repository at this point
Copy the full SHA f7205d2View commit details
Commits on Mar 19, 2015
-
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: conf/defaults.yaml storm-core/src/clj/backtype/storm/cluster.clj storm-core/src/clj/backtype/storm/daemon/nimbus.clj storm-core/src/clj/backtype/storm/ui/core.clj storm-core/test/clj/backtype/storm/cluster_test.clj storm-core/test/clj/backtype/storm/security/auth/auth_test.clj
Configuration menu - View commit details
-
Copy full SHA for 5758718 - Browse repository at this point
Copy the full SHA 5758718View commit details
Commits on Mar 20, 2015
-
Configuration menu - View commit details
-
Copy full SHA for eb3a837 - Browse repository at this point
Copy the full SHA eb3a837View commit details -
Merge remote-tracking branch 'upstream/master' into STORM-166
Conflicts: storm-core/src/ui/public/index.html storm-core/src/ui/public/templates/index-page-template.html storm-core/src/ui/public/templates/topology-page-template.html
Configuration menu - View commit details
-
Copy full SHA for a11fcc3 - Browse repository at this point
Copy the full SHA a11fcc3View commit details
Commits on Apr 1, 2015
-
Merge remote-tracking branch 'apache/master' into nimbus-ha
Conflicts: storm-core/src/jvm/backtype/storm/utils/NimbusClient.java storm-core/test/clj/backtype/storm/security/auth/nimbus_auth_test.clj
Configuration menu - View commit details
-
Copy full SHA for 765e4c2 - Browse repository at this point
Copy the full SHA 765e4c2View commit details
Commits on Aug 12, 2015
-
Merge remote-tracking branch 'apache/nimbus-ha-branch' into ha-merge
Conflicts: STORM-UI-REST-API.md conf/defaults.yaml storm-core/src/clj/backtype/storm/daemon/nimbus.clj storm-core/src/clj/backtype/storm/ui/core.clj storm-core/src/jvm/backtype/storm/Config.java storm-core/src/jvm/backtype/storm/generated/TopologySummary.java
Configuration menu - View commit details
-
Copy full SHA for d1afefd - Browse repository at this point
Copy the full SHA d1afefdView commit details -
STORM-726: Adding nimbus.host config for backward compatibility.
Conflicts: storm-core/src/jvm/backtype/storm/utils/NimbusClient.java
Configuration menu - View commit details
-
Copy full SHA for 3e20823 - Browse repository at this point
Copy the full SHA 3e20823View commit details -
Changed the code-distributor entries to ephemeral nodes. Added code t…
…o ensure nimbus sets up the correct code-distributor entries on startup.
Configuration menu - View commit details
-
Copy full SHA for 3f66ffd - Browse repository at this point
Copy the full SHA 3f66ffdView commit details -
modifed ui to reflect dead nimbus hosts based on nimbus.seeds.
Conflicts: storm-core/src/jvm/backtype/storm/utils/NimbusClient.java
Configuration menu - View commit details
-
Copy full SHA for 16293e4 - Browse repository at this point
Copy the full SHA 16293e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 95fb680 - Browse repository at this point
Copy the full SHA 95fb680View commit details -
STORM-726: Adding nimbus.host config for backward compatibility.
Conflicts: storm-core/src/clj/backtype/storm/ui/core.clj storm-core/src/jvm/backtype/storm/Config.java storm-core/src/jvm/backtype/storm/utils/NimbusClient.java Conflicts: storm-core/src/clj/backtype/storm/ui/core.clj storm-core/src/jvm/backtype/storm/Config.java storm-core/src/jvm/backtype/storm/utils/NimbusClient.java
Configuration menu - View commit details
-
Copy full SHA for 0395fd6 - Browse repository at this point
Copy the full SHA 0395fd6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 21ba9c1 - Browse repository at this point
Copy the full SHA 21ba9c1View commit details -
BUG-40864: Handing zookeeper failures that can result in nimbus ephem…
…eral entries getting deleted. Adding a sleep before cody-sycn thread executes ls /code-distributor/topology-id to ensure it gets the correct id back so users dont have to wait for upto 5 minutes to submit topology.
Configuration menu - View commit details
-
Copy full SHA for ef3cee6 - Browse repository at this point
Copy the full SHA ef3cee6View commit details -
Addressing TODOs. Calling sync before calling getChildren on code-dis…
…tributor path as zookeeper does not gurantee Simultaneously Consistent Cross-Client Views unless sync is called.
Configuration menu - View commit details
-
Copy full SHA for 93dbcaf - Browse repository at this point
Copy the full SHA 93dbcafView commit details
Commits on Aug 19, 2015
-
Configuration menu - View commit details
-
Copy full SHA for 51fdc1a - Browse repository at this point
Copy the full SHA 51fdc1aView commit details