Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Nimbus HA #422

Closed
wants to merge 85 commits into from
Closed

Nimbus HA #422

wants to merge 85 commits into from

Commits on Oct 17, 2012

  1. INimbusStorage interface added

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    382dfb6 View commit details
    Browse the repository at this point in the history

  2. custom storage implemented; local fs storage implemented.

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    69f520e View commit details
    Browse the repository at this point in the history

  3. storage instantiation added

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    683e248 View commit details
    Browse the repository at this point in the history

  4. nimbus-storage-stormdist-root added to config

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    eb788bd View commit details
    Browse the repository at this point in the history

  5. use storage to download files from nimbus

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    1151035 View commit details
    Browse the repository at this point in the history

  6. nimbus-storage-stormdist-root fixed

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    cd50cf7 View commit details
    Browse the repository at this point in the history

  7. IOUtils added to bootstrap

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    f29dffe View commit details
    Browse the repository at this point in the history

  8. Use FileInputStream instead of BufferFileInputStream

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    5235675 View commit details
    Browse the repository at this point in the history

  9. remove /nimbus prefix from storage path (nimbus-storage-stormdist-root)

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    53f24f3 View commit details
    Browse the repository at this point in the history

  10. read-storm-conf is using storage now

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    8ef473c View commit details
    Browse the repository at this point in the history

  11. read-storm-topology is now using storage

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    72d5a8d View commit details
    Browse the repository at this point in the history

  12. BufferInputStream added

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    a34d703 View commit details
    Browse the repository at this point in the history

  13. fileDownload is now using BufferInputStream

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    cac28ea View commit details
    Browse the repository at this point in the history

  14. dir for local storage can be configured directly now

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    e79f716 View commit details
    Browse the repository at this point in the history

  15. master-storage-local-dir -> nimbus-storage-local-dir

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    8075736 View commit details
    Browse the repository at this point in the history

  16. some helpers for working with nimbus storage has been added

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    25809bb View commit details
    Browse the repository at this point in the history

  17. setup-storm-code is now using storage

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    7d094fd View commit details
    Browse the repository at this point in the history

  18. code-ids is now using storage

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    e94196c View commit details
    Browse the repository at this point in the history

  19. full-path option added to the storage interface

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    0a66c6a View commit details
    Browse the repository at this point in the history

  20. code-ids fixed (list is now returns only names)

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    b5ef2f1 View commit details
    Browse the repository at this point in the history

  21. deserialize-from-storage helper added

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    7c83af6 View commit details
    Browse the repository at this point in the history

  22. msg fixed

    @Frostman
    Frostman committed Oct 17, 2012
    Configuration menu
    Copy the full SHA
    cd218f0 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2012

  1. Don't call delete for empty list.

    @Frostman
    Frostman committed Oct 18, 2012
    Configuration menu
    Copy the full SHA
    171f9ac View commit details
    Browse the repository at this point in the history

  2. clean INimbusStorage interface

    @Frostman
    Frostman committed Oct 18, 2012
    Configuration menu
    Copy the full SHA
    328ce66 View commit details
    Browse the repository at this point in the history

  3. delete(List) and move has been removed from Nimbus storage (unused)

    @Frostman
    Frostman committed Oct 18, 2012
    Configuration menu
    Copy the full SHA
    97fa2fd View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2012

  1. Merge remote-tracking branch 'upstream/master' into nimbus-storage

    @Frostman
    Frostman committed Oct 19, 2012
    Configuration menu
    Copy the full SHA
    57160cf View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2012

  1. 0.8.2-wip16

    Nathan Marz committed Oct 30, 2012
    Configuration menu
    Copy the full SHA
    08e1618 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into 0.8.2

    Nathan Marz committed Oct 30, 2012
    Configuration menu
    Copy the full SHA
    9a0243c View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2012

  1. Merge remote-tracking branch 'upstream/master' into nimbus-storage 

    Conflicts:
	src/clj/backtype/storm/bootstrap.clj
    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    aa50da1 View commit details
    Browse the repository at this point in the history

  2. nimbus.elections.zookeeper.root parameter added to config

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    7a66f2f View commit details
    Browse the repository at this point in the history

  3. NimbusLeaderElections implemented

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    5219d54 View commit details
    Browse the repository at this point in the history

  4. small refactoring

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    f0de754 View commit details
    Browse the repository at this point in the history

  5. NimbusClient is now discovering Nimbus leader using Zookeeper

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    1e3820e View commit details
    Browse the repository at this point in the history

  6. elections clj helper added

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    22db24a View commit details
    Browse the repository at this point in the history

  7. leadership awaiting added to nimbus

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    b550254 View commit details
    Browse the repository at this point in the history

  8. nimbus leader discovery added to ui

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    05038c2 View commit details
    Browse the repository at this point in the history

  9. fix curator client zk root path.

    @Frostman
    Frostman committed Nov 1, 2012
    Configuration menu
    Copy the full SHA
    8e178ee View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 7, 2012
    Configuration menu
    Copy the full SHA
    192d85a View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip17

    Nathan Marz committed Nov 7, 2012
    Configuration menu
    Copy the full SHA
    61ba860 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    cb7e648 View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip18

    Nathan Marz committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    4b22ed4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    3d90c4d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    1488476 View commit details
    Browse the repository at this point in the history

  5. close zk connection after leader id discovery

    @Frostman
    Frostman committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    98ba1f4 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 8, 2012
    Configuration menu
    Copy the full SHA
    15c75b2 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2012

  1. Merge remote-tracking branch 'upstream/master' into nimbus-storage

    @Frostman
    Frostman committed Nov 13, 2012
    Configuration menu
    Copy the full SHA
    9595dad View commit details
    Browse the repository at this point in the history

  2. Merge branch 'nimbus-storage' into nimbus-ha

    @Frostman
    Frostman committed Nov 13, 2012
    Configuration menu
    Copy the full SHA
    08bb175 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2012

  1. log-message about awaiting/gaining leadership added

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    92d5991 View commit details
    Browse the repository at this point in the history

  2. close leader-elections on nimbus shutdown (release leadership mutex)

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    7bde88d View commit details
    Browse the repository at this point in the history

  3. ensure mutex path to avoid NoNode exception

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    dd02170 View commit details
    Browse the repository at this point in the history

  4. NotALeaderException added to thrift api

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    c967da2 View commit details
    Browse the repository at this point in the history

  5. ensure-leadership fixed

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    846af39 View commit details
    Browse the repository at this point in the history

  6. ensure-leadership added to all methods of thrift service handler

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    6fe8f88 View commit details
    Browse the repository at this point in the history

  7. NotALeaderException handled in StormSubmitter

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    e87fbbb View commit details
    Browse the repository at this point in the history

  8. NotALeaderException handled in Utils

    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    84d3f80 View commit details
    Browse the repository at this point in the history

  9. personal session and connection timeouts has been added for nimbus el… 

    …ections
    @Frostman
    Frostman committed Nov 15, 2012
    Configuration menu
    Copy the full SHA
    796f708 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2012

  1. with-configured-nimbus-connection fixed

    @Frostman
    Frostman committed Nov 19, 2012
    Configuration menu
    Copy the full SHA
    9647543 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2012

  1. unnecessary 'str' call removed

    @Frostman
    Frostman committed Nov 27, 2012
    Configuration menu
    Copy the full SHA
    e1351ba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'nimbus-storage' into nimbus-ha

    @Frostman
    Frostman committed Nov 27, 2012
    Configuration menu
    Copy the full SHA
    c529b7a View commit details
    Browse the repository at this point in the history

  3. exception will be thrown if secondary Nimbus will try to start with s… 

    …torage that isn't supported distributed
    @Frostman
    Frostman committed Nov 27, 2012
    Configuration menu
    Copy the full SHA
    b365a69 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Nov 29, 2012
    Configuration menu
    Copy the full SHA
    3e38314 View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip19

    Nathan Marz committed Nov 29, 2012
    Configuration menu
    Copy the full SHA
    7769afb View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2012

  1. nimbus.local.dir option has been removed from config

    @Frostman
    Frostman committed Dec 3, 2012
    Configuration menu
    Copy the full SHA
    92deeb7 View commit details
    Browse the repository at this point in the history

  2. nimbus.local.dir option has been removed from config

    @Frostman
    Frostman committed Dec 3, 2012
    Configuration menu
    Copy the full SHA
    c7fec94 View commit details
    Browse the repository at this point in the history

  3. join-paths function added and used instead of str in storage.clj

    @Frostman
    Frostman committed Dec 3, 2012
    Configuration menu
    Copy the full SHA
    94098fb View commit details
    Browse the repository at this point in the history

  4. javadoc added for nimbus.storage option

    @Frostman
    Frostman committed Dec 3, 2012
    Configuration menu
    Copy the full SHA
    1a17260 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'nimbus-storage' into nimbus-ha 

    Conflicts:
	src/jvm/backtype/storm/Config.java
    @Frostman
    Frostman committed Dec 3, 2012
    Configuration menu
    Copy the full SHA
    48443a6 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Dec 10, 2012
    Configuration menu
    Copy the full SHA
    138a2f9 View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip20

    Nathan Marz committed Dec 10, 2012
    Configuration menu
    Copy the full SHA
    c405490 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Dec 12, 2012
    Configuration menu
    Copy the full SHA
    cfdb01b View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2012

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Dec 20, 2012
    Configuration menu
    Copy the full SHA
    3fe6e8f View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip21

    Nathan Marz committed Dec 20, 2012
    Configuration menu
    Copy the full SHA
    5ab86ad View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2013

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 5, 2013
    Configuration menu
    Copy the full SHA
    6f615b4 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2013

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 7, 2013
    Configuration menu
    Copy the full SHA
    9e30263 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2013

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 8, 2013
    Configuration menu
    Copy the full SHA
    8e0af8f View commit details
    Browse the repository at this point in the history

  2. 0.8.2-wip22

    Nathan Marz committed Jan 8, 2013
    Configuration menu
    Copy the full SHA
    88bd39a View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2013

  1. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 9, 2013
    Configuration menu
    Copy the full SHA
    3285f4e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 9, 2013
    Configuration menu
    Copy the full SHA
    c59ea52 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2013

  1. storm 0.8.2

    Nathan Marz committed Jan 11, 2013
    1 Configuration menu
    Copy the full SHA
    843c86e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into 0.8.2

    Nathan Marz committed Jan 11, 2013
    Configuration menu
    Copy the full SHA
    0be62fe View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2013

  1. now host+port used as Nimbus host id for elections

    @Frostman
    Frostman committed Jan 22, 2013
    Configuration menu
    Copy the full SHA
    09e592d View commit details
    Browse the repository at this point in the history

  2. exception message fixed

    @Frostman
    Frostman committed Jan 22, 2013
    Configuration menu
    Copy the full SHA
    e8a61da View commit details
    Browse the repository at this point in the history

  3. method name fixed

    @Frostman
    Frostman committed Jan 22, 2013
    Configuration menu
    Copy the full SHA
    b02f8d6 View commit details
    Browse the repository at this point in the history

  4. method names fixed, label changed

    @Frostman
    Frostman committed Jan 22, 2013
    Configuration menu
    Copy the full SHA
    407667d View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/0.8.2' into nimbus-ha 

    Conflicts:
	src/clj/backtype/storm/util.clj
	src/py/storm/Nimbus.py
    @Frostman
    Frostman committed Jan 22, 2013
    Configuration menu
    Copy the full SHA
    13d19b9 View commit details
    Browse the repository at this point in the history