Support new clustered NATS #32

Closed
drnic opened this Issue Mar 1, 2013 · 19 comments

Projects

None yet

10 participants

@drnic
Member
drnic commented Mar 1, 2013

NATS has a clustering branch and here is sample configuration for it.

https://github.com/derekcollison/nats/blob/cluster/examples/server_config_cluster.yml

If a deployment has 2+ nats jobs then perhaps it should switch to this NATS branch and use the clustering support.

@mheath
Contributor
mheath commented Mar 1, 2013

Will all the NATS client config have to change to be made aware of all the NATS servers?

@d
Member
d commented Mar 2, 2013

Wow that's an exciting release (probably I haven't been following it so closely lately). Although I'd rather not pick up the glam and glitz before we have evidence that the NATS server in our deployment is under extreme stress.

@d d closed this Mar 2, 2013
@mheath
Contributor
mheath commented Mar 2, 2013

We're not interested in NATS clustering for glam, glitz, or extreme stress. We are interested in removing the single point of failure of Cloud Foundry's primary communication mechanism though. Seams a little premature to close this issue don't you think?

@drnic
Member
drnic commented Mar 2, 2013

Please reopen the ticket as a placeholder for someone to do the work of introducing the clustered NATS branch into cf-release so people can begin testing it.

On Fri, Mar 1, 2013 at 8:07 PM, Jesse Zhang notifications@github.com
wrote:

Wow that's an exciting release (probably I haven't been following it so closely lately). Although I'd rather not pick up the glam and glitz before we have evidence that the NATS server in our deployment is under extreme stress.

Reply to this email directly or view it on GitHub:
#32 (comment)

@mkocher mkocher reopened this Mar 2, 2013
@mkocher
Member
mkocher commented Mar 2, 2013

I'm not clear on how the clustering works yet. Anyone tried it out?

@drnic
Member
drnic commented Mar 3, 2013

I haven't yet; only found out the branch exists the other day because @evanphx was asking @derekcollison about it.

On Sat, Mar 2, 2013 at 3:56 PM, Matthew Kocher notifications@github.com
wrote:

I'm not clear on how the clustering works yet. Anyone tried it out?

Reply to this email directly or view it on GitHub:
#32 (comment)

@derekcollison

Right now best way to figure it out is design wiki and the tests. The tests are fairly complete.

@cf-frameworks cf-frameworks pushed a commit that referenced this issue Mar 20, 2013
Maria Shaldibina and Mark Rushakoff Bump ccng
Andrew Liu and David Stevenson (3):
      [fixes #46132627] Service #extra field is text not string
      Fix migration that is broken in postgres only
      Run custom SQL to convert text columns to mediumtext in mysql

Andy Wilkinson (2):
      Access all git dependencies using https
      Use https:// rather than git:// for submodules

Bleicke and Dmitriy Kalinin (1):
      removed logger from DeaPool

Bleicke and Tony Hansmann (1):
      Removing staging task logs and redis.     [#45814227]

Bob Nugmanov and Tim Labeeuw (1):
      Fix integration test.

Chunjie (1):
      update response header content-type

CloudFoundry Services Team (1):
      Merge pull request #32 from Chunjie/master

Dave Syer (1):
      Remove token_endpoint from /info

David Sabeti and Ryan Spore (1):
      Change format for rake spec

David Stevenson and Jesse Zhang (5):
      correct typo
      A service doesn't have a crypted password
      add 'extra' attribute to services
      [finishes #46132627] CCNG accepts 'extra' field in service offering
      Fix test description to match reality

David Stevenson and Matt Royal (2):
      [finishes #46157255] Service offering's plans attributes are whitelisted for safety
      ServicePlan's #create calls bypass mass-assignment verification

Dmitriy Kalinin (1):
      start populating stager pool when cloud controller starts

Dmitriy Kalinin and Mark Rushakoff (5):
      remove inccorect usage of check_process_alive?
      explicitly require libraries used
      move stack model configuration into config.configure
      fix random failure by stubbing MessageBus correctly
      include backtraces for CI

Dmitriy Kalinin and Patrick Bozeman (4):
      removed unnecessary block when calling stage_app
      remove unused directories.stacks config option
      be more explicit when testing of removal of upload handle
      use stager pool to find stagers

Dmitriy Kalinin and Pieter Noordhuis (3):
      fixed typo when download staged app without nginx
      Allow finding stacks by name
      Correct Gemfile.lock

Eugenia Dellapenna & Sheel Choksi (2):
      use client_id when user_id is missing from token
      add a 'to_many spaces' relationship to domain

James Bayer (1):
      Provide additional detail for components

Jesse Zhang (1):
      Merge pull request #24 from dsyer/feature/token_endpoint

Jesse Zhang and Matt Royal (5):
      accept plan_details from service gateways
      Expose ServicePlan#extra
      [bugfix] don't filter "free"ness
      Refactor legacy_service_gateway_spec.rb
      Attempt to fix a non-deterministic failure on Travis

Kai Xiang and Matthew Boedicker (1):
      Replace VMC_APP_HOST env variables with VCAP_APP_HOST

Kowshik Prakasam (1):
      Make README better.

Luke Taylor (1):
      Make symmetric_secret an optional config property.

Matt Royal (1):
      Make "rake spec" the default rake task

cf-frameworks (2):
      Update README.md
      Merge pull request #33 from cloudfoundry/domain_spaces_relation

pivotal-vmware (4):
      Merge pull request #30 from cloudfoundry/allow_client_id
      Merge pull request #29 from tekul/master
      Merge pull request #27 from wilkinsona/https-submodules
      Merge pull request #26 from wilkinsona/git-dependencies
59679e1
@felixhoo felixhoo pushed a commit to felixhoo/cf-release that referenced this issue Mar 31, 2013
felixhoo Add a mgmt proxy for services
git shortlog 106ad12..HEAD

Andrew Liu and Scott Calvert (1):
      add default cc_api_version to provisioner spec

David Stevenson (2):
      Merge pull request #30 from felixhoo/monit_user
      Merge pull request #32 from felixhoo/mgmt_proxy

David Stevenson and Ryan Tang (3):
      Jenkins build setup
      Updated mysql user info for CI
      Update mysql port for CI

Jesse Zhang and Scott Calvert (1):
      Integration tests fail if there are local changes to ccng and ENV['NO_CHECKOUT'] is undefined.

Matt Royal and Phan Le (4):
      Fix the test
      Run echo build on travis
      Add marketplace, service_broker and mysql builds back
      Integration tests don't clear changes in CCNG

Phan Le (1):
      Revert previous inadvertent commit

Phan Le and Ryan Tang (1):
      Supporting only mysql 5.5 on ng and should always be running in wardenized mode

Phan Le and Scott Calvert (1):
      Fixing our last attempt at making integration tests fail when uncommitted changes would be clobbered

felixhoo (2):
      Create monitoring user on provision
      Add a proxy to delegate traffic to service native UI
64c24ed
@felixhoo felixhoo pushed a commit that referenced this issue Apr 1, 2013
felixhoo + David Stevenson Add a mgmt proxy for services
git shortlog 106ad12..HEAD

Andrew Liu and Scott Calvert (1):
      add default cc_api_version to provisioner spec

David Stevenson (2):
      Merge pull request #30 from felixhoo/monit_user
      Merge pull request #32 from felixhoo/mgmt_proxy

David Stevenson and Ryan Tang (3):
      Jenkins build setup
      Updated mysql user info for CI
      Update mysql port for CI

Jesse Zhang and Scott Calvert (1):
      Integration tests fail if there are local changes to ccng and ENV['NO_CHECKOUT'] is undefined.

Matt Royal and Phan Le (4):
      Fix the test
      Run echo build on travis
      Add marketplace, service_broker and mysql builds back
      Integration tests don't clear changes in CCNG

Phan Le (1):
      Revert previous inadvertent commit

Phan Le and Ryan Tang (1):
      Supporting only mysql 5.5 on ng and should always be running in wardenized mode

Phan Le and Scott Calvert (1):
      Fixing our last attempt at making integration tests fail when uncommitted changes would be clobbered

felixhoo (2):
      Create monitoring user on provision
      Add a proxy to delegate traffic to service native UI
8e65f85
@cf-bosh cf-bosh pushed a commit that referenced this issue Jun 21, 2013
Gregg Van Hove Bump src/dea_next:
Ben Hale (1):
      Update Java buildpack

Jon Stevens and Maria Shaldibina (2):
      increase port connection timeout from 1 to 5 seconds
      attempt (again) to make tests pass on jenkins

Mark Rushakoff (1):
      Merge pull request #32 from nebhale/52066937-update-java-buildpack

Stephan Hagemann (3):
      Change staging startup script
      tee the startup script output to logfile and STDOUT/STDERR
      ignore .iml files

cf-frameworks (1):
      Merge pull request #31 from cloudfoundry/staging_plugin_startup_script_cleanup
87d68be
@jfoley
Contributor
jfoley commented Aug 14, 2013

@mkocher - who owns the work to get clustered NATs into CF?

@aramprice / @jfoley

@mkocher
Member
mkocher commented Aug 15, 2013

@MarkKropf should prioritize this. I know @jbayer has been thinking about it for a while as well.

@christo4ferris
Member

It has certainly come up as a high priority, here.

@MarkKropf
Member

This is a priority for us, we'll have more info to share shortly.

@drnic
Member
drnic commented Aug 16, 2013

Bonza.

@mark-rushakoff
Contributor

@MarkKropf @jbayer Any updates to share on this yet?

@mark-rushakoff / @matthewmcnew

@MarkKropf
Member

@mark-rushakoff Still working on this

@emcee21
emcee21 commented Oct 22, 2013

@MarkKropf +1 this issue - any chance this will make it on the backlog soon?

@MarkKropf
Member

@emcee21 Now with gnatsd released, we're testing it in a few of our environments and will start getting stories in the backlog following our november release. https://github.com/apcera/gnatsd

@christo4ferris
Member

nice!

Cheers,

Christopher Ferris
IBM Distinguished Engineer, CTO Cloud Interoperability
Member, IBM Academy of Technology
IBM Software Group
email:chrisfer@us.ibm.com
Twitter: christo4ferris
phone: +1 508 234 2986

On Oct 22, 2013, at 12:49 PM, "Mark Kropf" notifications@github.com wrote:

@emcee21 Now with gnatsd released, we're testing it in a few of our environments and will start getting stories in the backlog following our november release.


Reply to this email directly or view it on GitHub.

@drnic
Member
drnic commented Oct 22, 2013

Awesome Mark.

@derekcollison

Feel free to hit me with any questions. Will start tagging releases soon, but for now use head of master, I will make sure to keep it passing the tests.

@vito vito pushed a commit that referenced this issue Nov 13, 2013
Alex Suraci Bump src/warden
Bump cloudfoundry/warden:
  Alex Suraci:
     add missing info.proto imports ( Travis Unknown )
     remove arbitrary 5 second timeout for shelling out ( Travis Unknown )
  Matthew Kocher:
     Merge pull request #32 from IronFoundry/master ( Travis Unknown )
  Mark Rushakoff:
     Merge pull request #34 from cloudfoundry/no-timeout ( Travis Unknown )
  Tier 3:
     Add includes for the Windows proto compiler. ( Travis Unknown )
     Change em-warden, warden client and warden proto so that it will work with a local connection with port on windows and not try to connnect to a unix domain. ( Travis Unknown )
  Sean Brady:
     Stylistic changes to specs from pr30 ( Travis Unknown )
     Merge remote-tracking branch 'remotes/origin/pr/30' ( Travis Unknown )
  Maria Shaldibina and Mark Rushakoff:
     Log error when spawning process ( Travis Unknown )
343721e
@jfoley jfoley closed this Apr 19, 2014
@hiremaga hiremaga added a commit that referenced this issue Jul 31, 2014
@parente @hiremaga parente + hiremaga Bump src/acceptance-tests
Bump :
  Peter Parente:
     Increase push and long curl timeouts
  Alex Stupakov:
     Merge pull request #32 from youngm/bundle_services
  youngstrommj:
     Support offline service tests

Signed-off-by: Abhijit Hiremagalur <abhi@pivotallabs.com>
89521ae
@luan luan added a commit that referenced this issue Sep 10, 2014
@luan luan Bump src/gnatsd
Bump apcera/gnatsd:
  Phil Pennock:
     Merge branch 'note_versions' ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/33650103 )
     Add build instructions & version constraint notes ( Travis Unknown )
  Ken Robertson:
     Fix gofmt issues ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/32404911 )
     Fix Travis to properly fail the build on go fmt and go vet. ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/32404824 )
     Added Server.Addr() helper to allow querying of the server's bound address ( Travis Unknown )
  Derek Collison:
     Merge pull request #39 from WuLonghui/hw-issue-1 ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/32340949 )
     Merge pull request #34 from simonleung8/selfReferenceFix ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/31357339 )
     Changed travis image link. ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/30877701 )
     Merge pull request #37 from apcera/coveralls.yml ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/30876789 )
     Merge pull request #36 from apcera/add-coveralls ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/30876077 )
     Just test 1.3 ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/30799027 )
     Make sure to account for route connections ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/30798354 )
     test fixups for 1.3, add in test for leaked route Go routines ( Travis Unknown )
     Fix minor races, add in 1.3 to testing, bump version ( Travis Unknown )
     Docker support for generating single executable image ( Travis Unknown )
     Added cluster restart test with queue subscribers ( Travis Unknown )
     Reload config option. ( Travis Unknown )
     Added some 1.3 options. ( Travis Unknown )
     Merge pull request #31 from apcera/add-addr-helper ( Travis Unknown )
     Moved travis status. ( Travis Unknown )
  w00228948:
     Use authTimeout in setAuthTimer ( Travis Unknown )
  Simon Leung:
     remove self referencing ip/host ( Travis Unknown )
  Jonathon Klobucar:
     Should have been included from the coveralls instructions to know more. ( Travis Unknown )
     Add a small script to run the tests and report to coveralls in travis. ( Travis Unknown )
  Alex Toombs:
     Merge pull request #32 from apcera/allow-external-listener ( Travis Unknown )
     Write back resolved port to options. ( Travis Unknown )
     PR feedback (nits) ( Travis Unknown )
     Allow nats to choose a random port when given port -1. ( Travis Unknown )

[#74057366]
ee71853
@routing-ci routing-ci added a commit that referenced this issue Jun 15, 2016
@routing-ci routing-ci Bump src/routing-release
Bump
  Shash Reddy:
     Add proxyproto to gorouter packaging spec
     Bump src/github.com/cloudfoundry/gorouter
     Revert "Bump src/github.com/cloudfoundry/gorouter"
     Bump src/github.com/cloudfoundry/gorouter
     Bump src/github.com/cloudfoundry/gorouter
     Remove uaa_port and routing_api_port
     Bump src/github.com/cloudfoundry-incubator/routing-api
  Edwin Xie:
     Bump src/github.com/armon/go-proxyproto, src/github.com/cloudfoundry/gorouter
  Shashwathi:
     Merge pull request #32 from shalako/master
  Shannon Coen:
     moved demo to docs
  Routing CI (Automated):
     Create final release 0.134.0
c95d9a2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment