Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create cluster interfaces and refactor #269

Merged
merged 161 commits into from
Feb 25, 2014

Conversation

pauldix
Copy link
Member

@pauldix pauldix commented Feb 25, 2014

Complete refactoring of how clustering works and how data is distributed. Addition of WAL, write buffering, and failover for queries when a server is downed.

…er package.

* fix backfill of continuous queries to actually work
…ment in raft server. Update server to work with new cluster configuration.
…unning queries.

Coordinator will have the responsibility for distributing the query and possibly running through the engine. This is because the results returned by remote servers may not need to be run through the engine. I'll fix the engine tests later when this refactoring is completed to work with the new sharding style of clustering.
…ard instead of by the coordinator. Moved filtering over to engine.
Hits shards and replicates out.
Gets logged into the WAL on the receiving server.
Removed old implementation.
Add the passthrough query processor. This can be used later if deletes return the number of rows deleted.
* Added ability to have a query spec execute against all servers in a shard.
* Ensured that both deletes and drops run against all servers.
toddboom and others added 26 commits February 24, 2014 15:02
…don't aggregate locally weren't closing out the seriesWriter.
…h isn't shared state. Updated initialization and recovery to set the local server id based on if a given server's Raft name matches the raft name set locally.
…g simpler.

Retries are handled elsewhere either by the write buffer or the client making the request. Connection status and other weird reconnect things where simplified to use a single lock.
Was caused by the response channels in coordinator filling up and blocking the response reader for a given cluster server (protobuf client). Added buffer size as a configuration option.
fixes #132, fixes #103, fixes #65

Merge branch 'master' into create-cluster-interfaces-and-refactor

Conflicts:
	src/api/http/api.go
	src/api/http/api_test.go
	src/coordinator/cluster_configuration.go
Conflicts:
	src/api/http/api.go
	src/coordinator/coordinator.go
	src/coordinator/raft_server.go
pauldix added a commit that referenced this pull request Feb 25, 2014
…efactor

Create cluster interfaces and refactor
@pauldix pauldix merged commit 86e21f7 into master Feb 25, 2014
@jvshahid jvshahid deleted the create-cluster-interfaces-and-refactor branch March 3, 2014 23:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants