Skip to content
This repository has been archived by the owner on Mar 3, 2023. It is now read-only.

New scheduler #128

Merged
merged 56 commits into from
Mar 8, 2016
Merged

New scheduler #128

merged 56 commits into from
Mar 8, 2016

Conversation

kramasamy
Copy link
Contributor

This branch includes a lot of changes -

  • includes nice packaging of heron client using self extracting binary
  • includes more modularization of scheduler, so that statemgr, uploader and scheduler are abstracted
  • standardizing all config on yaml
  • introduction of config builder pattern
  • lots of code cleanup in scheduler

Karthik Ramasamy and others added 30 commits February 11, 2016 13:44
initial version of context and IUploader
8140c70
modularized all the uploaders
bb1f303
moved packing algorithms to packing, updated IPackingAlgorithm
c39e51f
moved tests for utils
04c9a8b
Make context an immutable map
489d807
Merge branch 'karthik/newscheduler' of github.com:twitter/heron into …
7451a21 
…karthik/newscheduler
added tests for round robin packing and separated creation of test to…
674731f 
…pologies from tests
added tests for round robin packing and separated creation of test to…
b8246e7 
…pologies from tests
minor changes to Context
891b577
Merge branch 'karthik/newscheduler' of github.com:twitter/heron into …
2691ac4 
…karthik/newscheduler
added config parsing
633d7dd
resolve conflicts in Context
6c44c9c
initial version of config loading
1e41e0b
fix Context error
9a66015
move newuploader to uploader and fix compilation of uploaders
5af5815
Merge branch 'karthik/newscheduler' of https://github.com/twitter/heron…
f4eb153 
… into karthik/newscheduler
cleanup spi directory and compiles
114fda7
NullStateManager cleanup
324004d
Merge branch 'karthik/newscheduler' of github.com:twitter/heron into …
b8556f7 
…karthik/newscheduler
Move state manager out from spi
f3f825b
state manager clean up
1f0b084
changed FileUtility to FileUtils
35429e7
Merge branch 'karthik/newscheduler' of https://github.com/twitter/heron…
7b56185 
… into karthik/newscheduler
fix BUILD
0ca1cd1
cleanup to close
a1639c6
statemanager add comments
66cb92c
Merge branch 'karthik/newscheduler' of https://github.com/twitter/heron…
b70c14c 
… into karthik/newscheduler
changes to scheduler
e3e2ce4
packaging, self extracting tar balls and fixed bugs in local uploader…
037f408 
…, statemgr and submitter
added package release files
ee440b9
Karthik Ramasamy and others added 17 commits March 4, 2016 00:26
fixed local scheduler to compile using config key value pairs
bf4a3d5
self extracting binary uses tar balls
2c2543c
self extracting binary uses tar balls
6caaf8f
debugged the local scheduler
8279265
ensured unit tests work
97ca486
added a config keys test
0995293
added test to check the defaults read from defaults.yaml
35f2154
added a test to check if defaults values have corresponding config keys
7cccd75
added another test for checking variable substitution
c7bfa36
Added scheduler state manager adaptor, graceful shutdown of scheduler…
e52ef69 
…, code refactoring
fixed the shutdown issue
fa225c2
check if the topology running before we apply runtime commands activa…
ab6169e 
…te/deactivate/kill/restart
added final for safe inner class access
9967c2b
fix tmaster so that it takes metrics_sinks.yaml
5b641d1
Merge branch 'karthik/newscheduler' of https://github.com/twitter/heron…
f4a634d 
… into karthik/newscheduler
resolve conflicts from master
6d5e644
fix tmaster and stmgr tests
cbbcdef
@jingwei
Copy link
Contributor

jingwei commented Mar 8, 2016

shipit

@jingwei jingwei closed this Mar 8, 2016
@jingwei jingwei reopened this Mar 8, 2016
@maosongfu
Copy link
Contributor

will review it tonight

@kramasamy kramasamy self-assigned this Mar 8, 2016
kramasamy added a commit that referenced this pull request Mar 8, 2016
@kramasamy
Merge pull request #128 from twitter/karthik/newscheduler
6db70be 
New scheduler
@kramasamy kramasamy merged commit 6db70be into master Mar 8, 2016
@kramasamy kramasamy mentioned this pull request Mar 8, 2016
Closed
@jingwei jingwei deleted the karthik/newscheduler branch March 9, 2016 19:48
@kramasamy kramasamy mentioned this pull request Apr 5, 2016
Closed
saileshmittal pushed a commit that referenced this pull request May 18, 2016
@kramasamy
Merge pull request #128 from twitter/karthik/newscheduler
05f1495 
New scheduler
saileshmittal pushed a commit that referenced this pull request May 19, 2016
@kramasamy
Merge pull request #128 from twitter/karthik/newscheduler
ae04f18 
New scheduler
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees

@kramasamy kramasamy

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@kramasamy @jingwei @maosongfu