Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Added commands printconfig and reloadconfig #162

Closed
wants to merge 157 commits into
from

Conversation

Projects
None yet
1 participant
Contributor

FinchPowers commented Nov 12, 2012

The former is used to print the cluster config.
The later is used to update it with the config file. Usefull to update nodes AMI, instance types and spot bid price without the need to terminate the cluster.

FinchPowers added some commits Nov 9, 2012

@FinchPowers FinchPowers Added command to reload configs 967d49c
@FinchPowers FinchPowers No nfs for datacratic, datacratic plugin 8632c7b
@FinchPowers FinchPowers When requesting spot instances, looping untils SIR are returned by am…
…azon
45620fe
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev a1e9493
@FinchPowers FinchPowers Added a command to clean a cluster from dead spot instances 1303779
@FinchPowers FinchPowers Fixed commands names to fit with the rest of StarCluster commands 9974d10
@FinchPowers FinchPowers Merge branch 'dev_config_fcts' into develop 4f8331a
@FinchPowers FinchPowers Balancer now supports ignore master flag, stats include the queue whi…
…le the stats buffer is not full, each loop run calls cleancluster
b938518
@FinchPowers FinchPowers Merge branch 'dev_balancer_improvements' into develop 2786219
@FinchPowers FinchPowers Replaced a mkdir with makedirs, when removing from /etc/hosts, not on…
…ly removing by alias but also by ip
428c03a
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev b53f093
@FinchPowers FinchPowers Added missing functions 8c90d0b
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop b9beef7
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev 8dacaf3
@FinchPowers FinchPowers Moved fct where it belongs, added missing import 4475bb7
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop fc29730
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev 9c98d90
@FinchPowers FinchPowers Patience added when creating placement groups 888b7f3
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev 0ebedd7
@FinchPowers FinchPowers Adding both datacratic plugins fe2e4e3
@FinchPowers FinchPowers Post datacratic plugin sets slots to 1 on nodes 5aace9b
@FinchPowers FinchPowers Added back the ignore-master param 40b9749
@FinchPowers FinchPowers Merge branch 'dev_balancer_improvements' into develop 130e459
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev fa47494
@FinchPowers FinchPowers Fixing sge only_clean_master c8d9883
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop 93f572d
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev ac5bfaa
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into dev_balancer_improvements 3108d43
@FinchPowers FinchPowers No crash if the error is due to no jobs ran yet c7887cf
@FinchPowers FinchPowers Merge branch 'dev_balancer_improvements' into develop 4cf0ce9
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev 3233247
@FinchPowers FinchPowers adding traceback import 99bafe0
@FinchPowers FinchPowers Fix attempt for serialization problem 4528789
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop 0545949
@FinchPowers FinchPowers Removed the labda fct as another fix attempt 8a52b97
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop acaf88c
@FinchPowers FinchPowers Yet another pickling fix attempt 585cb25
@FinchPowers FinchPowers Merge branch 'dev_cleancluster' into develop d452d89
@FinchPowers FinchPowers Merge branch 'develop' into datacratic_dev 79eba97
@FinchPowers FinchPowers Debuging info for pickling f3e443c

Node name must be node### otherwise it will fail to get the slots count. With the loadbalancer, slots are supposed to have the default name anyway.

FinchPowers added some commits Nov 26, 2012

@FinchPowers FinchPowers Merged latest recover modifications ca8c94e
@FinchPowers FinchPowers Added wakeup time to loadbalancer 194c371
@FinchPowers FinchPowers More thread pool safety 4653b57
@FinchPowers FinchPowers Setting timeout over socket 5260357
@FinchPowers FinchPowers more debug output 9fdb58f
@FinchPowers FinchPowers Merge branch 'dev_ssh_timeouts' into datacratic_dev 59bb330
@FinchPowers FinchPowers Reverting as it was already done within _get_socket 74759f4
@FinchPowers FinchPowers Merge branch 'dev_ssh_timeouts' into datacratic_dev 11f08b8
@FinchPowers FinchPowers BLUK-71 debug for issue with slots key f3ec576
@FinchPowers FinchPowers BLUK-59 shutdown timer based on launch_time e56102c
@FinchPowers FinchPowers Fixed stuck qrsh killer, do not complain if pkill sge_execd fails on …
…nodes
b6bb917
@FinchPowers FinchPowers Merge pull request #1 from jtriley/develop
Merging with trunk
4db7cfd
@FinchPowers FinchPowers Debug info 88509c4
@FinchPowers FinchPowers Merge branch 'datacratic_dev' of github.com:datacratic/StarCluster in…
…to datacratic_dev
2429b1e
@FinchPowers FinchPowers Fixed qrsh kill condition dd4f90a
@FinchPowers FinchPowers BLUK-60 waiting for ssh forced timeout 4615ba3
@FinchPowers FinchPowers BLUK-92 enforcing node destruction if clean calls fail b91cf51
@FinchPowers FinchPowers Enforcing node removal to ultimately call terminate. 318b09b
@FinchPowers FinchPowers Removing prod plugin, mounting bk dir with sshfs on nodes. f76ab19
@FinchPowers FinchPowers Merged with jtriley:develop 82e4cb8
@FinchPowers FinchPowers Ading debug to see why the pool doesn't shutdown properly c3aa833
@FinchPowers FinchPowers Merge pull request #3 from jtriley/develop
Trunk merge
e9e41c9
@FinchPowers FinchPowers BLUK-27, using complex values should prevent node overload, no more s…
…lots=1 on nodes.
00545b3
@FinchPowers FinchPowers BLUK-67 debug output removed 51a8688
@FinchPowers FinchPowers Merge branch 'datacratic_dev' of github.com:datacratic/StarCluster in…
…to datacratic_dev
92dba6c
@FinchPowers FinchPowers Should fix part of the incident BLUK-99 be2657a
@FinchPowers FinchPowers Merge pull request #5 from jtriley/develop
Develop
ff2b027
@FinchPowers FinchPowers BLUK-99 add/remove errors from thread pool have better debug output a496889
@FinchPowers FinchPowers Fixed dce file execution permission e4b6494
@FinchPowers FinchPowers nodes back to 1 slot 992b919
@FinchPowers FinchPowers Merged with trunk 4ff6032
@FinchPowers FinchPowers BLUK-71 last job dies provoke lost qrsh 530d62f
Contributor

FinchPowers commented Dec 13, 2012

Broken by latest changes to jtriley:develop. I'll fix it and recomment.

Contributor

FinchPowers commented Dec 14, 2012

Fixed

Contributor

FinchPowers commented Jan 17, 2013

This branch now contains commits that are too custom for StarCluster global version. If there is interrest I can recreate a clean version of print/reload config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment