Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[meta] Add features for managing a running cluster #308

Open
PACordonnier opened this issue Apr 18, 2023 · 1 comment
Open

[meta] Add features for managing a running cluster #308

PACordonnier opened this issue Apr 18, 2023 · 1 comment

Comments

@PACordonnier
Copy link
Member

PACordonnier commented Apr 18, 2023

TDP-Lib should be able to manage a cluster already deployed and not only deploy from scratch.

This includes:

  • Stop/Start services on a single host (for maintenance purposes)
  • Deploy on a single host (adding a new worker to a cluster)
  • Restart a single service on a single host (i.e: restart the current HBase Master)
  • Manage reconfiguration deployment and restart of required services as two asynchronous operation
    • Users should be able to rolling-restart the appropriate services
  • Filter out the operation that are matched by 0 host.

This probably requires some change in the tdp-lib core:

@helenagodard
Copy link

helenagodard commented Apr 28, 2023

Via TDP-lib, ability to Manage Configuration Groups, for each installed service (HDFS, YARN, HBASE,HIVE...)

For example, after deploying cluster with default configuration settings, each host belongs to one configuration group that has default configuration settings for the YARN service. Due to differences in the hardware, we should be able to create specific group and associate hosts in the most appropriate configGroup (like yarn_hardware_type_A/yarn_hardware_type_B,default...)

clone by TOSIT-IO/tdp-collection#258 ?

@PaulFarault PaulFarault changed the title Add features for managing a running cluster [meta] Add features for managing a running cluster May 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants