[Umbrella][Agent] Add an agent installer module for agent installation

[justinwwhuang]

Motivation

Due to the fact that in actual deployment environments, the machine on which the inlong agent is located is often not controlled by the platform. Therefore, the inlong agent needs to have the ability to self upgrade. Agent installers are introduced for the installation and self upgrading of agents. He does not need to rely on third-party installation platforms and can achieve a closed loop of agent installation and upgrade capabilities.

Solution

Agent installers have five atomic operations:

1. Download installation package
2. Install through installation package
3. Start process
4. Stop process
5. Uninstall
   The agent installer periodically pulls configuration information from the manager and compares the new and old configurations to obtain three results. Each result corresponds to a process, and each process performs a fixed number of atomic operations.
   

add flow

manager config

local config

Local config module list is empty, manager config module list has one module, then add flow is actived. And 1 2 3 atomic operations will be execued:

• atomic operations 1 will use install package relatived config to download package
  
• atomic operations 2 will use installCommand to install the module
  
• atomic operations 3 will use startCommand to start the module
  
  Then, the module is installed.

update flow

manager config

local config

Local config and manager config has the same module id, but the md5 has changed, update flow is actived. And 1 4 5 2 3 atomic operations will be execued:

• atomic operations 1 will use install package relatived config to download package
  
• atomic operations 4 will use stopCommand to stop the module
  
• atomic operations 5 will use uninstallCommand to uninstall the module
  
• atomic operations 2 will use installCommand to install the module
  
• atomic operations 3 will use startCommand to start the module
  

Task list

• [Improve][Agent] Add an agent installer module for agent installation #9802
• [Improve][Agent] Add installer configuration file #9806
• [Improve][Agent] Add config class for installer #9816
• [Improve][Agent] Add guardian scripts #9829
• [Improve][Agent] Increase configuration acquisition capability #9831
• [Improve][Agent] Add module state to distinguish whether the module has been downloaded or installed #9833
• [Improve][Agent] Add agent installer config request class #9844
• [Improve][Agent] Add the getAuthHeader function in the HttpManager class  #9848
• [Improve][Agent] Add a function to retrieve HttpManager in the ModuleManager class  #9850
• [Improve][Agent] Place the configuration item for the installation package storage path in the installation package configuration #9852
• [Improve][Agent] Increase local read and write capabilities for module config #9858
• [Improve][Agent] Increase installation package download capability and local MD5 computing power #9859
• [Improve][Agent] Delete test code #9889
• [Improve][Agent] Add configuration comparison logic and processing of comparison results  #9906
• [Improve][Agent] Add unit test for installer #9909
• [Improve][Agent] Increase daily verification for process monitoring, reinstallation, or re downloading #9910
• [Improve][Agent] Add a configuration copy script to copy the configuration from the installer to the agent #9922

InLong Component

InLong Agent

Are you willing to submit PR?

• Yes, I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[dockerzhang]

close it for all sub-tasks finshed.