Skip to content

[feature][CGS][engineconn-manager] add support for hadoop3 engine material refresh #995

@v-kkhuang

Description

@v-kkhuang

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Is your feature request related to a problem? Please describe.

Currently, the engineconn manager does not fully support hadoop3 engine material refresh functionality. This can cause issues when engine materials need to be updated or refreshed in hadoop3 environments, affecting engine startup and resource management.

Description

A short description of your feature

This PR adds support for hadoop3 engine material refresh by enhancing the engineconn manager's configuration, command building, and launch processes to properly handle material refresh operations in hadoop3 environments.

Use case

Describe the use case of your feature request and the solution you'd like.

The feature enables:

  1. Proper configuration for hadoop3 material refresh
  2. Enhanced command building for material refresh operations
  3. Improved engine launch process with material refresh support
  4. Better environment variable handling for hadoop3

Solutions

Describe alternatives you've considered.

Alternative: Manual material refresh (current approach - less automated and error-prone)

Anything else

Additional context or screenshots about the feature request.

This change includes:

  • Add configuration options in ECPCoreConf for hadoop3 material refresh
  • Enhance ProcessEngineCommandBuilder to support material refresh commands
  • Update ProcessEngineConnLaunch to handle material refresh during engine startup
  • Improve Environment handling for hadoop3 specific variables

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions