Skip to content

[Feature] The checkpoints path of flink job on streampark should contains job name #3463

Description

@DimitriMok

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

By default, the checkpoint directory of flink job on streampark is consist of base directory configured by parameter "state.checkpoints.dir" on flink-conf.yaml and job id. However, it leads a disaster to distinguish between difference flink job, and it is very difficult to clear checkpoints of unuseful flink job. So I wish streampark community can consider to add job name to checkpoints directory.
BTW, I think streampark can restrict the job name only use English alphabet, number and "-" etc. to protect the checkpoint directory is avaliable absolutely!

For example, there are some cases might be happened:

  1. Flink job upgrade/change/restart. Job Id of flink job changed so that ck directory also change.
  2. Delete unuseful flink job. Delete flink job but not checkpoint directory on streampark, it will be difficult clear after that.
  3. Delete checkpoint directory on streampark is difficult when flink job has made many checkpoints, only can delete it manually.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions