Skip to content

[perf][COM][kerberos] optimize keytab file caching to prevent full gc issues #971

@v-kkhuang

Description

@v-kkhuang

Search before asking

  • I had searched in the issues and found no similar issues.

Linkis Component

  • linkis-commons
  • linkis-computation-governance
  • linkis-dist
  • linkis-engineconn-plugin
  • linkis-extensions
  • linkis-orchestrator
  • linkis-public-enhancements
  • linkis-spring-cloud-services
  • linkis-web

Description

Keytab file caching mechanism causes Full GC issues, affecting system performance and stability.

Steps to reproduce

  1. Enable keytab authentication
  2. Run for an extended period
  3. Monitor JVM memory usage

Expected behavior

Keytab file caching should not cause Full GC and should be optimized for better memory management.

Your environment

  • Linkis version used: 2.0.0
  • Environment name and version:
    • hadoop-3.3.4
    • hive-2.3.3
    • spark-2.4.3/3.3.0
    • scala-2.11.12
    • jdk 1.8.0_xxx

Anything else

This is a performance optimization to improve system stability in Kerberos authentication scenarios.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions