Skip to content

[Improvement] Any plans for Kyuubi Flink Engine on YARN to support Kerberos? #6850

@creazyboyone

Description

@creazyboyone

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

I have flink, hive hadoop cluster with kerberos, and want to use kyuubi access flink sql using yarn-session mode
so i get some error:
kyuubi-flink-sql-engine.log
kyuubi-server-hadoop98.test.com.log

I found this guide: https://kyuubi.readthedocs.io/en/master/deployment/engine_on_yarn.html#deploy-kyuubi-flink-engine-on-yarn

Deploy Kyuubi Flink Engine on YARN,YARN Session Mode,Kerberos
With regard to YARN session mode, security.kerberos.login.keytab and security.kerberos.login.principal are not effective, as Kyuubi Flink SQL engine mainly relies on Flink SQL client which currently does not support

so, Are there any plans for Kyuubi Flink Engine on YARN to support Kerberos?

How should we improve?

I don't know.

Maybe:
kyuubi/kyuubi-server/src/main/scala/org/apache/kyuubi/client/KyuubiSyncThriftClient.scala add some method like getPlainTransport() and support SASL. i am not sure

Are you willing to submit PR?

  • Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
  • No. I cannot submit a PR at this time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions