kyuubi spark engine initiate fail

[pore2c]

Hi i am facing issues using kyuubi with spark on eks
kyuubi is deployed on eks and deployed namespace is "test"
when i created a session by calling the kyuubi session api,
kyuubi executed spark-submit command and i got this error
spark deploy mode is cluster

Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException: Namespace mismatch. Item namespace:default. Operation namespace:test.
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.checkNamespace(OperationSupport.java:234)
at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleCreate(OperationSupport.java:304)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:644)
at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleCreate(BaseOperation.java:83)
at io.fabric8.kubernetes.client.dsl.base.CreateOnlyResourceOperation.create(CreateOnlyResourceOperation.java:61)
at org.apache.spark.deploy.k8s.submit.Client.run(KubernetesClientApplication.scala:152)
at org.apache.spark.deploy.k8s.submit.KubernetesClientApplication.$anonfun$run$5(KubernetesClientApplication.scala:248)
at org.apache.spark.deploy.k8s.submit.KubernetesClientApplication.$anonfun$run$5$adapted(KubernetesClientApplication.scala:242)
at org.apache.spark.util.Utils$.tryWithResource(Utils.scala:2764)
at org.apache.spark.deploy.k8s.submit.KubernetesClientApplication.run(KubernetesClientApplication.scala:242)
at org.apache.spark.deploy.k8s.submit.KubernetesClientApplication.start(KubernetesClientApplication.scala:214)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:958)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:165)
at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:163)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1046)
at org.apache.spark.deploy.SparkS23/08/10 08:39:31 INFO ShutdownHookManager: Shutdown hook called

I set the following two configs related to the namespace
kyuubi.kubernetes.namespace=test
spark.kubernetes.namespace=test

How can i properly set the "item namespace"

[yaooqinn]

where/how did you set spark.kubernetes.namespace

[pore2c]

i fix this issue
i used podTemplate option "spark.kubernetes.driver.podTemplateFile"
"default" is seted in podTemplate manifest namespace
spark can not rewrite the pod template namespace
deleting namespace in manifest fixed this issue