when use hdfs load, I got kerberos authentication problem when access hdfs #26171
Unanswered
huayucai
asked this question in
A - General / Q&A
Replies: 1 comment
-
|
put hdfs-site.xml and core-site.xml under DORIS_BE/conf and restart be , problem solved. So now the problem is that by doing so , it prevents me from loading data from any other hdfs. Is this a proper way? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
LOAD LABEL test.label_2023

(
DATA INFILE("hdfs://neoap047:8020/tmp/test.txt")
INTO TABLE
load_hdfs_file_testCOLUMNS TERMINATED BY " "
(id,age,name)
)
with HDFS (
"fs.defaultFS"="hdfs://neoap047:8020",
"dfs.nameservices" = "test",
"dfs.ha.namenodes.test" = "nn1,nn2",
"dfs.namenode.rpc-address.test.nn1" = "neoap047:8020",
"dfs.namenode.rpc-address.test.nn2" = "neoap048:8020",
"dfs.client.failover.proxy.provider.test" = "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",
"hadoop.security.authentication" = "kerberos",
"hadoop.kerberos.keytab" = "/etc/security/keytabs/doris.keytab",
"hadoop.kerberos.principal" = "doris@HADOOP.COM"
);
Beta Was this translation helpful? Give feedback.
All reactions