Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hive---执行ddl慢的问题排查 #94

Open
AronChung opened this issue Jan 18, 2021 · 0 comments
Open

Hive---执行ddl慢的问题排查 #94

AronChung opened this issue Jan 18, 2021 · 0 comments
Labels
Hive hive
Projects

Comments

@AronChung
Copy link
Owner

通过namenode的jstack日志分析和追踪,最终发现runnable的threads中有大量的
image

随后根据这篇文章得到启发:
https://cloud.tencent.com/developer/article/1749606

修改Sentry服务的配置项sentry.db.policy.store.owner.as.privilege为NONE, ddl慢的问题得到提升。

  1. Owner权限是Sentry里的权限。这个功能打开之后,创建数据库或者表的用户自动获得这个对象上的owner权限。但是在HDFS上对应的目录还是属于hive用户。
  2. Owner权限只存在于Sentry数据库中并被Sentry客户端在调用Sentry API的时候使用。与HDFS等都无关。在没有开启这个功能的情况下Sentry不会在创建数据库或者表的时候添加owner权限。也就是说对于新建的表或者数据库的owner都是空。Sentry通过判断其他权限比如CREATE/ALL/SELECT等判断用户是否可以对某个对象执行特定的操作。而在开启了这个功能之后,用户在建表或者数据库的时候自动获得owner权限,不需要额外授权就可以访问他自己创建的对象。
@AronChung AronChung added the Hive hive label Jan 18, 2021
@AronChung AronChung added this to Hive in My Blog Jan 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Hive hive
Projects
My Blog
  
Hive
Development

No branches or pull requests

1 participant