New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ambari---集成Azkaban #28

Open

AronChung opened this issue Jan 8, 2019 · 0 comments

Labels

Ambari

Projects

Owner

AronChung commented Jan 8, 2019 •

edited

Loading

azkaban棒谷新项目部署：

在ambari的services目录中新建AZKABAN并写脚本(/var/lib/ambari-server/resources/stacks/HDP/2.6/services)
修改package/scripts/download.ini文件，根据路径将对应的tar包上传到/var/www/html/ambari/HDP/centos6/azkaban目录中
在ambari的actions添加azkaban，并把对应的配置如mysql,zookeeper配置正确
启动并部署完成。

部署过程中的异常：

启动时mysql连接不上以及ha的zookeeper连接超时

检查mysql有无azkaban数据库，且mysql_user有操作权限
检查代码中zookeeper有无写错

执行job时参数有误

检查ha的开发中添加的字段以及字段的默认值，如dependence默认为null

ambari安装azkaban时报错

根据services/AZKABAN/package/scripts/azkaban_web.py脚本逐步执行，并能发现是tar命令无法解压download.ini指定的jar包，一般是用ftp传输时格式出错导致。建议可用sz拉到本地，再用ftp上传至服务器。

在ambari的元数据库中按顺序把表confgroupclusterconfigmapping、configgroup 对应的内容删除即可，若有提示Foreign key的异常则执行SET FOREIGN_KEY_CHECKS=0;再删除即可

启动脚本异常
/bin/sh^M: bad interpreter: No such file or directory
vim filename
利用如下命令查看文件格式
:set ff 或 :set fileformat
可以看到如下信息
fileformat=dos 或 fileformat=unix
利用如下命令修改文件格式
:set ff=unix 或 :set fileformat=unix
:wq (存盘退出)
最后再执行文件

The text was updated successfully, but these errors were encountered:

AronChung added the Azkaban label

AronChung added this to Azkaban in My Blog

AronChung changed the title ~~Azkaban---基于HDP的ambari部署~~ ambari---集成Azkaban

AronChung added Ambari and removed Azkaban labels

AronChung changed the title ~~ambari---集成Azkaban~~ Ambari---集成Azkaban

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment