Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

实现TIS与Zeppling的整合弥补TIS在数据可视化方面的短板 #161

Closed
Tracked by #154
baisui1981 opened this issue Nov 11, 2022 · 3 comments
Closed
Tracked by #154
Labels
3.7.1 enhancement New feature or request
Milestone

Comments

@baisui1981
Copy link
Member

baisui1981 commented Nov 11, 2022

TIS目前已经实现 ETL 数仓的 抽取(E)和加载(L),转化(T)还没有很深涉足。

不过在ETL之上另外一块比较重要的是数据的可视化,当用户在处理数据的过程,数据具体的状态是否大要处理的预期效果,目前还要要通过TIS之外的客户端工具来查看的,目前发现社区有一款比较优秀的产品 zepplin,隶属于Apache基金会。特点是用java实现,支持的端比较丰富,前端也是用Angular来实现的。

从直觉上来看,对其加以改造可以与TIS进行整合以弥补在数据可视化方面的短板。

@baisui1981 baisui1981 mentioned this issue Nov 11, 2022
6 tasks
@baisui1981
Copy link
Member Author

baisui1981 commented Nov 11, 2022

  • zeppelin index package http://localhost:9010/#/: zeppelin-web-angular/src/app/pages/login/login.component.html
  • 疑似是angular路由配置: zeppelin-web/src/app/app.js
  • 服务端响应的WebSocket 类:zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java L1627 runParagraph执行具体的paragraph逻辑
  • 对应的解释器:jdbc/src/main/java/org/apache/zeppelin/jdbc/JDBCInterpreter.java L510创建Connection对象需要扩展

@baisui1981 baisui1981 added enhancement New feature or request 3.7.1 labels Nov 28, 2022
@baisui1981
Copy link
Member Author

已经实现了

@baisui1981
Copy link
Member Author

baisui1981 commented Apr 4, 2023

模块 作用
Zeppelin: Common
Zeppelin: Interpreter
Zeppelin: Interpreter Shaded 生成 interpreter/zeppelin-interpreter-shaded-0.10.2-SNAPSHOT.jar
Zeppelin: Zengine
Zeppelin: JDBC interpreter
Zeppelin: Elasticsearch interpreter
Zeppelin: Client
Zeppelin: Server
Zeppelin: Packaging distribution 构建zeppelin工程包,被zeppelin-package 所依赖
jdbc-tis 构建 interpreter/jdbc-tis
elasticsearch-tis 构建interpreter/elasticsearch-tis
zeppelin-package 构建 tis-zeppelin-0.10.1-bin-all.tar.gz ZEPPELIN_HOME 对应的包文件
tis-zeppelin 构建 tis-uber 下zeppelin相关的context 包文件

@baisui1981 baisui1981 added this to the v3.7.1 milestone Apr 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3.7.1 enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant