Skip to content
This repository has been archived by the owner on Jul 10, 2024. It is now read-only.

SUBMARINE-289. Add the distributed applications case about Kaldi on Submarine #106

Closed
wants to merge 6 commits into from

Conversation

huiyangjian
Copy link
Contributor

@huiyangjian huiyangjian commented Nov 25, 2019

What is this PR for?

Used submarine running distributed Kaldi, used thchs30 case, the basic environment needs hadoop 3.1 or above version, need configure Registry DNS Server, prepare Dockerfile and script, and operate according to the document.

What type of PR is it?

[Documentation]

Todos

  • - Task

What is the Jira issue?

https://issues.apache.org/jira/browse/SUBMARINE-289

How should this be tested?

CI Pass

Screenshots (if appropriate)

Questions:

  • Does the licenses files need update? Yes/No
  • Is there breaking changes for older versions? Yes/No
  • Does this needs documentation? Yes/No

Copy link
Member

@jiwq jiwq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The ASF source header refer to http://www.apache.org/legal/src-headers.html#headers @huiyangjian Can u help fix it?

0 upgraded, 33 newly installed, 0 to remove and 30 not upgraded.
Need to get 12.1 MB of archives.
After this operation, 65.8 MB of additional disk space will be used.
Get:1 http://mirrors.aliyun.com/ubuntu xenial/main amd64 libatm1 amd64 1:2.5.1-1.5 [24.2 kB]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can replace the source?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

YES,The "archive.ubuntu.com" source was not added to the dockerfile before. This is the information in the log, and I will replace the content in the log

hhhizzz and others added 2 commits November 26, 2019 16:06
### What is this PR for?
Add SparkSQL interpreter and improve the structure of interpreter

### What type of PR is it?
Feature and Improvement

### Todos
* [*] - add sparkSQL interpreter
* [*] - add Abstract interpreter

### What is the Jira issue?
https://issues.apache.org/jira/browse/SUBMARINE-277

### How should this be tested?
https://travis-ci.org/hhhizzz/submarine/builds/617065629

### Questions:
* Does the licenses files need an update? No
* Are there breaking changes for older versions? Yes, some change in InterpreterProcess
* Does this needs documentation? No

Author: xunix huang <qiwei_huang@qq.com>
Author: luzhonghao <luzhonghao12345@163.com>

Closes apache#107 from hhhizzz/luzhonghao and squashes the following commits:

8dd305d [xunix huang] change exception
4fc0b34 [xunix huang] change exception
dfb2e3d [xunix huang] add license
e31f788 [xunix huang] shade the zeppelin package
409cdad [xunix huang] some fix
8ec5df2 [xunix huang] SUBMARINE-277. Support Spark Interpreter add sparkSQL interpreter
1654fbc [luzhonghao] sparkSqlInterpreter
### What is this PR for?
Remove stubServiceClient from YarnServiceUtils and introduce a Factory based injecting solution. (See jira for further details)

### What type of PR is it?
Refactoring

### Todos
* [ ] - Check whether the refactored test passes.

### What is the Jira issue?
* https://issues.apache.org/jira/browse/SUBMARINE-60

### How should this be tested?
* No need for integration testing, just the UTs.

### Screenshots (if appropriate)
-

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Adam Antal <adam.antal@cloudera.com>

Closes apache#96 from adamantal/SUBMARINE-60 and squashes the following commits:

adb6e62 [Adam Antal] SUBMARINE-60. Remove stubServiceClient from YarnServiceUtils
@xunliu
Copy link
Member

xunliu commented Nov 27, 2019

@huiyangjian Please change PR title, A space is required between SUBMARINE-ID and PR title.
like. SUBMARINE-289. Add the distributed applications case about Kaldi on Submarine

…marine

### What is this PR for?
The default hadoop dependency version of tony is hadoop-2.7.3. We need to change it to 2.9.3

### What type of PR is it?
Improvement

### Todos
* [ ] - Task

### What is the Jira issue?
https://issues.apache.org/jira/browse/SUBMARINE-301

### How should this be tested?
https://travis-ci.org/yuanzac/hadoop-submarine/builds/617518484?utm_medium=notification&utm_source=github_status

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Zac Zhou <zhouquan@apache.org>

Closes apache#109 from yuanzac/topic/SUBMARINE-301 and squashes the following commits:

fa9d112 [Zac Zhou] SUBMARINE-301. Tony default hadoop version is not compatible with submarine.
@huiyangjian huiyangjian changed the title SUBMARINE-289.Add the distributed applications case about Kaldi on Submarine SUBMARINE-289. Add the distributed applications case about Kaldi on Submarine Nov 27, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants