HDDS-2793. concept/Datanodes.md translation #520

iamabug · 2020-02-03T07:23:49Z

What changes were proposed in this pull request?

Datanodes.zh.md added

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-2793

How was this patch tested?

hugo server -D

iamabug · 2020-02-03T07:30:50Z

hadoop-hdds/docs/content/concept/Datanodes.zh.md

+This extra indirection helps tremendously with scaling Ozone. SCM has far
+less block data to process and the name node is a different service are
+critical to scaling Ozone.


the name node is a different service are critical to scaling Ozone

I think it does not make sense in grammar.

Good catch. Can you change EN document from "name node is a" to " namespace service (Ozone Manager) as a "? That will make sense.

xiaoyuyao · 2020-02-22T23:35:11Z

hadoop-hdds/docs/content/concept/Datanodes.zh.md

 date: "2017-09-14"
 weight: 4
-summary: TODO translated summary
+summary: Ozone 支持 Amazon 的简易存储服务（S3）协议，你可以原封不动地在 Ozone 上使用基于 S3 客户端和 S3 SDK 的应用。


Amazon 的简易存储服务（S3）=> Amazon S3

xiaoyuyao · 2020-02-22T23:51:54Z

hadoop-hdds/docs/content/concept/Datanodes.zh.md

+![FunctionalOzone](ContainerMetadata.png)
+
+Ozone 的存储容器是一个自包含的超级块，容器中包含一系列的 Ozone 块，以及存储实际数据的磁盘文件，这是默认的存储容器格式。对于 Ozone 来说，容器只是提供了一个协议说明，实际的存储方式并不重要，换句话说，扩展或引入新的容器设计也是很容易的。因此，上述格式应当被看作是 Ozone 存储容器的参考实现。


协议说明=>协议规范

实际的存储方式并不重要=》它独立于具体的存储格式实现。

扩展或引入新的容器设计也是很容易的=》我们可以很容易扩展或引入新的容器实现格式。

xiaoyuyao · 2020-02-22T23:57:52Z

hadoop-hdds/docs/content/concept/Datanodes.zh.md

+### 容器的位置发现
+
+SCM 如何获得容器的位置？方法和 HDFS 中的方法十分相似。数据节点会定期发送类似于块报告的容器报告，但比块报告的内容简洁的多，比如，对于一个存储容量为 196 TB 的单数据节点组成的集群，Ozone 大概会拥有四万个容器，相比于 HDFS 的一百五十万个块，块报告数量缩减为四十分之一。


方法和 HDFS 中的方法十分相似=》这一点和现有的HDFS 十分相似

但比块报告的内容简洁的多=》容器报告比块报告的内容简洁的多

196 TB 的单数据节点组成的集群-》196 TB 的集群

xiaoyuyao

LGTM， a few comments added inline

iamabug · 2020-03-07T06:33:59Z

retest

xiaoyuyao

LGTM, +1.

xiaoyuyao · 2020-03-16T23:09:07Z

I check the acceptance test logs which points to the om-ha tests with permission issue. This does not seem to relate to the document change here. cc: @hanishakoneru and @bharatviswa504

2019-11-16T11:59:00.0117168Z ==============================================================================
2019-11-16T11:59:00.0120741Z ozone-om-ha-testOMHA :: Smoketest ozone cluster startup
2019-11-16T11:59:00.0121273Z ==============================================================================
2019-11-16T11:59:12.8359463Z Stop Leader OM and Verify Failover | FAIL |
2019-11-16T11:59:12.8360383Z OSError: [Errno 13] Permission denied: '/opt/hadoop/tmpsCDIs5'
2019-11-16T11:59:12.8360708Z ------------------------------------------------------------------------------
2019-11-16T12:01:07.8768425Z Restart OM and Verify Ratis Logs | PASS |
2019-11-16T12:01:07.8772261Z ------------------------------------------------------------------------------
2019-11-16T12:01:24.9714368Z Test Multiple Failovers | FAIL |
2019-11-16T12:01:24.9715403Z OSError: [Errno 13] Permission denied: '/opt/hadoop/tmpLn9PKJ'
2019-11-16T12:01:24.9715697Z ------------------------------------------------------------------------------
2019-11-16T12:01:24.9742716Z ozone-om-ha-testOMHA :: Smoketest ozone cluster startup | FAIL |
2019-11-16T12:01:24.9749529Z 3 critical tests, 1 passed, 2 failed
2019-11-16T12:01:24.9749662Z 3 tests total, 1 passed, 2 failed

hanishakoneru · 2020-03-18T16:29:01Z

@xiaoyuyao, OM-HA tests are disabled and should not be running.
In the following CI run, the acceptance test suite does not run OM-HA tests:
https://github.com/apache/hadoop-ozone/pull/520/checks?check_run_id=485882139

Is there any other run you are referring to?

xiaoyuyao · 2020-03-18T16:40:48Z

If you download the acceptance test results from the link and
https://github.com/apache/hadoop-ozone/suites/485213917/artifacts/2531797

search for this file 7_Run .hadoop-ozonedev-supportchecksacceptance.sh.txt
You can find the error above.

xiaoyuyao · 2020-03-18T16:49:22Z

==============================================================================
2019-11-16T11:59:00.0120726Z ozone-om-ha-testOMHA :: Smoketest ozone cluster startup
2019-11-16T11:59:00.0121265Z ==============================================================================
2019-11-16T11:59:12.8359426Z Stop Leader OM and Verify Failover | FAIL |
2019-11-16T11:59:12.8360374Z OSError: [Errno 13] Permission denied: '/opt/hadoop/tmpsCDIs5'
2019-11-16T11:59:12.8360702Z ------------------------------------------------------------------------------
2019-11-16T12:01:07.8768389Z Restart OM and Verify Ratis Logs | PASS |
2019-11-16T12:01:07.8772219Z ------------------------------------------------------------------------------
2019-11-16T12:01:24.9714328Z Test Multiple Failovers | FAIL |
2019-11-16T12:01:24.9715394Z OSError: [Errno 13] Permission denied: '/opt/hadoop/tmpLn9PKJ'
2019-11-16T12:01:24.9715691Z

hanishakoneru · 2020-03-18T18:34:16Z

This error is from an old run. Confirmed with @xiaoyuyao that the new runs do not have the OM HA tests.

adoroszlai · 2020-04-04T17:53:29Z

Thanks @iamabug for the translation and @xiaoyuyao for reviewing it.

HDDS-2793. concept/Datanodes.md translation

608e77f

iamabug commented Feb 3, 2020

View reviewed changes

iamabug requested a review from xiaoyuyao February 3, 2020 08:08

adoroszlai added the documentation Improvements or additions to documentation label Feb 3, 2020

xiaoyuyao reviewed Feb 22, 2020

View reviewed changes

xiaoyuyao reviewed Feb 23, 2020

View reviewed changes

Xiang Zhang and others added 2 commits February 23, 2020 11:15

HDDS-2793. concept/Datanodes.md translation

19c5f20

retrigger build with empty commit

3815469

xiaoyuyao approved these changes Mar 16, 2020

View reviewed changes

xiaoyuyao mentioned this pull request Mar 18, 2020

HDDS-2621. Enable OM HA acceptance tests. #265

Merged

trigger new CI check

8e16961

adoroszlai merged commit 0fbacbc into apache:master Apr 4, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HDDS-2793. concept/Datanodes.md translation #520

HDDS-2793. concept/Datanodes.md translation #520

iamabug commented Feb 3, 2020

iamabug Feb 3, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao Feb 22, 2020

xiaoyuyao left a comment

iamabug commented Mar 7, 2020

xiaoyuyao left a comment

xiaoyuyao commented Mar 16, 2020

hanishakoneru commented Mar 18, 2020

xiaoyuyao commented Mar 18, 2020

xiaoyuyao commented Mar 18, 2020

hanishakoneru commented Mar 18, 2020

adoroszlai commented Apr 4, 2020

		![FunctionalOzone](ContainerMetadata.png)

		Ozone 的存储容器是一个自包含的超级块，容器中包含一系列的 Ozone 块，以及存储实际数据的磁盘文件，这是默认的存储容器格式。对于 Ozone 来说，容器只是提供了一个协议说明，实际的存储方式并不重要，换句话说，扩展或引入新的容器设计也是很容易的。因此，上述格式应当被看作是 Ozone 存储容器的参考实现。

		### 容器的位置发现

		SCM 如何获得容器的位置？方法和 HDFS 中的方法十分相似。数据节点会定期发送类似于块报告的容器报告，但比块报告的内容简洁的多，比如，对于一个存储容量为 196 TB 的单数据节点组成的集群，Ozone 大概会拥有四万个容器，相比于 HDFS 的一百五十万个块，块报告数量缩减为四十分之一。

HDDS-2793. concept/Datanodes.md translation #520

HDDS-2793. concept/Datanodes.md translation #520

Conversation

iamabug commented Feb 3, 2020

What changes were proposed in this pull request?

What is the link to the Apache JIRA

How was this patch tested?

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

xiaoyuyao left a comment

Choose a reason for hiding this comment

iamabug commented Mar 7, 2020

xiaoyuyao left a comment

Choose a reason for hiding this comment

xiaoyuyao commented Mar 16, 2020

hanishakoneru commented Mar 18, 2020

xiaoyuyao commented Mar 18, 2020

xiaoyuyao commented Mar 18, 2020

hanishakoneru commented Mar 18, 2020

adoroszlai commented Apr 4, 2020