Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-5405. Refactor pom files for HadoopRpc and Grpc/Ratis compilation properties. #2386

Merged
merged 5 commits into from Jul 6, 2021

Conversation

mukul1987
Copy link
Contributor

What changes were proposed in this pull request?

Refactor the pom files to differentiate proto files compiled for hadooprpc and grpc related proto files

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-5405

How was this patch tested?

compilation succeeds and existing unit tests pass

Copy link
Member

@ayushtkn ayushtkn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanx @mukul1987 for the work here:
Guess you need to update here as well:
https://github.com/apache/ozone/blob/master/hadoop-hdds/common/src/main/resources/hdds-version-info.properties#L26

https://github.com/apache/ozone/blob/master/hadoop-ozone/common/src/main/resources/ozone-version-info.properties#L27

Else on ozone version it isn't printing the protobuf version, give a check once

Source code repository https://github.com/apache/hadoop-ozone.git -r 2e802035524be64323c9ba51d49aa6743b2fc1e7
Compiled by ayushsaxena on 2021-07-05T05:04Z
Compiled with protoc ${protobuf.version}
From source with checksum fe96641cc7e1e3154a11d5656a18992
With Apache Ratis: 2.1.0-ff8aa66-SNAPSHOT from ff8aa668f1a0569ba5e6b0f30dbd51a673913344

Using HDDS 1.2.0-SNAPSHOT
Source code repository https://github.com/apache/hadoop-ozone.git -r 2e802035524be64323c9ba51d49aa6743b2fc1e7
Compiled by ayushsaxena on 2021-07-05T05:03Z
Compiled with protoc ${protobuf.version}
From source with checksum 2195247c589f9b7ac11c30949830147

Copy link
Contributor

@bharatviswa504 bharatviswa504 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to clarify my understanding, where we use hadoop rpc we use hadoop.rpc.version, where we use ratis grpc like datanode, we use grpc protobuf version.

And also one more question, We have proto version printing previously hadoop rpc protobuf version, a question do we want to add 2 one with hadoop rpc and other grpc protobuf version also?

@mukul1987
Copy link
Contributor Author

Thanks for the reviews @ayushtkn and @bharatviswa504, I have addressed the review comments.

Also, I have created a jira to harmonize the protobuf version across both protocols.

@mukul1987
Copy link
Contributor Author

Just to clarify my understanding, where we use hadoop rpc we use hadoop.rpc.version, where we use ratis grpc like datanode, we use grpc protobuf version.

And also one more question, We have proto version printing previously hadoop rpc protobuf version, a question do we want to add 2 one with hadoop rpc and other grpc protobuf version also?

Yes, thats correct. I am now also including the protobuf versions in the output.

Copy link
Member

@ayushtkn ayushtkn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mukul1987 mukul1987 merged commit 9948632 into apache:master Jul 6, 2021
@mukul1987 mukul1987 deleted the HDDS-5405 branch July 6, 2021 04:53
errose28 added a commit that referenced this pull request Jul 6, 2021
…ing-upgrade

* upstream/master:
  HDDS-5332. Add a new column family and a service provider in Recon DB for Namespace Summaries (#2366)
  HDDS-5405. Refactor pom files for HadoopRpc and Grpc/Ratis compilation properties. (#2386)
  HDDS-5406. add proto version to all the proto files. (#2385)
errose28 added a commit to errose28/ozone that referenced this pull request Jul 7, 2021
* master: (28 commits)
  HDDS-5332. Add a new column family and a service provider in Recon DB for Namespace Summaries (apache#2366)
  HDDS-5405. Refactor pom files for HadoopRpc and Grpc/Ratis compilation properties. (apache#2386)
  HDDS-5406. add proto version to all the proto files. (apache#2385)
  HDDS-5398. Avoid object creation in ReplicationManger debug log statements (apache#2379)
  HDDS-5396. Fix negligence issue conditional expressions in MockCRLStore.java (apache#2380)
  HDDS-5395. Avoid unnecessary numKeyOps.incr() call in OMMetrics (apache#2374)
  HDDS-5389. Include ozoneserviceid in fs.defaultFS when configuring o3fs (apache#2370)
  HDDS-5383. Eliminate expensive string creation in debug log messages (apache#2372)
  HDDS-5380. Get more accurate space info for DedicatedDiskSpaceUsage. (apache#2365)
  HDDS-5341. Container report processing is single threaded (apache#2338)
  HDDS-5387. ProfileServlet to move the default output location to an ozone specific directory (apache#2368)
  HDDS-5289. Update container's deleteTransactionId on creation of the transaction in SCM. (apache#2361)
  HDDS-5369. Cleanup unused configuration related to SCM HA (apache#2359)
  HDDS-5381. SCM terminated with exit status 1: null. (apache#2362)
  HDDS-5353. Avoid unnecessary executeBatch call in insertAudits (apache#2342)
  HDDS-5350 :  Add allocate block support in MockOmTransport (apache#2341). Contributed by Uma Maheswara Rao G.
  HDDS-4926. Support start/stop for container balancer via command line (apache#2278)
  HDDS-5269. Datandoe with low ratis log volume space should not be considered for new pipeline allocation. (apache#2344)
  HDDS-5367. Update modification time when updating quota/storageType/versioning (apache#2355)
  HDDS-5352. java.lang.ClassNotFoundException: org/eclipse/jetty/alpn/ALPN (apache#2347)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants