HDDS-4253. Add LayoutVersion request/response for DN registration.

[prashantpogde]

What changes were proposed in this pull request?

Add LayoutVersion request/response for DN registration.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4253

How was this patch tested?

tested with existing and updated UTs.

[linyiqun]

@prashantpogde , some minor comments from me.
I noticed that PR title is not consistent with HDDS-4253 JIRA title.

[avijayanhwx]

Thanks for working on this @prashantpogde. Approach looks good to me. A couple of suggestions inline.

[linyiqun]

@prashantpogde , the CI failure still happened, due to below socket closed error. Seems not related.

Exception in thread "main" java.net.SocketException: Socket closed
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:560)
	at java.net.ServerSocket.accept(ServerSocket.java:528)
	at org.apache.hadoop.test.JacocoServer.main(JacocoServer.java:60)
Error: Process completed with exit code 1.

[adoroszlai]

Exception in thread "main" java.net.SocketException: Socket closed
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:560)
	at java.net.ServerSocket.accept(ServerSocket.java:528)
	at org.apache.hadoop.test.JacocoServer.main(JacocoServer.java:60)
Error: Process completed with exit code 1.

is not the cause of failures, it can be ignored.

Acceptance tests (secure and unsecure) fail with:

Check if Recon picks up DN heartbeats                                 | FAIL |
'{"totalCount":0,"datanodes":[]}' does not contain 'datanode_1'

[avijayanhwx]

Exception in thread "main" java.net.SocketException: Socket closed
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:560)
	at java.net.ServerSocket.accept(ServerSocket.java:528)
	at org.apache.hadoop.test.JacocoServer.main(JacocoServer.java:60)
Error: Process completed with exit code 1.

is not the cause of failures, it can be ignored.

Acceptance tests (secure and unsecure) fail with:

Check if Recon picks up DN heartbeats                                 | FAIL |
'{"totalCount":0,"datanodes":[]}' does not contain 'datanode_1'

It is possible the acceptance test failures are related since the DN registration step is done Recon's underlying SCM as well.

[prashantpogde]

I am investigating errors and I will fix if any.

[linyiqun]

All checks have passed, +1.

[avijayanhwx]

Thanks for working on this @prashantpogde. We can refine this in subsequent JIRAs.