Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-4026. Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true #1256

Merged
merged 3 commits into from
Jul 27, 2020

Conversation

bharatviswa504
Copy link
Contributor

What changes were proposed in this pull request?

Rename failed for directory when ozone.om.enable.filesystem.paths is set to true.

As rename is not used by ObjectStore API, we don't need to normalize the path when ozone.om.enable.filesystem.paths is set to true.

O3FS uses deleteObjects for deleting directory and deleteKey for delete file/key. So, normalizing the path when the config is enabled should be fine, as the deletekey only used for deleting file. (Note: deleteObject does not normalize paths)

Still, a fix is required for OFS delete, as it uses deleteKey for deleting the directory. I will open a Jira to fix the issue.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4026

How was this patch tested?

Added tests for rename and delete.

@codecov-commenter
Copy link

Codecov Report

Merging #1256 into master will decrease coverage by 0.12%.
The diff coverage is 100.00%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #1256      +/-   ##
============================================
- Coverage     73.75%   73.62%   -0.13%     
+ Complexity    10122    10118       -4     
============================================
  Files           974      974              
  Lines         50123    50180      +57     
  Branches       4881     4892      +11     
============================================
- Hits          36967    36944      -23     
- Misses        10824    10892      +68     
- Partials       2332     2344      +12     
Impacted Files Coverage Δ Complexity Δ
...adoop/ozone/om/request/key/OMKeyRenameRequest.java 93.10% <100.00%> (-0.45%) 10.00 <0.00> (ø)
...x509/certificates/utils/SelfSignedCertificate.java 76.59% <0.00%> (-15.95%) 7.00% <0.00%> (+1.00%) ⬇️
...va/org/apache/hadoop/hdds/utils/db/RDBMetrics.java 85.71% <0.00%> (-14.29%) 13.00% <0.00%> (-2.00%)
...doop/hdds/scm/container/ContainerStateManager.java 81.53% <0.00%> (-6.93%) 31.00% <0.00%> (-3.00%)
...java/org/apache/hadoop/hdds/utils/db/RDBTable.java 57.33% <0.00%> (-6.67%) 19.00% <0.00%> (-3.00%)
...ozone/container/ozoneimpl/ContainerController.java 63.15% <0.00%> (-5.27%) 11.00% <0.00%> (-1.00%)
.../transport/server/ratis/ContainerStateMachine.java 71.07% <0.00%> (-5.16%) 62.00% <0.00%> (-3.00%)
.../common/volume/RoundRobinVolumeChoosingPolicy.java 80.95% <0.00%> (-4.77%) 5.00% <0.00%> (-1.00%)
...e/commandhandler/CreatePipelineCommandHandler.java 87.50% <0.00%> (-3.99%) 8.00% <0.00%> (ø%)
...iner/common/transport/server/ratis/CSMMetrics.java 70.76% <0.00%> (-3.08%) 20.00% <0.00%> (-1.00%)
... and 32 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 32ac7bf...807b04b. Read the comment docs.

@arp7 arp7 merged commit ddd3211 into apache:master Jul 27, 2020
errose28 pushed a commit to errose28/ozone that referenced this pull request Jul 31, 2020
* master: (55 commits)
  HDDS-4052. Remove master/slave terminology from Ozone (apache#1281)
  HDDS-4047. OzoneManager met NPE exception while getServiceList (apache#1277)
  HDDS-3990. Test Kubernetes examples with acceptance tests (apache#1223)
  HDDS-4045. Add more ignore rules to the RAT ignore list (apache#1273)
  HDDS-3970. Enabling TestStorageContainerManager with all failures addressed (apache#1257)
  HDDS-4033. Make the acceptance test reports hierarchical (apache#1263)
  HDDS-3423. Enabling TestContainerReplicationEndToEnd and addressing failures (apache#1260)
  HDDS-4027. Suppress ERROR message when SCM attempt to create additional pipelines. (apache#1265)
  HDDS-4024. Avoid while loop too soon when exception happen (apache#1253)
  HDDS-3809. Make number of open containers on a datanode a function of no of volumes reported by it. (apache#1081)
  HDDS-4019. Show the storageDir while need init om or scm (apache#1248)
  HDDS-3511. Fix javadoc comment in OmMetadataManager (apache#1247)
  HDDS-4041. Ozone /conf endpoint triggers kerberos replay error when SPNEGO is enabled. (apache#1267)
  HDDS-4031. Run shell tests in CI (apache#1261)
  HDDS-4038. Eliminate GitHub check warnings (apache#1268)
  HDDS-4011. Update S3 related documentation. (apache#1245)
  HDDS-4030. Remember the selected columns and make the X-axis scrollable in recon datanodes UI (apache#1259)
  HDDS-4032. Run author check without docker (apache#1262)
  HDDS-4026. Dir rename failed when sets 'ozone.om.enable.filesystem.paths' to true (apache#1256)
  HDDS-4017. Acceptance check may run against wrong commit (apache#1249)
  ...
timmylicheng pushed a commit that referenced this pull request Aug 6, 2020
ChenSammi pushed a commit that referenced this pull request Aug 12, 2020
rakeshadr pushed a commit to rakeshadr/hadoop-ozone that referenced this pull request Sep 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants