Skip to content

Conversation

@steveloughran
Copy link
Contributor

Contributed by Steve Loughran

How was this patch tested?

running ITestS3ACommitterMRJob from IDE and CLI.

Saw a new error message coming from #8061 ; reported it on the JIRA.

[INFO] Running org.apache.hadoop.fs.s3a.commit.integration.ITestS3ACommitterMRJob
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.apache.hadoop.security.authentication.util.SubjectUtil (file:/Users/stevel/.m2/repository/org/apache/hadoop/hadoop-auth/3.5.0-SNAPSHOT/hadoop-auth-3.5.0-SNAPSHOT.jar)
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.SubjectUtil
WARNING: System::setSecurityManager will be removed in a future release

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

@steveloughran
Copy link
Contributor Author

@mukund-thakur and @ahmarsuhail something of relevance for you two; I will cp to branch-3.4 to assist in test running there too

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 21m 41s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 42m 49s trunk passed
+1 💚 compile 0m 46s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 compile 0m 45s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 checkstyle 0m 34s trunk passed
+1 💚 mvnsite 0m 53s trunk passed
+1 💚 javadoc 0m 41s trunk passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 0m 37s trunk passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
-1 ❌ spotbugs 1m 31s /branch-spotbugs-hadoop-tools_hadoop-aws-warnings.html hadoop-tools/hadoop-aws in trunk has 188 extant spotbugs warnings.
+1 💚 shadedclient 31m 22s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 41s the patch passed
+1 💚 compile 0m 39s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javac 0m 39s the patch passed
+1 💚 compile 0m 37s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 javac 0m 37s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 22s the patch passed
+1 💚 mvnsite 0m 45s the patch passed
+1 💚 javadoc 0m 30s the patch passed with JDK Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
+1 💚 javadoc 0m 29s the patch passed with JDK Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
+1 💚 spotbugs 1m 31s the patch passed
+1 💚 shadedclient 32m 1s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 3m 31s hadoop-aws in the patch passed.
+1 💚 asflicense 0m 37s The patch does not generate ASF License warnings.
144m 24s
Subsystem Report/Notes
Docker ClientAPI=1.52 ServerAPI=1.52 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8087/1/artifact/out/Dockerfile
GITHUB PR #8087
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 960b3cde5241 5.15.0-156-generic #166-Ubuntu SMP Sat Aug 9 00:02:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / b9a4eeb
Default Java Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Multi-JDK versions /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8087/1/testReport/
Max. process+thread count 593 (vs. ulimit of 5500)
modules C: hadoop-tools/hadoop-aws U: hadoop-tools/hadoop-aws
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8087/1/console
versions git=2.25.1 maven=3.9.11 spotbugs=4.9.7
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Copy link
Contributor

@mukund-thakur mukund-thakur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 pending successful yetus.

@steveloughran
Copy link
Contributor Author

jenkins couldn't update the PR; here's the results from the console. Failures are from the new spotbugs complaints. which need a review then turning off


21:32:02  ============================================================================
21:32:02  ============================================================================
21:32:02                           Adding comment to Github
21:32:02  ============================================================================
21:32:02  ============================================================================
21:32:02  
21:32:02  
21:32:07  ERROR: Failed to write github status. Token expired or missing repo:status write?
21:32:08  
21:32:08  
21:32:08  ============================================================================
21:32:08  ============================================================================
21:32:08                               Writing HTML to 
21:32:08  ============================================================================
21:32:08  ============================================================================
21:32:08  
21:32:08  
21:32:11  
21:32:11  
21:32:11  -1 overall
21:32:11  
21:32:11  | Vote |        Subsystem |  Runtime   | Comment
21:32:11  ============================================================================
21:32:11  |   0  |          reexec  |  21m 41s   | Docker mode activated. 
21:32:11  +---------------------------------------------------------------------------
21:32:11  |      |                  |            | Prechecks 
21:32:11  +---------------------------------------------------------------------------
21:32:11  |  +1  |         dupname  |   0m  0s   | No case conflicting files found. 
21:32:11  |   0  |       codespell  |   0m  0s   | codespell was not available. 
21:32:11  |   0  |      detsecrets  |   0m  0s   | detect-secrets was not available. 
21:32:11  |  +1  |         @author  |   0m  0s   | The patch does not contain any @author 
21:32:11  |      |                  |            | tags.
21:32:11  |  +1  |      test4tests  |   0m  0s   | The patch appears to include 1 new or 
21:32:11  |      |                  |            | modified test files.
21:32:11  +---------------------------------------------------------------------------
21:32:11  |      |                  |            | trunk Compile Tests 
21:32:11  +---------------------------------------------------------------------------
21:32:11  |  +1  |      mvninstall  |  42m 49s   | trunk passed 
21:32:11  |  +1  |         compile  |   0m 46s   | trunk passed with JDK 
21:32:11  |      |                  |            | Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |         compile  |   0m 45s   | trunk passed with JDK 
21:32:11  |      |                  |            | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |      checkstyle  |   0m 34s   | trunk passed 
21:32:11  |  +1  |         mvnsite  |   0m 53s   | trunk passed 
21:32:11  |  +1  |         javadoc  |   0m 41s   | trunk passed with JDK 
21:32:11  |      |                  |            | Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |         javadoc  |   0m 37s   | trunk passed with JDK 
21:32:11  |      |                  |            | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11  |  -1  |        spotbugs  |   1m 31s   | hadoop-tools/hadoop-aws in trunk has 
21:32:11  |      |                  |            | 188 extant spotbugs warnings.
21:32:11  |  +1  |    shadedclient  |  31m 22s   | branch has no errors when building and 
21:32:11  |      |                  |            | testing our client artifacts.
21:32:11  +---------------------------------------------------------------------------
21:32:11  |      |                  |            | Patch Compile Tests 
21:32:11  +---------------------------------------------------------------------------
21:32:11  |  +1  |      mvninstall  |   0m 41s   | the patch passed 
21:32:11  |  +1  |         compile  |   0m 39s   | the patch passed with JDK 
21:32:11  |      |                  |            | Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |           javac  |   0m 39s   | the patch passed 
21:32:11  |  +1  |         compile  |   0m 37s   | the patch passed with JDK 
21:32:11  |      |                  |            | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |           javac  |   0m 37s   | the patch passed 
21:32:11  |  +1  |          blanks  |   0m  0s   | The patch has no blanks issues. 
21:32:11  |  +1  |      checkstyle  |   0m 22s   | the patch passed 
21:32:11  |  +1  |         mvnsite  |   0m 45s   | the patch passed 
21:32:11  |  +1  |         javadoc  |   0m 30s   | the patch passed with JDK 
21:32:11  |      |                  |            | Ubuntu-21.0.7+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |         javadoc  |   0m 29s   | the patch passed with JDK 
21:32:11  |      |                  |            | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04
21:32:11  |  +1  |        spotbugs  |   1m 31s   | the patch passed 
21:32:11  |  +1  |    shadedclient  |  32m  1s   | patch has no errors when building and 
21:32:11  |      |                  |            | testing our client artifacts.
21:32:11  +---------------------------------------------------------------------------
21:32:11  |      |                  |            | Other Tests 
21:32:11  +---------------------------------------------------------------------------
21:32:11  |  +1  |            unit  |   3m 31s   | hadoop-aws in the patch passed. 
21:32:11  |  +1  |      asflicense  |   0m 37s   | The patch does not generate ASF 
21:32:11  |      |                  |            | License warnings.
21:32:11  |      |                  | 144m 24s   |
21:32:11

@steveloughran steveloughran merged commit 15a5c90 into apache:trunk Nov 18, 2025
1 of 4 checks passed
steveloughran added a commit that referenced this pull request Nov 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants