JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException #2662

candrews · 2021-02-20T19:20:48Z

java.net.URLClassLoader.getResource can throw an undocumented IllegalArgumentException.

According to the javadoc for the getResource and findResource methods, neither should be throwing IllegalArgumentException - they should return null if the resource can't be resolved.

Quoting the javadoc for URLClassLoader.html#findResource

Returns:
a URL for the resource, or null if the resource could not be found, or if the loader is closed.

And quoting the javadoc for ClassLoader.html#getResource

Returns:
URL object for reading the resource; null if the resource could not be found, a URL could not be constructed to locate the resource, the resource is in a package that is not opened unconditionally, or access to the resource is denied by the security manager.

Neither mentions throwing IllegalArgumentException and both are clear that when URL can't be constructed, null should be returned.

Here's a stack trace:

java.lang.IllegalArgumentException: name
        at java.base/jdk.internal.loader.URLClassPath$Loader.findResource(URLClassPath.java:600)
        at java.base/jdk.internal.loader.URLClassPath.findResource(URLClassPath.java:291)
        at java.base/java.net.URLClassLoader$2.run(URLClassLoader.java:655)
        at java.base/java.net.URLClassLoader$2.run(URLClassLoader.java:653)
        at java.base/java.security.AccessController.doPrivileged(Native Method)
        at java.base/java.net.URLClassLoader.findResource(URLClassLoader.java:652)

Looking at URLClassPath.findResource

        URL findResource(final String name, boolean check) {
            URL url;
            try {
                url = new URL(base, ParseUtil.encodePath(name, false));
            } catch (MalformedURLException e) {
                throw new IllegalArgumentException("name");
            }

Instead of throwing IllegalArgumentException, that line should simply return null.

A similar issue exists at URLClassPath.getResource

        URL findResource(final String name, boolean check) {
            URL url;
            try {
                url = new URL(base, ParseUtil.encodePath(name, false));
            } catch (MalformedURLException e) {
                throw new IllegalArgumentException("name");
            }

Instead of throwing IllegalArgumentException, that line should simply return null.

Progress

Change must not contain extraneous whitespace
Commit message must refer to an issue
Change must be properly reviewed

Issue

JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException

Reviewers

Alan Bateman (@AlanBateman - Reviewer)
Brent Christian (@bchristi-git - Reviewer)
Prasanta Sadhukhan (@prsadhuk - Reviewer)

Download

$ git fetch https://git.openjdk.java.net/jdk pull/2662/head:pull/2662
$ git checkout pull/2662

bridgekeeper · 2021-02-20T19:21:47Z

Hi @candrews, welcome to this OpenJDK project and thanks for contributing!

We do not recognize you as Contributor and need to ensure you have signed the Oracle Contributor Agreement (OCA). If you have not signed the OCA, please follow the instructions. Please fill in your GitHub username in the "Username" field of the application. Once you have signed the OCA, please let us know by writing /signed in a comment in this pull request.

If you already are an OpenJDK Author, Committer or Reviewer, please click here to open a new issue so that we can record that fact. Please use "Add GitHub user candrews" as summary for the issue.

If you are contributing this work on behalf of your employer and your employer has signed the OCA, please let us know by writing /covered in a comment in this pull request.

candrews · 2021-02-20T19:22:10Z

Submitted a bug report at https://bugreport.java.com/
Received internal review ID : 9069151

openjdk · 2021-02-20T19:22:57Z

@candrews The following label will be automatically applied to this pull request:

core-libs

When this pull request is ready to be reviewed, an "RFR" email will be sent to the corresponding mailing list. If you would like to change these labels, use the /label pull request command.

candrews · 2021-02-22T21:37:51Z

This one liner will reproduce this issue (you can easily use jshell to run it and see the problem):

new java.net.URLClassLoader(new java.net.URL[]{new java.net.URL("https://repo1.maven.org/anything-that-ends-with-slash/")}).findResource("c:/windows");

The key parts to reproduce the issue are:

The URLClassLoader URL must not start with file: or jar: and must end in /. See

jdk/src/java.base/share/classes/jdk/internal/loader/URLClassPath.java

Line 493 in 2b00367

return new Loader(url);
The string passed to findResource must not be a valid URL component. Windows paths (which include a : making them invalid URL components) are a common and easy way to see this error.

candrews · 2021-02-26T14:11:27Z

/signed

bridgekeeper · 2021-02-26T14:12:30Z

Thank you! Please allow for up to two weeks to process your OCA, although it is usually done within one to two business days. Also, please note that pull requests that are pending an OCA check will not usually be evaluated, so your patience is appreciated!

mlbridge · 2021-03-03T14:16:03Z

Webrevs

04: Full - Incremental (944956c)
03: Full - Incremental (79869e78890bba539fbc21ab535f53fa57b63689)
02: Full - Incremental (e456f8863f9b5e17302124fdc4ce7df4b25365f1)
01: Full - Incremental (3f6a974e47a6b880918962257a760aade2d155bf)
00: Full (d9506624d05d6d1475274468d1f93828a24c738e)

AlanBateman

This seems to be a long standing bug, maybe goes all the way back to JDK 1.2. Are you planning to add a regression test?

bchristi-git · 2021-03-03T18:10:25Z

Hi, Craig
The commented-out lines should be removed from the change.

As Alan said, a regression test will be needed. At minimum, it should test a method that returns a URL, as well as a method that returns an Enumeration (which can also lead to an IAE, as I noted in the bug report).

Also, though the compatibility risk is low, it would be good to include a CSR for this change to long-standing behavior.

bchristi-git · 2021-03-03T18:10:31Z

/csr needed

openjdk · 2021-03-03T18:10:40Z

@bchristi-git has indicated that a compatibility and specification (CSR) request is needed for this pull request.
@candrews please create a CSR request and add link to it in JDK-8262277. This pull request cannot be integrated until the CSR request is approved.

bchristi-git · 2021-03-03T18:18:10Z

Also, the copyright year should be updated: 2019 -> 2021

candrews · 2021-03-04T21:10:56Z

The commented-out lines should be removed from the change.

Done! 👍

As Alan said, a regression test will be needed. At minimum, it should test a method that returns a URL, as well as a method that returns an Enumeration (which can also lead to an IAE, as I noted in the bug report).

I've added a test.

Also, the copyright year should be updated: 2019 -> 2021

Done! 👍

@bchristi-git has indicated that a compatibility and specification (CSR) request is needed for this pull request.
@candrews please create a CSR request and add link to it in JDK-8262277. This pull request cannot be integrated until the CSR request is approved.

I'm trying to figure out how to create a CSR and I'm not having much luck. According to the CSR FAQs:

Q: How do I create a CSR ?
A: Do not directly create a CSR from the Create Menu. JIRA will let you do this right up until the moment you try to save it and find your typing was in vain.
Instead you should go to the target bug, select "More", and from the drop down menu select "Create CSR". This is required to properly associate the CSR with the main bug, just as is done for backports.

However, I don't have an account on https://bugs.openjdk.java.net so I can't do as instructed.

How do I create the CSR?

mlbridge · 2021-03-04T22:01:41Z

Mailing list message from Brent Christian on core-libs-dev:

On 3/4/21 1:16 PM, Craig Andrews wrote:

@bchristi-git has indicated that a [compatibility and specification](https://wiki.openjdk.java.net/display/csr/Main) (CSR) request is needed for this pull request.
@candrews please create a CSR request and add link to it in [JDK-8262277](https://bugs.openjdk.java.net/browse/JDK-8262277). This pull request cannot be integrated until the CSR request is approved.

I'm trying to figure out how to create a CSR and I'm not having much luck. According to the [CSR FAQs](https://wiki.openjdk.java.net/display/csr/CSR+FAQs):

Q: How do I create a CSR ?
A: Do not directly create a CSR from the Create Menu. JIRA will let you do this right up until the moment you try to save it and find your typing was in vain.
Instead you should go to the target bug, select "More", and from the drop down menu select "Create CSR". This is required to properly associate the CSR with the main bug, just as is done for backports.

However, I don't have an account on https://bugs.openjdk.java.net so I can't do as instructed.

How do I create the CSR?

OK, yeah - I can create the CSR. If you can craft some content for the
Summary, Problem, Solution, and maybe Compatibility Risk Description
(the risk itself is Low), I can take it from there.

A recent CSR of a somewhat similar
fix-the-implementation-to-match-the-spec flavor might be:
https://bugs.openjdk.java.net/browse/JDK-8255997
(though the change there is to *start* throwing an exception :D ).
Anyway, perhaps that might helpful as a reference.

-Brent

AlanBateman · 2021-03-05T15:42:11Z

test/jdk/java/net/URLClassLoader/TestBug8262277.java

+ * @bug 8262277
+ * @summary Test to see if URLClassLoader.getResource and URLClassLoader.getResources
+ * throw IllegalArgumentException
+ */


I'd prefer if the test checked that findResource returned null and that findResources returned an empty enumeration. I think we should be able to find a better name for the test too.
Do you really want the author tag in the test? I know they exist in some tests but they are impossible to remove, even when tests/code are significantly changed by someone else.

I'd prefer if the test checked that findResource returned null and that findResources returned an empty enumeration.

I'll update the test accordingly.

think we should be able to find a better name for the test too.
Do you really want the author tag in the test? I know they exist in some tests but they are impossible to remove, even when tests/code are significantly changed by someone else.

I can rename the test class to be something descriptive and remove the @author tag. I was following other tests which is why I did it this way.

I've made the changes you requested.

candrews · 2021-03-05T19:41:57Z

Summary

Modify implementation of java.net.URLClassLoader such that findResource and java.net.URLClassLoader.html#findResources do no longer throw undocumented IllegalArgumentException.

Problem

The javadocs for URLClassLoader.html#findResource and java.net.URLClassLoader.html#findResources do not indicate that an IllegalArgumentException can be thrown. The implementation does throw such exceptions under specific conditions which, due to being undocumented, is unexpected behavior. The unexpected exception can cause incorrect behavior, particularly on Windows systems due to the Windows file system path format increasingly the likelihood of causing the unexpected exception. An example of such a problem was discovered in Spring Framework necessitating a workaround..

Solution

Modify the implementation of java.net.URLClassLoader to not throw IllegalArgumentException when finding resources.

Compatibility Risk

Low

Compatibility Risk Description

It is possible that some code is catching the undocumented IllegalArgumentException and treating it in a specific way.

test/jdk/java/net/URLClassLoader/FindResourceDoesNotThrowException.java

…IllegalArgumentException

AlanBateman

The fix looks good. Brent has created a CSR. It seems unlikely that anyone is depending the long standing/broken behavior but it seems release note worthy.

bchristi-git

Looks good, thanks!

candrews · 2021-03-15T16:19:20Z

What's the next step in the process for this PR?

kevinrushforth · 2021-03-15T16:26:35Z

You need to fix this error:

Title mismatch between PR and JBS for issue JDK-8262277

by changing the title of this PR to match the JBS title. Then you should be able to integrate it.

candrews · 2021-03-15T16:29:54Z

You need to fix this error:

Title mismatch between PR and JBS for issue JDK-8262277

by changing the title of this PR to match the JBS title. Then you should be able to integrate it.

Done - how's it look now?

openjdk · 2021-03-15T16:30:06Z

@candrews This change now passes all automated pre-integration checks.

ℹ️ This project also has non-automated pre-integration requirements. Please see the file CONTRIBUTING.md for details.

After integration, the commit message for the final commit will be:

8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException

Reviewed-by: alanb, bchristi, psadhukhan

You can use pull request commands such as /summary, /contributor and /issue to adjust it as needed.

At the time when this comment was updated there had been 286 new commits pushed to the master branch:

d6b5e18: 8263191: Consolidate ThreadInVMfromJavaNoAsyncException and ThreadBlockInVMWithDeadlockCheck with existing wrappers
80cdf78: 8263544: Unused argument in ConstantPoolCacheEntry::set_field()
c0176c4: 8263552: Use String.valueOf() for char-to-String conversions
fac39fe: 8263508: Remove dead code in MethodHandleImpl
7b4aefe: 8263530: sun.awt.X11.ListHelper.removeAll() should use clear()
32c7fcc: 8263490: [macos] Crash occurs on JPasswordField with activated InputMethod
8afec70: 8260931: Implement JEP 382: New macOS Rendering Pipeline
0638303: 8263497: Clean up sun.security.krb5.PrincipalName::toByteArray
ba22e6f: 8263446: Avoid unary minus over unsigned type in ObjectSynchronizer::dec_in_use_list_ceiling
b371f90: 8263504: Some OutputMachOpcodes fields are uninitialized
... and 276 more: https://git.openjdk.java.net/jdk/compare/2b00367e1154feb2c05b84a11d62fb5750e46acf...master

As there are no conflicts, your changes will automatically be rebased on top of these commits when integrating. If you prefer to avoid this automatic rebasing, please check the documentation for the /integrate command for further details.

As you do not have Committer status in this project an existing Committer must agree to sponsor your change. Possible candidates are the reviewers of this PR (@AlanBateman, @bchristi-git, @prsadhuk) but any other Committer may sponsor as well.

➡️ To flag this PR as ready for integration with the above commit message, type /integrate in a new comment. (Afterwards, your sponsor types /sponsor in a new comment to perform the integration).

candrews · 2021-03-15T16:35:25Z

/contributor add @candrews

openjdk · 2021-03-15T16:35:35Z

@candrews Could not parse @candrews as a valid contributor.
Syntax: /contributor (add|remove) [@user | openjdk-user | Full Name <email@address>]. For example:

/contributor add @openjdk-bot
/contributor add duke
/contributor add J. Duke <duke@openjdk.org>

kevinrushforth · 2021-03-15T16:36:42Z

You don't need to add yourself as a contributor. The only thing you need to do is integrate. Then it is ready to be sponsored.

candrews · 2021-03-15T16:36:48Z

/integrate

openjdk · 2021-03-15T16:37:35Z

@candrews
Your change (at version 944956c) is now ready to be sponsored by a Committer.

bchristi-git · 2021-03-15T18:34:25Z

/sponsor

openjdk · 2021-03-15T18:35:18Z

@bchristi-git @candrews Since your change was applied there have been 292 commits pushed to the master branch:

4f1cda4: 8263387: G1GarbageCollection JFR event gets gc phase, not gc type
5ab5244: 8263514: Minor issue in JavacFileManager.SortFiles.REVERSE
771b146: 8245025: MoveAndUpdateClosure::do_addr calls function with side-effects in an assert
46d78f0: 6539707: (fc) MappedByteBuffer.force() method throws an IOException in a very simple test
189289d: 8262326: MaxMetaspaceSize does not have to be aligned to metaspace commit alignment
d825198: 8263556: remove @modules java.base from tests
d6b5e18: 8263191: Consolidate ThreadInVMfromJavaNoAsyncException and ThreadBlockInVMWithDeadlockCheck with existing wrappers
80cdf78: 8263544: Unused argument in ConstantPoolCacheEntry::set_field()
c0176c4: 8263552: Use String.valueOf() for char-to-String conversions
fac39fe: 8263508: Remove dead code in MethodHandleImpl
... and 282 more: https://git.openjdk.java.net/jdk/compare/2b00367e1154feb2c05b84a11d62fb5750e46acf...master

Your commit was automatically rebased without conflicts.

Pushed as commit 0c718ab.

💡 You may see a message that your pull request was closed with unmerged commits. This can be safely ignored.

bridgekeeper bot added the oca Needs verification of OCA signatory status label Feb 20, 2021

openjdk bot added the core-libs core-libs-dev@openjdk.org label Feb 20, 2021

candrews mentioned this pull request Feb 20, 2021

ClassLoader.getResource can throw IllegalArgumentException spring-projects/spring-framework#26574

Merged

candrews changed the title ~~URLClassPath: do not throw exception~~ 8262277: URLClassPath: do not throw exception Feb 24, 2021

candrews changed the title ~~8262277: URLClassPath: do not throw exception~~ 8262277: java.net.URLClassLoader.getResource throws undocumented IllegalArgumentException Feb 24, 2021

candrews force-pushed the patch-1 branch from aa1d0fc to d950662 Compare February 24, 2021 04:37

bridgekeeper bot added the oca-verify Needs verification of OCA signatory status label Feb 26, 2021

bridgekeeper bot removed oca Needs verification of OCA signatory status oca-verify Needs verification of OCA signatory status labels Mar 3, 2021

openjdk bot added the rfr Pull request is ready for review label Mar 3, 2021

AlanBateman reviewed Mar 3, 2021

View reviewed changes

openjdk bot added the csr Pull request needs approved CSR before integration label Mar 3, 2021

candrews changed the title ~~8262277: java.net.URLClassLoader.getResource throws undocumented IllegalArgumentException~~ JDK-8262277: java.net.URLClassLoader.getResource throws undocumented IllegalArgumentException Mar 4, 2021

candrews force-pushed the patch-1 branch 2 times, most recently from 3f6a974 to e456f88 Compare March 4, 2021 21:56

AlanBateman reviewed Mar 5, 2021

View reviewed changes

candrews force-pushed the patch-1 branch from e456f88 to 79869e7 Compare March 5, 2021 15:55

bchristi-git suggested changes Mar 5, 2021

View reviewed changes

test/jdk/java/net/URLClassLoader/FindResourceDoesNotThrowException.java Outdated Show resolved Hide resolved

JDK-8262277: java.net.URLClassLoader.getResource throws undocumented …

944956c

…IllegalArgumentException

candrews force-pushed the patch-1 branch from 79869e7 to 944956c Compare March 6, 2021 01:31

AlanBateman approved these changes Mar 6, 2021

View reviewed changes

bchristi-git approved these changes Mar 8, 2021

View reviewed changes

openjdk bot removed the csr Pull request needs approved CSR before integration label Mar 9, 2021

prsadhuk approved these changes Mar 9, 2021

View reviewed changes

candrews changed the title ~~JDK-8262277: java.net.URLClassLoader.getResource throws undocumented IllegalArgumentException~~ JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException Mar 15, 2021

openjdk bot added the ready Pull request is ready to be integrated label Mar 15, 2021

openjdk bot added the sponsor Pull request is ready to be sponsored label Mar 15, 2021

openjdk bot closed this Mar 15, 2021

openjdk bot added integrated Pull request has been integrated and removed sponsor Pull request is ready to be sponsored ready Pull request is ready to be integrated rfr Pull request is ready for review labels Mar 15, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException #2662

JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException #2662

candrews commented Feb 20, 2021 •

edited by openjdk bot

Loading

bridgekeeper bot commented Feb 20, 2021

candrews commented Feb 20, 2021 •

edited by bridgekeeper bot

Loading

openjdk bot commented Feb 20, 2021

candrews commented Feb 22, 2021

candrews commented Feb 26, 2021

bridgekeeper bot commented Feb 26, 2021

mlbridge bot commented Mar 3, 2021 •

edited

Loading

AlanBateman left a comment

bchristi-git commented Mar 3, 2021

bchristi-git commented Mar 3, 2021

openjdk bot commented Mar 3, 2021

bchristi-git commented Mar 3, 2021

candrews commented Mar 4, 2021 •

edited

Loading

mlbridge bot commented Mar 4, 2021

AlanBateman Mar 5, 2021

candrews Mar 5, 2021 •

edited

Loading

candrews Mar 5, 2021

candrews commented Mar 5, 2021

AlanBateman left a comment

bchristi-git left a comment

candrews commented Mar 15, 2021

kevinrushforth commented Mar 15, 2021

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021 •

edited

Loading

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

kevinrushforth commented Mar 15, 2021

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

bchristi-git commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException #2662

JDK-8262277: URLClassLoader.getResource throws undocumented IllegalArgumentException #2662

Conversation

candrews commented Feb 20, 2021 • edited by openjdk bot Loading

Progress

Issue

Reviewers

Download

bridgekeeper bot commented Feb 20, 2021

candrews commented Feb 20, 2021 • edited by bridgekeeper bot Loading

openjdk bot commented Feb 20, 2021

candrews commented Feb 22, 2021

candrews commented Feb 26, 2021

bridgekeeper bot commented Feb 26, 2021

mlbridge bot commented Mar 3, 2021 • edited Loading

Webrevs

AlanBateman left a comment

Choose a reason for hiding this comment

bchristi-git commented Mar 3, 2021

bchristi-git commented Mar 3, 2021

openjdk bot commented Mar 3, 2021

bchristi-git commented Mar 3, 2021

candrews commented Mar 4, 2021 • edited Loading

mlbridge bot commented Mar 4, 2021

AlanBateman Mar 5, 2021

Choose a reason for hiding this comment

candrews Mar 5, 2021 • edited Loading

Choose a reason for hiding this comment

candrews Mar 5, 2021

Choose a reason for hiding this comment

candrews commented Mar 5, 2021

Summary

Problem

Solution

Compatibility Risk

Compatibility Risk Description

AlanBateman left a comment

Choose a reason for hiding this comment

bchristi-git left a comment

Choose a reason for hiding this comment

candrews commented Mar 15, 2021

kevinrushforth commented Mar 15, 2021

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021 • edited Loading

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

kevinrushforth commented Mar 15, 2021

candrews commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

bchristi-git commented Mar 15, 2021

openjdk bot commented Mar 15, 2021

candrews commented Feb 20, 2021 •

edited by openjdk bot

Loading

candrews commented Feb 20, 2021 •

edited by bridgekeeper bot

Loading

mlbridge bot commented Mar 3, 2021 •

edited

Loading

candrews commented Mar 4, 2021 •

edited

Loading

candrews Mar 5, 2021 •

edited

Loading

openjdk bot commented Mar 15, 2021 •

edited

Loading