Backwards compability to android 7 Nougat

[arifinreinaldo]

Hi, is it possible to fork a version htmlunit that support android 7? Because I have a requirement to test in the android 7 devices.
I'm planning to lower the htmlunit version library and also other supporting library. Is it possible and do you have any input which file that needs to be taken care of? Thanks

[rbri]

@arifinreinaldo everything is possible ;-)

I already made some changes for older android versions, but i have no test env here. What is the error you are facing on android 7?

[rbri]

Made a check with https://stackoverflow.com/questions/11048805/maven-plugin-for-checking-api-compliance-with-android

[arifinreinaldo]

Hi @rbri , thank you for your swift response.

I'm trying to run program in Android API Level 25, and I'm faced with run time error.

java.lang.NoClassDefFoundError: Failed resolution of: Ljava/lang/reflect/Executable; at com.gargoylesoftware.htmlunit.javascript.configuration.AbstractJavaScriptConfiguration.process(AbstractJavaScriptConfiguration.java:208) at com.gargoylesoftware.htmlunit.javascript.configuration.AbstractJavaScriptConfiguration.getClassConfiguration(AbstractJavaScriptConfiguration.java:193) at com.gargoylesoftware.htmlunit.javascript.configuration.AbstractJavaScriptConfiguration.<init>(AbstractJavaScriptConfiguration.java:67) at com.gargoylesoftware.htmlunit.javascript.configuration.JavaScriptConfiguration.<init>(JavaScriptConfiguration.java:686) at com.gargoylesoftware.htmlunit.javascript.configuration.JavaScriptConfiguration.getInstance(JavaScriptConfiguration.java:702) at com.gargoylesoftware.htmlunit.javascript.JavaScriptEngine.<init>(JavaScriptEngine.java:161)

I'm assuming that Ljava/lang/reflect/Executable crashed because it's being added at Android API 26 (https://developer.android.com/reference/java/lang/reflect/Executable). That's why I'm planning to downgrade the HtmlUnit to a version that is running without the Executable. Currently I'm trying to implement what you do with a lower version of HtmlUnit with version 2.15 or 2.20. Is it a viable solution from your opinion? Thanks

[rbri]

will have a look

[arifinreinaldo]

Thanks, if you need any additional information, please let me know.

[rbri]

@arifinreinaldo thanks, looks like i have to do a bigger change in HtmlUnit (at the moment i guess there is a huge bug that i have to sort out). Hope i can address this during this week. Will come back to you if i have something to test.

[rbri]

@arifinreinaldo made a first snapshot build available 2.66.0-SNAPSHOT - please try and report your findings

[arifinreinaldo]

hi @rbri , thanks for the updated code.
I have tried and there is a new error
java.lang.NoSuchMethodError: No static method withInitial(Ljava/util/function/Supplier;)Ljava/lang/ThreadLocal; in class Ljava/lang/ThreadLocal; or its super classes (declaration of 'java.lang.ThreadLocal' appears in /system/framework/core-oj.jar) at org.apache.commons.io.IOUtils.<clinit>(IOUtils.java:183) at org.apache.commons.io.IOUtils.read(IOUtils.java:1685) at com.gargoylesoftware.htmlunit.util.EncodingSniffer.read(EncodingSniffer.java:1101) at com.gargoylesoftware.htmlunit.util.EncodingSniffer.sniffHtmlEncoding(EncodingSniffer.java:550) at com.gargoylesoftware.htmlunit.util.EncodingSniffer.sniffEncoding(EncodingSniffer.java:462) at com.gargoylesoftware.htmlunit.WebResponse.getContentCharsetOrNull(WebResponse.java:172) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoHtmlParser.parse(HtmlUnitNekoHtmlParser.java:178) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:299) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:219) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:690) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:592) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:510) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:417) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:555) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:537)

It seems it has a same problem with the problem in https://stackoverflow.com/questions/73604534/no-static-method-threadlocal-withinitial-commons-io-dependency.

[rbri]

Ok, please try the next snapshot - i guess you will see another error.

[arifinreinaldo]

Hi @rbri , I have tried the snapshot again and it has different error.

No static method withInitial(Ljava/util/function/Supplier;)Ljava/lang/ThreadLocal; in class Ljava/lang/ThreadLocal; or its super classes (declaration of 'java.lang.ThreadLocal' appears in /system/framework/core-oj.jar) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.<clinit>(XPathHelper.java:45) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.isProcessingXPath(XPathHelper.java:108) at com.gargoylesoftware.htmlunit.html.DomNamespaceNode.getLocalName(DomNamespaceNode.java:88) at com.gargoylesoftware.htmlunit.html.HtmlElement.getNodeName(HtmlElement.java:412) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.addNodeToRightParent(HtmlUnitNekoDOMBuilder.java:409) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:359) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:291) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1226) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:822) at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:140) at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:278) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2811) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2125) at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:937) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:443) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:394) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.parse(HtmlUnitNekoDOMBuilder.java:762) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoHtmlParser.parse(HtmlUnitNekoHtmlParser.java:204) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:299) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:219) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:690) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:592) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:510) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:417) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:555) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:537)

Here's the log. Thank you

[rbri]

Ok, next version is ready - please try

[arifinreinaldo]

helo @rbri , using version -> net.sourceforge.htmlunit:htmlunit-android:2.66.0-SNAPSHOT

error still the same
java.lang.NoSuchMethodError: No static method withInitial(Ljava/util/function/Supplier;)Ljava/lang/ThreadLocal; in class Ljava/lang/ThreadLocal; or its super classes (declaration of 'java.lang.ThreadLocal' appears in /system/framework/core-oj.jar) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.<clinit>(XPathHelper.java:45) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.isProcessingXPath(XPathHelper.java:108) at com.gargoylesoftware.htmlunit.html.DomNamespaceNode.getLocalName(DomNamespaceNode.java:88) at com.gargoylesoftware.htmlunit.html.HtmlElement.getNodeName(HtmlElement.java:412) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.addNodeToRightParent(HtmlUnitNekoDOMBuilder.java:409) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:359) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:291) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1226) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:822) at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:140) at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:278) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2811) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2125) at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:937) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:443) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:394) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.parse(HtmlUnitNekoDOMBuilder.java:762) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoHtmlParser.parse(HtmlUnitNekoHtmlParser.java:204) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:299) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:219) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:690) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:592) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:510) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:417) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:555) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:537)

[rbri]

@arifinreinaldo strange please try again

[arifinreinaldo]

@rbri , still the same error. I have tried invalidate cache and rebuild project. Any other suggestions what to do?

java.lang.NoSuchMethodError: No static method withInitial(Ljava/util/function/Supplier;)Ljava/lang/ThreadLocal; in class Ljava/lang/ThreadLocal; or its super classes (declaration of 'java.lang.ThreadLocal' appears in /system/framework/core-oj.jar) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.<clinit>(XPathHelper.java:45) at com.gargoylesoftware.htmlunit.html.xpath.XPathHelper.isProcessingXPath(XPathHelper.java:108) at com.gargoylesoftware.htmlunit.html.DomNamespaceNode.getLocalName(DomNamespaceNode.java:88) at com.gargoylesoftware.htmlunit.html.HtmlElement.getNodeName(HtmlElement.java:412) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.addNodeToRightParent(HtmlUnitNekoDOMBuilder.java:409) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:359) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.startElement(HtmlUnitNekoDOMBuilder.java:291) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.callStartElement(HTMLTagBalancer.java:1226) at net.sourceforge.htmlunit.cyberneko.HTMLTagBalancer.startElement(HTMLTagBalancer.java:822) at net.sourceforge.htmlunit.cyberneko.filters.DefaultFilter.startElement(DefaultFilter.java:140) at net.sourceforge.htmlunit.cyberneko.filters.NamespaceBinder.startElement(NamespaceBinder.java:278) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scanStartElement(HTMLScanner.java:2811) at net.sourceforge.htmlunit.cyberneko.HTMLScanner$ContentScanner.scan(HTMLScanner.java:2125) at net.sourceforge.htmlunit.cyberneko.HTMLScanner.scanDocument(HTMLScanner.java:937) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:443) at net.sourceforge.htmlunit.cyberneko.HTMLConfiguration.parse(HTMLConfiguration.java:394) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoDOMBuilder.parse(HtmlUnitNekoDOMBuilder.java:762) at com.gargoylesoftware.htmlunit.html.parser.neko.HtmlUnitNekoHtmlParser.parse(HtmlUnitNekoHtmlParser.java:204) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createHtmlPage(DefaultPageCreator.java:299) at com.gargoylesoftware.htmlunit.DefaultPageCreator.createPage(DefaultPageCreator.java:219) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:690) at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseInto(WebClient.java:592) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:510) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:417) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:555) at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:537)

[rbri]

so the change was this time in HtmlUnit - i will try to redeploy the snapshot build