With htmlunit-4.15.0, the following test code produces almost empty page content on some urls:
WebClient webClient=new WebClient();
HtmlPage p=webClient.getPage("https://www.toutiao.com/c/user/token/MS4wLjABAAAA6Ftyf-tftfbjp1u_TEz6kpY77ZlPaYRV0UsfXkF2UsM/");
logger.info(p.asXml());
The output xml content of the page is almost empty:
<html>
<head/>
<body/>
</html>
I checked a bit and found the problem seems is in neko-htmlunit-4.15.0. If I just replace neko-htmlunit with version 4.14.0, the output is correct:
<html lang="en">
<head>
<meta charset="UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=edge"/>
<meta name="viewport" content="width=device-width, initial-scale=1.0"/>
<link rel="shortcut icon" href="//sf3-cdn-tos.douyinstatic.com/obj/eden-cn/uhbfnupkbps/toutiao_favicon.ico" type="image/x-icon"/>
<title>今日头条</title>
<script src="https://lf3-short.ibytedapm.com/slardar/fe/sdk-web/browser.cn.js?bid=toutiao_web_pc&globalName=Slardar"></script>
</head>
....
With htmlunit-4.15.0, the following test code produces almost empty page content on some urls:
The output xml content of the page is almost empty:
I checked a bit and found the problem seems is in neko-htmlunit-4.15.0. If I just replace neko-htmlunit with version 4.14.0, the output is correct: