URL fragments dropped after redirect

[omervk]

On some pages, the web page is not completely rendered when getPageSource is called. Calling pageWait or even Thread.sleep to wait for the script to run does not help.

Example: https://www.duolingo.com/privacy

[hollingsworthd]

Thanks for reporting this. Someone else had also and it's now fixed in master or 0.11.1-SNAPSHOT. Will be in next release.

[omervk]

That's great. Would you kindly point to the original issue?

[omervk]

@hollingsworthd Hi, I've just started using version 0.12.0 and this issue still exists...

[hollingsworthd]

@omervk does calling pageWait() help? Or try increasing ajaxWait to something higher than 150 ms Settings.bulder().ajaxWait(..)

[omervk]

@hollingsworthd I've had pageWait from the start and it didn't help. Added ajaxWait with higher and higher values, up to 10 seconds, and none work. You're can use the URL in the OP to debug the issue.

[hollingsworthd]

@omervk This is the source I get: http://pastebin.com/uw19pStZ

Is that not similar to what you're getting?

Also can you enable logging and post the output? Settings.builder().logJavascript(true).logTrace(true).logWire(true)...

[omervk]

That is definitely not what I'm seeing, but is indeed what I expected to see.

I took another look and found my mistake: It's actually http://duolingo.com/#/privacy and not http://duolingo.com/privacy. Running the latter works great, but the former fails.

[hollingsworthd]

I was able to reproduce this. Glad you found/reported this. Fix will be in next release. Thanks!

Background: fragments were not passed on redirects -- related info, http://stackoverflow.com/questions/2286402/url-fragment-and-302-redirects