java.io.UnsupportedEncodingException: gzip

[soulgalore]

Cannot fetch:
http://m.sportsauthority.com

The "problem" is the site sends gzip even though HTTPClient does say it can't accept GZip.

[bensquire]

Would be really useful if sitespeed.io could cope with GZip'ped content, my site is served via an S3 bucket, the content is uploaded in a Gzi'pped format and therefore is 'always' downloaded in compressed format, I can't control this without disabling compressed content for everyone...

[soulgalore]

Hi again @bensquire , yes, the problem is the crawler, however the server should not send GZip if the browser doesn't say it can handle it. However, I see your point and it should be fixed, the problem is in the crawler. I will add a ticket in that project tomorrow and reference it. soulgalore/crawler#9

[soulgalore]

Hi again Ben,
I did a fix in the 2.6-wip branch, it would be great if you would be able to test it (the old URL that I had that actually broke the impl works now, so I haven't been able to fully test)?

Best
Peter

[bensquire]

Thanks Peter,

I ran this from the 2.6 branch and it did indeed seem to work. The only possible issue is this error:

./sitespeed.io: line 449: java -Xmx1024m -Xms1024m -jar /usr/local/sitespeed.io/dependencies/browsertime-0.5-full.jar: No such file or directory

In context:

with User-Agent Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1500.71 Safari/537.36 and viewport 1280x800 with crawl depth 1 using ruleset sitespeed.io-desktop ... this can take a while
./sitespeed.io: line 449: java -Xmx1024m -Xms1024m -jar /usr/local/sitespeed.io/dependencies/browsertime-0.5-full.jar: No such file or directory
Using sitespeed.io version 2.6-wip
Using PhantomJS version 1.9.1
Using Java version 1.6.0_27
Using BrowserTime version 
From IP 198.199.122.59
Will analyze 1 pages
Analyzing http://dev.collate-it.com/
Create all (1) pages per URL
Create all the result pages
Create result.xml
Create the summary.xml
Create the summary.details.html
Create the pages.html
Create the summary index.html
Create the assets.html
Create the rules.html
Finished analyzing dev.collate-it.com

I checked and the file does exist... When I ran this branch via the jekins plugin, I got a different error, but I'm hesitant to raise another bug for a branch your still developing!

Thank again,
Ben

[soulgalore]

Hi Ben, ok I will look at it asap tonight, I did a fix for windows, worked on mac os x ... you know how it is :)

[bensquire]

Legend! I look forward to the update!

On 26 Jan 2014, at 13:22, Peter Hedenskog notifications@github.com wrote:

Hi Ben, ok I will look at it asap tonight, I did a fix for windows, worked on mac os x ... you know how it is :)

—
Reply to this email directly or view it on GitHub.

[soulgalore]

ohh, my mistake, I've done a fix now in 2.6-wip.

[bensquire]

Hi Peter,

That removed the error regarding browsertime, however builds are still failing in Jenkins because of the following error:

Create all (1) pages per URL
Create all the result pages
Create result.xml
Create the summary.xml
tee: /dev/tty: No such device or address

I appreciate this might not be to do with sitespeed.io but the jenkins plugin, would you rather I raised a ticket in the other repo?

Thanks for the continued effort!
Ben

[soulgalore]

Hi Ben,
sorry for the problems. no it's in sitespeed. So you are running on CentOS right? I will set up a box later today and test (only tested on Ubuntu for the latest release).

Best
Peter

[bensquire]

Hi Peter,

No problem, I'm just grateful for the support! Yes I'm on CentOS. I look forward to an update with baited breath!

Cheers
Ben

[soulgalore]

Hi Ben, ok cool. Got CentOS up and running and it works running standalone, need to test through Jenkins,I'll get back if I need help.

[bensquire]

Hi Peter, awesome thanks. I can also confirm it seemed ok when simply running it via the command line.

Cheers
Ben

On 27 Jan 2014, at 10:09, Peter Hedenskog notifications@github.com wrote:

Hi Ben, ok cool. Got CentOS up and running and it works running standalone, need to test through Jenkins,I'll get back if I need help.

—
Reply to this email directly or view it on GitHub.

[bensquire]

Hi Peter, awesome thanks. I can also confirm it seemed ok when simply
running it via the command line.

Cheers
Ben

On 27 Jan 2014, at 10:09, Peter Hedenskog notifications@github.com wrote:

Hi Ben, ok cool. Got CentOS up and running and it works running standalone,
need to test through Jenkins,I'll get back if I need help.

—
Reply to this email directly or view it on
GitHubhttps://github.com//issues/263#issuecomment-33354839
.

[soulgalore]

yes I just need to see how I can get Jenkins up & running, Im not used to CentOS :)

[soulgalore]

Hi Ben, so now it actually works on my box (it worked in the master branch, I've missed one thing in 2.6-wip). Only thing now for me on CentOS is that I'm missing XSLTProc, will check that later. Please get back to me when you have had time to test!

Best
Peter

[bensquire]

Hi Peter,

It worked :) thank you... No errors just the report! I'll continue using the 2.6 branch until you get a chance to merge.

Thanks once again!
Cheers
Ben

[soulgalore]

Hi Ben, great!! I will write a summary of whats needed on the docunentation site later this week, would be great if you have time to review it!

Best
Peter

[bensquire]

No worries Peter, just point me in the right direction once you've completed it :)

Cheers
Ben