Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

utils.is_gzipped returns false on application/x-gzip;charset=utf-8 #2049

Closed
Tethik opened this issue Jun 12, 2016 · 1 comment
Closed

utils.is_gzipped returns false on application/x-gzip;charset=utf-8 #2049

Tethik opened this issue Jun 12, 2016 · 1 comment
Labels
Milestone

Comments

@Tethik
Copy link
Contributor

Tethik commented Jun 12, 2016

I had a site return the following header, which caused SitemapSpider to not parse a sitemap xml that was gzipped.

Content-Type: application/x-gzip;charset=utf-8

Looking into the code it seems that the function utils.is_gzipped does not take into account cases where the Content-Type header would include charset.

@eliasdorneles
Copy link
Member

Fixed in #2050!
@Tethik @robsonpeixoto @redapple thanks fellows!

@redapple redapple added this to the v1.1.1 milestone Jul 13, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants