Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some websites return 405 error #59

Closed
x-ji opened this issue Oct 21, 2018 · 3 comments
Closed

Some websites return 405 error #59

x-ji opened this issue Oct 21, 2018 · 3 comments
Labels
Bug Something isn't working

Comments

@x-ji
Copy link

x-ji commented Oct 21, 2018 •
edited

Some websites like SCMP (e.g. https://www.scmp.com/economy/china-economy/article/2169378/xi-jinping-donald-trump-agree-talks-g20-summit-next-month) doesn't seem to allow requests from headless browsers? I wonder if there's anything that can be done about it, though of course this might fall out of the scope of what this tool should handle.
@danburzo
Copy link
Owner

danburzo commented Oct 22, 2018 •
edited

It seems to have been a problem with not supplying a User-Agent header. The change will be released soon, thanks for reporting!

@danburzo danburzo added the Bug Something isn't working label Oct 22, 2018
@danburzo
Copy link
Owner

Released percollate@0.2.13 which includes a fix for this issue.

@x-ji
Copy link
Author

x-ji commented Oct 24, 2018

Thanks. Works well now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@danburzo @x-ji