Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WikipediaCrawlTool] Set Accept-Language to zh-Hant and zh-Hans for Chinese #5

Open
kkrugler opened this issue Apr 16, 2016 · 2 comments
Open

[WikipediaCrawlTool] Set Accept-Language to zh-Hant and zh-Hans for Chinese #5

kkrugler opened this issue Apr 16, 2016 · 2 comments

Comments

@kkrugler
Copy link
Owner

This means we make two requests for each page.

Try with https://zh.wikipedia.org/wiki/疏花木犀榄

Should get different pages, for zh-Hant vs. zh-Hans
@kkrugler
Copy link
Owner Author

  • zh-hans works
  • zh-Hans works
  • zho-Hans doesn't work

@kkrugler
Copy link
Owner Author

Hmmm, I've got these examples in my notes. Not sure if this means you can make requests via different URLs, vs having to set Accept-Language.

@kkrugler kkrugler mentioned this issue Apr 16, 2016
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kkrugler