Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scrape problems #1

Closed
xalanq opened this issue Apr 9, 2019 · 3 comments
Closed

Scrape problems #1

xalanq opened this issue Apr 9, 2019 · 3 comments
Labels
enhancement New feature or request

Comments

@xalanq
Copy link
Owner

xalanq commented Apr 9, 2019

Is it legal?

@xalanq xalanq added the enhancement New feature or request label Apr 9, 2019
@VincentXWD
Copy link

VincentXWD commented Apr 12, 2019

Please refer the robot protocol: http://codeforces.com/robots.txt to make sure you're not crawling the unauthorized pages. I think it's ok to touch the problems since the protocol didn't limit the /problemset/problem/* .
BTW, you can use some tools to follow the robot protocol such as: https://github.com/PuerkitoBio/fetchbot

@xalanq
Copy link
Owner Author

xalanq commented Apr 12, 2019

Please refer the robot protocol: http://codeforces.com/robots.txt to make sure you're not crawling the unauthorized pages. I think it's ok to touch the problems since the protocol didn't limit the /problemset/problem/* .
BTW, you can use some tools to follow the robot protocol such as: https://github.com/PuerkitoBio/fetchbot

OK. I will add this feature. Save problems and view it in local

@xalanq xalanq closed this as completed Apr 12, 2019
@xalanq
Copy link
Owner Author

xalanq commented Apr 15, 2019

I thought about it carefully these days. Finally I decided not to add this feature. Just open the problem by default web browser.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants