Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

有没有办法查询当前还有多少个链接没有爬完？ #35

Closed
caolusg opened this issue Feb 1, 2019 · 1 comment
Closed

有没有办法查询当前还有多少个链接没有爬完？ #35

caolusg opened this issue Feb 1, 2019 · 1 comment

Comments

@caolusg
Copy link

caolusg commented Feb 1, 2019

生成了数十万个链接在redis里面，怎样知道当前还有多少个URL没有被爬过？
@nghuyong
Copy link
Owner

nghuyong commented Feb 1, 2019

通过redis客户端可以查看redis中剩余的URL数目。具体自行Google。

@nghuyong nghuyong closed this as completed Feb 1, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@caolusg @nghuyong