Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大师你好 怎么判断是否抓取完毕了？ #142

Open
MissAlang opened this issue Aug 7, 2019 · 6 comments
Open

大师你好 怎么判断是否抓取完毕了？ #142

MissAlang opened this issue Aug 7, 2019 · 6 comments

Comments

@MissAlang
Copy link

No description provided.

@MissAlang
Copy link
Author

不可能是一直运行的吧？ 我想知道 我给的网址 是否抓取完毕的

@owner888
Copy link
Owner

owner888 commented Aug 7, 2019

是一直运行直到抓完所有数据自动停止的哈，看到程序退出了，就是全抓完了

@MissAlang
Copy link
Author

感觉大神 这么速度的回答。比如 我想这样呢 抓取完毕了 发送一个报告 咋处理 。

@MissAlang
Copy link
Author

大神求指点下

@pfinal-nc
Copy link

@MissAlang 我是linux系统 跑后台进程 然后写日志,程序跑完毕有写日志的

@awebc
Copy link
Contributor

awebc commented Aug 12, 2020

是一直运行直到抓完所有数据自动停止的哈，看到程序退出了，就是全抓完了

能不能加一个 $phpspider->on_end()的方法，当任务结束时可以做一些操作，比如启动下一个网站的爬取，更新任务状态，可以做web 爬虫的任务监控

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@owner888 @awebc @pfinal-nc @MissAlang