-
Notifications
You must be signed in to change notification settings - Fork 891
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
线程没有正确结束? #41
Comments
start()方式启动engine线程不会释放的,会一直监听队列。run()方式启动engine,如果队列里没有需要抓取的内容就会停止线程 |
也就是说 run() 方式爬虫跑完一个链接就停止一个线程, 而 start() 跑完并不会释放 是这个意思吗? |
用 start() 方式不会自动释放 能不能手动进行释放? 这样的话 跑定时任务一直不结束线程 第一次还行 后面几次都直接累积了 一直到系统最大线程 服务又挂掉 |
定时任务用run()的方式 |
Closed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
链接大概有5-10k左右 如下:
运行了一段时间过后 项目报错
观察了下系统线程
已经跑完的链接 run 方法并没有被结束 ,请问下爬虫跑完为什么没有让线程停止呢? 谢谢了。
The text was updated successfully, but these errors were encountered: