Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gerapy任务管理选择多台主机,调度2台,剩下2台未调度 #252

Open
Qingenmm opened this issue Dec 6, 2022 · 0 comments
Open
Assignees
Labels

Comments

@Qingenmm
Copy link

Qingenmm commented Dec 6, 2022

问题描述
任务管理中配置4台主机,gerapy调度时有输出客户端的调度日志,但scrapyd的web页面有两台未启动,gerapy元数据表(django_apscheduler_djangojobexecution)的状态是两条数据为Executed,两条数据为Started execution。【重启gerapy后可正常调度】

日志
INFO - 2022-12-06 10:23:00,022 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler02_6805, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,055 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6806, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,067 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6807, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,088 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6808, project project_name, spider spider_name

django_apscheduler_djangojobexecution表数据
16 Started execution 2022-12-06 02:23:00.000000 crawler02_6805-project_name-spider_name
17 Started execution 2022-12-06 02:23:00.000000 crawler03_6806-project_name-spider_name
18 Executed 2022-12-06 02:23:00.000000 2.00 1670293382.00 crawler03_6807-project_name-spider_name
19 Executed 2022-12-06 02:23:00.000000 1.98 1670293381.98 crawler03_6808-project_name-spider_name

环境
OS: ubuntu 20.04
Browser: Chrome 104(64位)
Python: 3.9.15
Gerapy: 0.9.11
Scrapyd: 1.3.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants