Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

抓取“回答”不成功 #125

Open
Rich-999 opened this issue Feb 5, 2023 · 1 comment
Open

抓取“回答”不成功 #125

Rich-999 opened this issue Feb 5, 2023 · 1 comment

Comments

@Rich-999
Copy link

Rich-999 commented Feb 5, 2023

显示好像是抓取成功了,但生成电子书没成功,卸载重装也不行。。

自定义任务运行日志登陆知乎使用说明
2023-02-05 15:37:27.120: 重新载入cookie配置
2023-02-05 15:37:27.221: 开始工作
2023-02-05 15:37:27.222: 重新载入cookie配置
2023-02-05 15:37:27.223: 开始执行任务
2023-02-05 15:37:27.223: [DispatchCommand] command start
2023-02-05 15:37:27.223: [DispatchCommand] 检查更新
2023-02-05 15:37:27.224: [InitEnv] command start
2023-02-05 15:37:27.224: [InitEnv] 检查更新
2023-02-05 15:37:27.772: [InitEnv] 初始化文件夹
2023-02-05 15:37:27.776: [InitEnv] 文件夹初始化完毕
2023-02-05 15:37:27.776: [InitEnv] 初始化数据库
2023-02-05 15:37:27.786: [InitEnv] 数据库初始化完毕
2023-02-05 15:37:27.787: [InitEnv] command finish
2023-02-05 15:37:27.787: [DispatchCommand] 创建任务实例
2023-02-05 15:37:27.787: [DispatchCommand] 执行抓取命令
2023-02-05 15:37:27.787: [FetchCustomer] command start
2023-02-05 15:37:27.787: [FetchCustomer] 从C:\Program Files\zhihuhelp\resources\app\customer_task_config.json中读取配置文件
2023-02-05 15:37:27.788: [FetchCustomer] content =>{
"configList": [
{
"type": "answer",
"id": "2167746971",
"rawInputText": "https://www.zhihu.com/question/33939325/answer/2167746971",
"comment": "",
"skipFetch": false,
"defaultTitle": "回答_2167746971",
"lastId": "2167746971"
}
],
"imageQuilty": "raw",
"bookTitle": "回答_2167746971",
"maxQuestionOrArticleInBook": 10000,
"orderByList": [
{
"orderBy": "createAt",
"order": "desc"
}
],
"comment": "",
"skipFetch": false
}
2023-02-05 15:37:27.789: [FetchCustomer] 开始进行自定义抓取, 共有1个任务
2023-02-05 15:37:27.789: [FetchCustomer] 合并抓取任务
2023-02-05 15:37:27.789: [FetchCustomer] 抓取任务合并完毕, 最终结果为=>{"answer":["2167746971"]}
2023-02-05 15:37:27.789: [FetchCustomer] 开始派发自定义任务=>
2023-02-05 15:37:27.789: [BatchFetchAnswer] 启动第1/1个抓取任务(2167746971)
2023-02-05 15:37:27.790: [BatchFetchAnswer] 准备抓取回答2167746971
2023-02-05 15:37:27.912: [BatchFetchAnswer] 问题33939325下的回答2167746971抓取成功, 存入数据库
2023-02-05 15:37:27.922: [BatchFetchAnswer] 问题33939325下的回答2167746971成功存入数据库
2023-02-05 15:37:27.922: [BatchFetchAnswer] 第1/1个任务(2167746971)执行完毕
2023-02-05 15:37:27.922: [BatchFetchAnswer] 派发所有待抓取任务
2023-02-05 15:37:27.923: 任务队列已满, 开始执行任务, 共1个任务待执行
2023-02-05 15:37:27.923: 队列已满, 休眠1s, 保护知乎服务器
2023-02-05 15:37:28.924: 任务队列内所有任务执行完毕
2023-02-05 15:37:28.925: [BatchFetchAnswer] 所有抓取任务执行完毕
2023-02-05 15:37:28.925: [FetchCustomer] 自定义任务抓取完毕
2023-02-05 15:37:28.925: [FetchCustomer] command finish
2023-02-05 15:37:28.925: [DispatchCommand] 抓取命令执行完毕
2023-02-05 15:37:28.926: [DispatchCommand] 执行生成电子书命令
2023-02-05 15:37:28.926: [GenerateCustomer] command start
2023-02-05 15:37:28.926: [GenerateCustomer] 从C:\Program Files\zhihuhelp\resources\app\customer_task_config.json中读取配置文件
2023-02-05 15:37:28.926: [GenerateCustomer] content =>{
"configList": [
{
"type": "answer",
"id": "2167746971",
"rawInputText": "https://www.zhihu.com/question/33939325/answer/2167746971",
"comment": "",
"skipFetch": false,
"defaultTitle": "回答_2167746971",
"lastId": "2167746971"
}
],
"imageQuilty": "raw",
"bookTitle": "回答_2167746971",
"maxQuestionOrArticleInBook": 10000,
"orderByList": [
{
"orderBy": "createAt",
"order": "desc"
}
],
"comment": "",
"skipFetch": false
}
2023-02-05 15:37:28.927: [GenerateCustomer] 开始输出自定义电子书, 共有1个任务
2023-02-05 15:37:28.928: [GenerateCustomer] 将任务中的数据按照问题/文章/想法进行汇总
2023-02-05 15:37:28.928: [GenerateCustomer] 处理第1/1个任务, 任务类型:answer, 任务备注:
2023-02-05 15:37:28.928: [GenerateCustomer] 获取回答2167746971
2023-02-05 15:37:28.968: [GenerateCustomer] 回答2167746971不存在, 自动跳过
2023-02-05 15:37:28.968: [GenerateCustomer] 所有数据获取完毕, 最终结果为=>
2023-02-05 15:37:28.968: [GenerateCustomer] 问题 => 0个
2023-02-05 15:37:28.969: [GenerateCustomer] 文章 => 0篇
2023-02-05 15:37:28.969: [GenerateCustomer] 想法 => 0条
2023-02-05 15:37:28.969: [GenerateCustomer] 按配置排序
2023-02-05 15:37:28.970: [GenerateCustomer] command finish
2023-02-05 15:37:28.970: [DispatchCommand] 生成电子书命令执行完毕
2023-02-05 15:37:28.970: [DispatchCommand] 所有命令执行完毕
2023-02-05 15:37:28.970: [DispatchCommand] command finish
2023-02-05 15:37:28.971: 所有任务执行完毕, 打开电子书文件夹 => C:\Program Files\zhihuhelp\resources\app\知乎助手输出的电子书

@king0billy
Copy link

俺也一样

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants