Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

站点爬虫功能建议 #665

Open
Oldman19 opened this issue Nov 22, 2023 · 1 comment
Open

站点爬虫功能建议 #665

Oldman19 opened this issue Nov 22, 2023 · 1 comment

Comments

@Oldman19
Copy link

现有的站点爬虫功能可以参考https://github.com/Ciyfly/Argo进行优化,或者直接就把这个工具融进来,原本的这个站点爬虫功能实话说挺难用的,爬不到什么东西,太少了

@1c3z
Copy link
Collaborator

1c3z commented Nov 23, 2023

感谢反馈,目前是静态爬虫,用动态爬虫资源消耗比较大,结果如果只保存URL,有点太浪费。 目前还不会加动态爬虫的。
有需要可以导出站点自己爬。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants