New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

将ua伪装成crawler怎么判断是否被爬 #7

Closed

liSong5713 opened this issue Aug 29, 2017 · 1 comment

liSong5713 commented Aug 29, 2017 •

edited

Loading

1.将ua伪装成crawler怎么判断是否被爬？
2.如果开启useReady，不设置window.isPageReady = 1,headless chrome会生成html吗？
多谢楼主帮助。

Owner

gwuhaolin commented Apr 9, 2018

这个问题很复杂，目前业界比较高级的方法运用到了机械学习；
不会生成html，会timeout；

gwuhaolin closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment