Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

selenium如何爬取js现实的网页 #1533

Open
Totie-O opened this issue Apr 28, 2024 · 1 comment
Open

selenium如何爬取js现实的网页 #1533

Totie-O opened this issue Apr 28, 2024 · 1 comment

Comments

@Totie-O
Copy link

Totie-O commented Apr 28, 2024

李老师,我最近想用selenium模拟浏览器,登录淘宝千牛后台(我想下载自家公司的链接评论)
image
但是我在浏览器上面能定位到这个两个输入框,但是用python代码去模拟浏览器点击会报错,说定位不到这个元素
image
我猜原因可能是网页通过动态生成,但这种网页我以前没有遇到过,不知道怎么解决,李老师能不能给个指引啥的,谢谢

@neolee
Copy link
Owner

neolee commented Apr 29, 2024

这类大厂的商业网站一般会有很多防抓取的设计,不容易搞定,可能要针对目标网站做尝试,可以先搜索下有没有人干过,比如

https://blog.csdn.net/qq_53953480/article/details/130606111

这个你有试过么?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants