Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

可以获取用户信息吗 #1

Closed
lovesnacks opened this issue Apr 16, 2019 · 4 comments
Closed

可以获取用户信息吗 #1

lovesnacks opened this issue Apr 16, 2019 · 4 comments

Comments

@lovesnacks
Copy link

您好,请问可以把用户的个人信息如性别/所在地/出生年月等标签一起爬取下来吗

@qinyuenlp
Copy link
Owner

您好,您是说爬取用户在其主页填写的个人信息吗?目前上传的代码是无法完成这个工作的。
事实上您说的这个工作我已经写了一部分了,但还没有全部完成,过段时间会上传。

@lovesnacks
Copy link
Author

是的是的!谢谢您的回复~

@lovesnacks
Copy link
Author

lovesnacks commented May 2, 2019

您好,您运行user spider有出现这样的情况吗?就是弹出chrome微博页面登陆,自动输入用户名和密码,我手动输入验证码然后确认就没有下一步了,就会报错。大概有两种错误:
1)selenium.common.exceptions.TimeoutException: Message:
2)selenium.common.exceptions.InvalidArgumentException: Message: invalid argument: 'url' must be a string
image
image

@qinyuenlp
Copy link
Owner

我这里是没有出现这两个情况的,第一个TimeoutException可能的情况比较多,不太好分析;第二个错误说url不是字符,您可以检查一下输入的href是否正确。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants