Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[crawler] 影片DSVR1038数据抓取异常 #26

Closed
Losalkki opened this issue Dec 16, 2021 · 2 comments
Closed

[crawler] 影片DSVR1038数据抓取异常 #26

Losalkki opened this issue Dec 16, 2021 · 2 comments

Comments

@Losalkki
Copy link

番号
DSVR1038-cd1.mp4

异常数据信息
不挂代理时可以正确抓取演员名
挂代理时反而不能抓取
建议排查,建议考虑合并字段

是否使用代理
挂代理反而出现问题

@Yuukiy
Copy link
Owner

Yuukiy commented Dec 16, 2021

这部影片用的是normal里配的抓取器,我看了一下,这些抓取器里只有JavDB有演员数据,挂代理可能触发了JavDB的反爬虫措施,所以导致抓取失败。遇到类似情况可以换个代理地址,或者等一段时间再试试

@Losalkki
Copy link
Author

OK,Thanks。

@Yuukiy Yuukiy closed this as completed Dec 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants