Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The crawler falls with uninformative messages #2

Closed
arsenyinfo opened this issue Nov 23, 2018 · 3 comments
Closed

The crawler falls with uninformative messages #2

arsenyinfo opened this issue Nov 23, 2018 · 3 comments

Comments

@arsenyinfo
Copy link

Would you please make the logging more informative? It's kind of complicated to understand what went wrong here:

MacBook-Pro-2:AutoCrawler Arseny$ PATH="$PATH:./" python auto_crawler.py
Options - skip:True, threads:4, google:True, naver:True
2 keywords found: ['cat', 'dog']
Collecting links... cat from naver
Collecting links... cat from google
Collecting links... dog from google
Collecting links... dog from naver
Exception cat - Message: session not created exception
from unknown error: Runtime.executionContextCreated has invalid 'context': {"auxData":{"frameId":"297D684EEED11AB59AC252CF27E1E7B2","isDefault":true,"type":"default"},"id":1,"name":"","origin":"://"}
  (Session info: chrome=70.0.3538.102)
  (Driver info: chromedriver=2.20.353124 (035346203162d32c80f1dce587c8154a1efa0c3b),platform=Mac OS X 10.14.0 x86_64)

Exception dog - Message: session not created exception
from unknown error: Runtime.executionContextCreated has invalid 'context': {"auxData":{"frameId":"5805277448BDF963C6444F5EE17C0CDB","isDefault":true,"type":"default"},"id":1,"name":"","origin":"://"}
  (Session info: chrome=70.0.3538.102)
  (Driver info: chromedriver=2.20.353124 (035346203162d32c80f1dce587c8154a1efa0c3b),platform=Mac OS X 10.14.0 x86_64)

Exception cat - Message: session not created exception
from unknown error: Runtime.executionContextCreated has invalid 'context': {"auxData":{"frameId":"000EFF0A0FF3241C84B420B51870186B","isDefault":true,"type":"default"},"id":1,"name":"","origin":"://"}
  (Session info: chrome=70.0.3538.102)
  (Driver info: chromedriver=2.20.353124 (035346203162d32c80f1dce587c8154a1efa0c3b),platform=Mac OS X 10.14.0 x86_64)

Exception dog - Message: session not created exception
from unknown error: Runtime.executionContextCreated has invalid 'context': {"auxData":{"frameId":"1150DDBD226F6974C666A822E62E278B","isDefault":true,"type":"default"},"id":1,"name":"","origin":"://"}
  (Session info: chrome=70.0.3538.102)
  (Driver info: chromedriver=2.20.353124 (035346203162d32c80f1dce587c8154a1efa0c3b),platform=Mac OS X 10.14.0 x86_64)
@YoongiKim
Copy link
Owner

I think it is Chrome Driver error. Please check this. florentbr/SeleniumBasic#158
I uploaded chrome driver version 2.44 on the repository. Try updating to latest version.

@YoongiKim
Copy link
Owner

YoongiKim commented Nov 24, 2018

Chrome Driver is now no need to set PATH. It automatically detects OS and run chrome driver directly. Just Fetch and run again.

@arsenyinfo
Copy link
Author

Thanks! It working now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants