-
Notifications
You must be signed in to change notification settings - Fork 559
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not downloading any images #24
Comments
@Ajithbalakrishnan I believe you behaved a typo on '127.0.0.0:1080", which should be '127.0.0.1:1080 |
@sczhengyabin Thanks for your quick comment . But i have tried every combination and i got the same answer. `python3 image_downloader.py --engine Google --driver chrome_headless --max-number 100 --output ./images --proxy_socks5 127.0.0.1:1080 apple Scraping From Google Image Search ... Keywords: apple == 0 out of 0 crawled images urls will be used. Finished.` I tried the same with GUI also. But got the same results. |
|
@sczhengyabin I have proper network. But am woking on ubuntu with anaconda environment. I hopes that will not be a problem. I installed the requiremnets through pip. |
@Ajithbalakrishnan Try using chrome mode. Which you can see visual actions in chrome browser to see where goes wrong. |
@sczhengyabin I tried chrome mode in GUI. Please watch the result. Chrome promted for a second. But it went off. I checked the chrome driver also. Versin also same only. |
@Ajithbalakrishnan no clue yet. Does Bing engine works? |
@sczhengyabin Nope. Same result. Chrome is not showing that search results. I checked the internet. I have good network. @sczhengyabin Please share the dependancies and its versions that u have used. |
requests==2.18.4
selenium==3.141.0
PyQt5==5.14.2 generated using Seems to me still a network issue, at least for this project. To verify, you can setup proxy using 'proxychains', rather than the proxy option in this project. # config in /etc/proxychains.conf
proxychains python3 image_downloader.py ... |
`proxychains python3 image_downloader.py --engine Google --driver chrome_headless --max-number 100 --output ./images --proxy_socks5 127.0.0.1:1080 apple Scraping From Google Image Search ... Keywords: apple I tried to change the line "socks4 127.0.0.1 9050" in proxychain config file to 127 0 0 1 1080. But no use. |
@Ajithbalakrishnan |
@sczhengyabin Its working now. I made some changes in /etc/proxychains config file.
Then i have installed Tor,pysocks in my environment.
As the sock5 port has been changed, so command will be
Hopes this might helpful for others. Sorry for wasting your valuable time. |
@Ajithbalakrishnan It's ok, as long as the problem is solved. |
fwiw I have a similar issue but only with Google. I think the reason is that google shows a "before you continue to google" page - that's what I quickly see in the interactive Chrome option, before it closes. Using Bing instead works. |
`python3 image_downloader.py --engine Google --driver chrome_headless --max-number 100 --output ./images --proxy_socks5 127.0.0.0:1080 apple
Scraping From Google Image Search ...
Keywords: apple
Number: 100
Face Only: False
Safe Mode: False
Query URL: https://www.google.com/search?tbm=isch&hl=en&q=apple&safe=off
/home/ajith/miniconda3/lib/python3.7/site-packages/selenium-4.0.0a5-py3.7.egg/selenium/webdriver/remote/webdriver.py:640: UserWarning: find_elements_by_* commands are deprecated. Please use find_elements() instead
warnings.warn("find_elements_by_* commands are deprecated. Please use find_elements() instead")
Find 0 images.
== 0 out of 0 crawled images urls will be used.
Finished.`
I tried with GUI also. But it doesnt work. Please guid me.
The text was updated successfully, but these errors were encountered: