Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Script crashes if it's not the default address #8

Closed
TheCastes opened this issue Aug 14, 2024 · 3 comments
Closed

Script crashes if it's not the default address #8

TheCastes opened this issue Aug 14, 2024 · 3 comments
Assignees
@MajideND
Labels
invalid This doesn't seem right

Comments

@TheCastes
Copy link

When using another address that is not the standard one in the env.py file, i encounter this error

Traceback (most recent call last):
File "/home/cristianc/Scrivania/ads-scraper/app.py", line 64, in counter
result = driver.find_element_by_xpath('//body/div[2]/div[3]/div[8]/div[9]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[2]').find_element_by_class_name('fontBodySmall').text
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 394, in find_element_by_xpath
return self.find_element(by=By.XPATH, value=xpath)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
return self.execute(Command.FIND_ELEMENT, {
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//body/div[2]/div[3]/div[8]/div[9]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[2]"}
(Session info: chrome-headless-shell=127.0.6533.99)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/cristianc/Scrivania/ads-scraper/app.py", line 119, in
counter = counter()
^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/app.py", line 67, in counter
result = driver.find_element_by_xpath('//body/div[2]/div[3]/div[8]/div[9]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[2]/div[2]/div[1]/div[2]').find_element_by_class_name('fontBodySmall').text
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 394, in find_element_by_xpath
return self.find_element(by=By.XPATH, value=xpath)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
return self.execute(Command.FIND_ELEMENT, {
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/home/cristianc/Scrivania/ads-scraper/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//body/div[2]/div[3]/div[8]/div[9]/div[1]/div[1]/div[1]/div[2]/div[1]/div[1]/div[1]/div[1]/div[2]/div[2]/div[1]/div[2]"}
(Session info: chrome-headless-shell=127.0.6533.99)
@MajideND
Copy link
Owner

MajideND commented Aug 14, 2024 via email

@TheCastes
Copy link
Author

The two links I used are these @MajideND :

https://www.google.com/maps/place//data=!4m2!3m1!1s0x4875efde7d1f391b:0x59dda4bf018973ff?entry=s&sa=X&ved=1t:8290&hl=it-it&ictx=111

https://www.google.com/maps/place/La+Dolce+Legnano,+Via+Abruzzi,+14,+20025+Legnano+MI/@45.5861246,8.9005932,17z/data=!4m6!3m5!1s0x47868d339f625a31:0x9a9ed3e95cf6ab65!8m2!3d45.5861246!4d8.9005932!16s%2Fg%2F11h0mp24r4?hl=it-it

@MajideND
Copy link
Owner

MajideND commented Aug 15, 2024 •
edited
Loading

It would help if you used the reviews tab URL in the eny.py file. it should be:
https://www.google.com/maps/place/Aeroporto+di+Londra-Gatwick/@51.1536621,-0.1820629,17z/data=!4m8!3m7!1s0x4875efde7d1f391b:0x59dda4bf018973ff!8m2!3d51.1536621!4d-0.1820629!9m1!1b1!16zL20vMHByNnM?hl=it-it&entry=ttu
and
https://www.google.com/maps/place/La+Dolce+Legnano/@45.5861246,8.9005932,17z/data=!4m8!3m7!1s0x47868d339f625a31:0x9a9ed3e95cf6ab65!8m2!3d45.5861246!4d8.9005932!9m1!1b1!16s%2Fg%2F11h0mp24r4?hl=it-it&entry=ttu

If it worked please let me know to close the issue.

@MajideND MajideND added the invalid This doesn't seem right label Aug 17, 2024
@MajideND MajideND self-assigned this Aug 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@MajideND MajideND

Labels
invalid This doesn't seem right
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@TheCastes @MajideND