No Such Element Exception

[bartels50642]

Hi All,

I'm trying to run this code as of Oct 2020, but I keep running into the "No Such Element Exception" error. Any help here would be GREATLY appreciated! Here is the error that runs:

2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu

NoSuchElementException Traceback (most recent call last)
in
44
45 if name == 'main':
---> 46 main()

in main()
7
8
----> 9 sign_in()
10
11 if not args.start_from_url:

in sign_in()
7 # import pdb;pdb.set_trace()
8
----> 9 email_field = browser.find_element_by_name('username')
10 password_field = browser.find_element_by_name('password')
11 submit_btn = browser.find_element_by_xpath('//button[@type="submit"]')

/opt/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in find_element_by_name(self, name)
494 element = driver.find_element_by_name('foo')
495 """
--> 496 return self.find_element(by=By.NAME, value=name)
497
498 def find_elements_by_name(self, name):

/opt/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in find_element(self, by, value)
976 return self.execute(Command.FIND_ELEMENT, {
977 'using': by,
--> 978 'value': value})['value']
979
980 def find_elements(self, by=By.ID, value=None):

/opt/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py in execute(self, driver_command, params)
319 response = self.command_executor.execute(driver_command, params)
320 if response:
--> 321 self.error_handler.check_response(response)
322 response['value'] = self._unwrap_value(
323 response.get('value', None))

/opt/anaconda3/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py in check_response(self, response)
240 alert_text = value['alert'].get('text')
241 raise exception_class(message, screen, stacktrace, alert_text)
--> 242 raise exception_class(message, screen, stacktrace)
243
244 def _value_or_default(self, obj, key, default):

NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"[name="username"]"}
(Session info: chrome=86.0.4240.111)

[sachinchaturvedi93]

https://github.com/sachinchaturvedi93/glassdoor-review-scraper

Try this out, I haven't updated this in a while though. Let me know if I could help.

[bartels50642]

Hi Sachin,

Thanks for the speedy reply! I tried your code and it looks like part of it is working (Chrome opens, goes to Glassdoor, passes through login, and opens the "Premise Data Corporation" landing page) but I still get an error in python like this:

NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".pagination__PaginationStyle__page.pagination__PaginationStyle__current"}
(Session info: chrome=86.0.4240.111)

Any ideas what could be wrong?

[sachinchaturvedi93]

I guess the element isn't loading. Try again or try adding wait time. I'm sure that's the name of the current page class. I checked the source code too.

[bartels50642]

Hrm okay, how would I go about adding wait time? Sorry I am new to scraping...

[bartels50642]

Should I change the "time.sleep(1)" to "time.sleep(500)" (or some other number that is greater?

[Cangelelli]

@bartels50642 Did you ever figure it out? I am having the same issue with the page-turner.