Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Uncaught RangeError: Maximum call stack size exceeded" #8

Closed
anksng1201 opened this issue Aug 18, 2020 · 2 comments · Fixed by #12
Closed

Uncaught RangeError: Maximum call stack size exceeded" #8

anksng1201 opened this issue Aug 18, 2020 · 2 comments · Fixed by #12

Comments

@anksng1201
Copy link

Hello,

I am getting an Uncaught RangeError for locations where the reviews are more than 900-1000. This is probably from the while loop in scrapper.py. Is there a way to resolve this. Thanks in advance.

Best

@ghost
Copy link

ghost commented Aug 19, 2020

Hello,

I am getting an Uncaught RangeError for locations where the reviews are more than 900-1000. This is probably from the while loop in scrapper.py. Is there a way to resolve this. Thanks in advance.

Best

Hi,

Can you please look at the issue I posted and see if you had the same error?

#9

Thanks

@gaspa93
Copy link
Owner

gaspa93 commented Aug 28, 2020

Hi @anksng1201,

I already run some tests about limits and I discovered that at around 1300 reviews, Google Maps website does not load further reviews and it remains blocked while trying to load more: I am not sure if it is a problem of loading more data on the HTML, a memory problem or a limitation that imposed Google itself.

The only thing that it comes to my mind is to add a control that, after a number of scrolls without new data, terminates the program. If you want to scrape more reviews, you have to run the scraper daily or hourly so that you can always stay in the limit of 1300 I think.

Mattia

@gaspa93 gaspa93 added this to the Periodic monitoring milestone Dec 5, 2020
@gaspa93 gaspa93 linked a pull request Jan 8, 2021 that will close this issue
@gaspa93 gaspa93 closed this as completed Jan 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants