Endless loop when receiving comments #1347
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There is currently a problem with Instagram that sporadically the comments do not come to an end and can be scraped endlessly.
The has_next_page-flag (inside the request response) is always true although the comments are repeated.
This error does not always occur, but mainly with larger profiles and the consequence is that you quickly run into an HTTP 429 Error (Too Many Requests).
The problem can also be reproduced in the browser
Test data: https://www.instagram.com/p/CVyEdhbIXPG/
The changes proposed in this pull request
change the nodeiterator next method to check if the response is the same than before
The completeness of this change