Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Youtube gives us infinite loading screen sometimes when we scrap a playlist (did we trip a bot protection mechanism?) #22

Open
brilliant-ember opened this issue Dec 27, 2021 · 0 comments
Labels
bug Something isn't working

Comments

@brilliant-ember
Copy link
Owner

brilliant-ember commented Dec 27, 2021

as mentioned in #19
and could be related to #18

Sometimes youtube gives us an infinite loading spinner when we try to download dynamic content from a playlist and we don't detect that loading spinner (it's html class is circle and id is spinner-id as of today) and this causes us to exit the playlist prematurely and not scrape the remaining of the videos.

run ` python3 tests/functionality_testing/Scrapper_test.py -k "test_get_playlist_info" which passed normally, but fails when the issue happens (or a user updates their number of videos 😄 )

@brilliant-ember brilliant-ember added the bug Something isn't working label Dec 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant