Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YouTube comment scraper deactivated #28

Open
Yakabuff opened this issue Oct 17, 2019 · 8 comments

Comments

@Yakabuff
Copy link

@Yakabuff Yakabuff commented Oct 17, 2019

502 bad gateway

@philbot9

This comment has been minimized.

Copy link
Owner

@philbot9 philbot9 commented Oct 17, 2019

@Yakabuff Thanks, there are issues with retrieving the video info and the scraper stopped working. I have taken the site down so I don't get flooded with error reports from users 😉

While I work on a solution you can use https://github.com/philbot9/youtube-comment-scraper-cli locally.

@sevecose

This comment has been minimized.

Copy link

@sevecose sevecose commented Oct 21, 2019

@Yakabuff Thanks, there are issues with retrieving the video info and the scraper stopped working. I have taken the site down so I don't get flooded with error reports from users

While I work on a solution you can use https://github.com/philbot9/youtube-comment-scraper-cli locally.

Not everyone is a programmer and not everyone has Linux. If it was an exe, no problem. This is desperate. Many comments from YT disappear. I only found your service last month. It was great help!

@philbot9

This comment has been minimized.

Copy link
Owner

@philbot9 philbot9 commented Oct 21, 2019

@sevecose Neither programming skills nor Linux are required to run the CLI. As per the installation instructions in the README you do have to have node.js with npm installed (and I would suggest PowerShell on Windows).

If that’s not an option for you keep an eye on this GitHub issue. When I have the time to fix this problem and the site is back up I will close this Issue.

@philbot9

This comment has been minimized.

Copy link
Owner

@philbot9 philbot9 commented Oct 23, 2019

The site is back up for the short term!

http://ytcomments.klostermann.ca

Depending on usage it may go down again. I'm exploring options to find a more permanent solution.

@philbot9 philbot9 closed this Oct 23, 2019
@philbot9

This comment has been minimized.

Copy link
Owner

@philbot9 philbot9 commented Oct 29, 2019

Unfortunately, I had to disable the scraper again.

It looks like we have reached critical mass. Due to the high number of comments being scraped by users, YouTube has blocked the server IP. I'm looking at alternative options such as Proxy servers or something like AWS lambda.

Until I have found a solution the scraper will remain deactivated. As an alternative, users can use this project to run the scraper locally: https://github.com/philbot9/youtube-comment-scraper-cli

@philbot9 philbot9 reopened this Oct 29, 2019
@philbot9 philbot9 changed the title youtube comment scraper site down YouTube comment scraper deactivated Oct 29, 2019
@memento

This comment has been minimized.

Copy link

@memento memento commented Nov 11, 2019

Unfortunately, I had to disable the scraper again.

It looks like we have reached critical mass. Due to the high number of comments being scraped by users, YouTube has blocked the server IP. I'm looking at alternative options such as Proxy servers or something like AWS lambda.

Until I have found a solution the scraper will remain deactivated. As an alternative, users can use this project to run the scraper locally: https://github.com/philbot9/youtube-comment-scraper-cli

What is the volume or requets that triggered the BAN ?

@everythinginitsrightplace

This comment has been minimized.

Copy link

@everythinginitsrightplace everythinginitsrightplace commented Nov 17, 2019

Hi! Thanks a lot for this wonderful scraper that can be run locally. But I found a bug when videoID starts with dash "-". For example, "-Kh0zUkX7cs" this video returns me a helper in the terminal.

How to fix it?

@philbot9

This comment has been minimized.

Copy link
Owner

@philbot9 philbot9 commented Nov 17, 2019

@everythinginitsrightplace Please post issues with the CLI on that repo: https://github.com/philbot9/youtube-comment-scraper-cli

This has actually come up before though: philbot9/youtube-comment-scraper-cli#19

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
5 participants
You can’t perform that action at this time.