Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are bots ok? #84

Closed
k2helix opened this issue Oct 5, 2022 · 2 comments
Closed

Are bots ok? #84

k2helix opened this issue Oct 5, 2022 · 2 comments

Comments

@k2helix
Copy link

k2helix commented Oct 5, 2022

Hi. I discovered Proxitok a while ago and thought about making a bot that would scrape a proxitok instance and send someone's posts into Discord. It would just scrape it when a Discord user requests (via a command) to see a tiktok profile (which would not happen so much).

Is this ok or do you prefer not to let bots scrape proxitok instances? I'm asking because as you may know one of the causes of Bibliogram dying was the bots that were scraping it.

@pablouser1
Copy link
Owner

Hi @k2helix,

Bots/automated requests are a growing problem in ProxiTok. I guess it's OK if you don't spam requests, but I would still highly appreciate anyone trying to scrape ProxiTok not to. There are already libraries such as TikTok-Api for Python or tiktok-scraper for JS/TS, to name a few, that do the job for you.

I'm asking because as you may know one of the causes of Bibliogram dying was the bots that were scraping it.

I wasn't aware about Bibliogram been discotinued... I've been reading Bibliogram's author blog article about it.
ProxiTok is having similar problems with bots spamming requests non-stop (at a smaller scale though, this project is still relatively young after all).

RSS isn't much of a problem (at least for now). All requests made to TikTok are cached for some time so they don't impact that much rate limits.

@k2helix
Copy link
Author

k2helix commented Oct 6, 2022

Hi again.

In my case I would be using the js library, which at the moment is broken. I discovered a fork that worked and edited it a bit.

What I was planning to do is to try and get the info directly from tiktok (for which I've been looking at Tiktok scraper from this project's readme) and if there is some kind of error grab it from Proxitok.

I'll try not to scrape it if I can, keeping in mind what you said. If you have some problem anytime caused by bots, please let me know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants