Need to be able to limit the scraping speed or use proxies

[Blare1337]

As many people have stated here, you cannot scrape ig accounts with large following & no limits being set. It's scraping to fast. We need delays or the use of proxies to scrape large accounts.

Searching for target followers...
Traceback (most recent call last):
File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/client.py", line 523, in _call_api
response = self.opener.open(req, timeout=self.timeout)
File "/usr/lib/python3.9/urllib/request.py", line 523, in open
response = meth(req, response)
File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response
response = self.parent.error(
File "/usr/lib/python3.9/urllib/request.py", line 561, in error
return self._call_chain(*args)
File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain
result = func(*args)
File "/usr/lib/python3.9/urllib/request.py", line 641, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 429: Too Many Requests

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/kali/Osintgram/main.py", line 186, in
_cmd()
File "/home/kali/Osintgram/src/Osintgram.py", line 324, in get_followers
data = self.api.user_followers(str(self.target_id), rank_token=rank_token)
File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/endpoints/friendships.py", line 65, in user_followers
res = self._call_api(endpoint, query=query_params)
File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/client.py", line 527, in _call_api
ErrorHandler.process(e, error_response)
File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/errors.py", line 116, in process
raise ClientThrottledError(
instagram_private_api.errors.ClientThrottledError: Please wait a few minutes before you try again.

[TheoLeao]

Hello,

Have you found a solution to solve this limitation? I am also facing this error.

Thanks

[endeavourhgp]

Hello,

I have the same problem with big accounts....

[mk99633d]

في الخميس، ٩ ديسمبر ٢٠٢١ ٣:٥٨ ص endeavourhgp ***@***.***> كتب:

…

Hello, I have the same problem with big accounts.... — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#365 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AWXNB5V2X2OWHUAON7HSQZ3UP75J3ANCNFSM5HGO43NA> .

[emperoribk]

can you use proxies for the osintgram

[markshi9008]

same here, do u guys find any solutions to solve it?

[cryptoparrott]

Completely agree on the need for a rate limit, afaik the current api limit per hour is now 200... you'd need hundreds of proxies baked in somewhere to make that work.

I'm looking at asyncio, aiohttp and semaphores, to see if these could be placed into the command code or at a higher level for all commands etc.