"Unable to find guest token" exception on Twitter calls from AWS

[arranjdavis]

I am using a conda environment on a Linux machine (an AWS instance) using Python 3.8.3.

I have installed snscrape using pip3 install git+https://github.com/JustAnotherArchivist/snscrape.git

When I run any call to Twitter from the command line, such as:

snscrape twitter-user textfiles >twitter-@textfiles

I get the snscrape.base.ScraperException: Unable to find guest token exception. I saw that this is similar to issue #64, but it is closed. Sorry, not sure if I should bring this up here or on #64!

Thanks for the help, and all of your work on this!

[JustAnotherArchivist]

I've heard this before. It appears that all AWS IPs are blocked on Twitter. This isn't something that I can work around in snscrape I'm afraid.

[arranjdavis]

Ahh, I see. Thanks for clarifying that! It is really useful to know. Good luck with this project!

[arranjdavis]

Just to say, I have figured out how to run snscrape from a Google Colab, although you will need to figure out a way to run Python 3.8 on the Colab if you want to use arguments like --jsonl.

This worked for me (see comments on the accepted answer, as well).

[T-Zahil]

Same issue but with Heroku :/

[JustAnotherArchivist]

@T-Zahil Heroku runs on top of AWS, so that makes sense.

[Hamma111]

I get the snscrape.base.ScraperException: Unable to find guest token exception. I saw that this is similar to issue #64, but it is closed. Sorry, not sure if I should bring this up here or on #64!

I'm in google colab and getting this exception. Were you able to this working?

BTW thanks for this

This worked for me (see comments on the accepted answer, as well).

[tungstenm]

Has anyone found a workaround/solution for running snscrape on aws?
I am getting the same error: "ScraperException: Unable to find guest token"

[mahdix]

Same issue on DO. Works perfectly fine on my laptop but on my VPS fails.