[Question] Why is Twint not extracting tweets?

[Barbz2]

Hi,

I am trying to extract tweets in England, under the query of 'hate speech'.

I wrote the following code:

---

import twint

c = twint.Config()

c.Username = "noneprivacy"
c.Custom["tweet"] = ["id"]
c.Custom["user"] = ["bio"]
c.Limit = 10
c.Geocode = 'England'
c.Store_csv = True
c.Output = "none"

twint.run.Search(c)

---

The output was:
Results:
#[!] No more data! Scraping will stop now.
#found 0 deleted tweets in this search.

I tried using the previous code as an experiment before searching my own query.
I also added a date limit but it makes no difference.
It was working well yesterday but for whatever reason, it has stopped.
I can't seem to get why Twint is not working right now. Any advice?

Python - 3.8.5
Windows 10
Notepad ++

Thank you so much! :)

[minamotorin]

Same as #1349

[Barbz2]

I have tried the solution but it is not working. I even tested the examples the comments provided under #1349 but it is not working for me.

[vgewilliam]

Maybe you should update "pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint"?

[minamotorin]

@Barbz2

#1349 means you have to use twint.run.Profile instead of twint.run.Search.
Have you tried this?

[Barbz2]

Hi, No, it gives me a different error message. That said an old coding program has started working, so I will try and go with that (until it stops again) :) Thank you for your help!

…

On Wed, 16 Mar 2022 at 04:58, minamotorin ***@***.***> wrote: @Barbz2 <https://github.com/Barbz2> #1349 <#1349> means you have to use twint.run.Profile instead of twint.run.Search. Have you tried this? — Reply to this email directly, view it on GitHub <#1370 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AQ34Y2DY7HRV7ACZUIZWM5LVAFS6FANCNFSM5QZAJDTQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[orestisc]

@Barbz2

#1349 means you have to use twint.run.Profile instead of twint.run.Search. Have you tried this?

Experiencing the same problem, tried everything. twint.run.Profile returns error: json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

EDIT : twint.run.Search works fully sometimes.
Other times getting half data
Most of the time showing
#[!] No more data! Scraping will stop now.
#found 0 deleted tweets in this search.

[woluxwolu]

Maybe you can check here #1363
OR
Just Reinstall your twint using this fork:
!pip install git+https://github.com/woluxwolu/twint.git

[batmanscode]

@woluxwolu's fork works for me. I was able to scrape tweets going back years

[YooTimmy]

Hello,

I am having similar issues (seeing the following returns while running the queries)
#[!] No more data! Scraping will stop now.
#found 0 deleted tweets in this search.

Have tried the solution proposed by woluxwolu to reinstall my twint, but problem still exists. Any suggestions would be appreciated.

[vgewilliam]

Hello,

I am having similar issues (seeing the following returns while running the queries) #[!] No more data! Scraping will stop now. #found 0 deleted tweets in this search.

Have tried the solution proposed by woluxwolu to reinstall my twint, but problem still exists. Any suggestions would be appreciated.

Hello @YooTimmy , maybe you can try uninstall the twint first and then reinstall:
!pip install git+https://github.com/woluxwolu/twint.git.

[YooTimmy]

Hello @YooTimmy , maybe you can try uninstall the twint first and then reinstall:

Thanks for getting back! I have tried uninstall (pip uninstall twint is the code I used, it rans successfully) and then install using your command again. But still, when extracting the tweets it will stop in the middle or only return a few hundred records back.

[ghost]

The fork works. You are lucky to find anything that works on Windows lately.

[pbabvey]

Thanks, @woluxwolu for the fix. It works to download tweets. I am still getting errors while using twint to collect the following/follower lists. Is there a solution around that or a hint on how can we fix it?