R.I.P. Nitter 🪦😭 (...unless?)

[devgaucho]

https://techcrunch.com/2023/06/30/twitter-now-requires-an-account-to-view-tweets/

the nitter crawler will need to be recreated...

[animegrafmays]

it was working this morning but it appears nitter is now broken. viewing any profile results in the following error being thrown

An error has occured in one of your routes.

Detail: jsony.nim(45) parseHook
asyncfutures.nim(389) read
asyncfutures.nim(389) read
asyncfutures.nim(389) read
asyncfutures.nim(389) read
asyncfutures.nim(389) read
asyncfutures.nim(389) read
Expected { but end reached. At offset: 0

[thechesu]

Libreddit gone tomorrow.

Wonder how long Invidious and FreeTube will last?

[cyberseihis]

It's so over

[devgaucho]

the twitter rank has already dropped 6 places from yesterday to today 🤦‍♂️ https://ciscorank.com/s/twitter.com

[ericpa06]

Libreddit gone tomorrow.

Wonder how long Invidious and FreeTube will last?

At least reddit still has the old.reddit.com. Which is a pretty descent front-end (as long as you don't care with privacy), with twitter, you are pretty much forced to use that horrible garbage interface. But yeah, this data rush pretty much will make all platforms to garden walled themselves.

[sunlightspectre]

There are plenty of people who only engage in the modern internet through front-ends; myself being one of them. I have no interest in registering for sites; it took me ages to register a proper git.

One wonders what will happen when these self-inflicted stab-wounds deplete 'profit' rather then generate it?..
Removing access isn't going to make people want to use a site more.
And it certainly won't inflate user numbers, which I'd imagine is the end goal.

C'est la vie.

I'm glad I got to experience the internet as it was.

[animegrafmays]

thoughts?

[codybrom]

No chance in hell this is temporary unless it affects ad revenue

[orbea]

Maybe people will be smart enough to stop using proprietary garbage finally...

[ericpa06]

"Temporary emergency" measure that will always be in place forever.

[DuplicantWood]

This fork is working

https://github.com/PrivacyDevel/nitter/

[roryyamm]

This fork is working

https://github.com/PrivacyDevel/nitter/

But privacydev.net isn't.

[animegrafmays]

I can confirm after building that fork that it also has the same issue

ERROR jsony.nim(45)            parseHook
asyncfutures.nim(389)    read
redpool.nim(68)          getUserIdIter
asyncfutures.nim(389)    read
asyncfutures.nim(389)    read
asyncfutures.nim(389)    read
asyncfutures.nim(389)    read
asyncfutures.nim(389)    read
Expected { but end reached. At offset: 0
404 Not Found:  --- url: https://api.twitter.com/graphql/gkjsKepM6gl_HmFWoWKfgg/SearchTimeline?variables=%7B%22rawQuery%22%3A%22include%3Anativeretweets+%5C%22%23RoshamboCoin%5C%22%22%2C%22count%22%3A20%2C%22product%22%3A%22Latest%22%2C%22withDownvotePerspective%22%3Afalse%2C%22withReactionsMetadata%22%3Afalse%2C%22withReactionsPerspective%22%3Afalse%7D&features=%7B%22blue_business_profile_image_shape_enabled%22%3Afalse%2C%22creator_subscriptions_tweet_preview_api_enabled%22%3Atrue%2C%22freedom_of_speech_not_reach_fetch_enabled%22%3Afalse%2C%22graphql_is_translatable_rweb_tweet_is_translatable_enabled%22%3Afalse%2C%22highlights_tweets_tab_ui_enabled%22%3Afalse%2C%22interactive_text_enabled%22%3Afalse%2C%22longform_notetweets_consumption_enabled%22%3Atrue%2C%22longform_notetweets_inline_media_enabled%22%3Afalse%2C%22longform_notetweets_richtext_consumption_enabled%22%3Atrue%2C%22longform_notetweets_rich_text_read_enabled%22%3Afalse%2C%22responsive_web_edit_tweet_api_enabled%22%3Afalse%2C%22responsive_web_enhance_cards_enabled%22%3Afalse%2C%22responsive_web_graphql_exclude_directive_enabled%22%3Atrue%2C%22responsive_web_graphql_skip_user_profile_image_extensions_enabled%22%3Afalse%2C%22responsive_web_graphql_timeline_navigation_enabled%22%3Afalse%2C%22responsive_web_text_conversations_enabled%22%3Afalse%2C%22responsive_web_twitter_blue_verified_badge_is_enabled%22%3Atrue%2C%22rweb_lists_timeline_redesign_enabled%22%3Atrue%2C%22spaces_2022_h2_clipping%22%3Atrue%2C%22spaces_2022_h2_spaces_communities%22%3Atrue%2C%22standardized_nudges_misinfo%22%3Afalse%2C%22tweet_awards_web_tipping_enabled%22%3Afalse%2C%22tweet_with_visibility_results_prefer_gql_limited_actions_policy_enabled%22%3Afalse%2C%22tweetypie_unmention_optimization_enabled%22%3Afalse%2C%22verified_phone_label_enabled%22%3Afalse%2C%22vibe_api_enabled%22%3Afalse%2C%22view_counts_everywhere_api_enabled%22%3Afalse%7D

[eylles]

This fork is working
https://github.com/PrivacyDevel/nitter/

But privacydev.net isn't.

That instance is always pegged from the sheer volume of traffic alone.

[tghe-retford]

thoughts?

"There is nothing more permanent than a temporary measure". Either now or in the future.

[HEPOSHEIKKI]

This is a sad year for social media.

Cheers lads, was a wild ride.

[notune]

Couldn't we use accounts to scrape the data (one per instance)? As far as I know this was already done for NSFW-content so maybe it could be applied to all content now

[hyzchip]

There is one instance that is still functional:
https://tweet.whateveritworks.org
Partly functional, anyway...individual tweets are displayed, but profiles produce a 502 error.

[pozirk]

Well, big thanks to @zedeus for nitter, have been enjoying it for some time.
Hope it can be fixed, but... it was going downhill for some time already.
Around a month ago twitter stopped working with disabled cookies, now this.

[NovemberOrWhatever]

Okay, well, to Mastodon I guess. It's a shame they're killing this. I don't think there are many here who will respond to this by going back to regular Twitter. I'm now just done with Twitter for good I suppose. Thanks to everyone who tried their best.

[AlyoshaVasilieva]

Couldn't we use accounts to scrape the data (one per instance)? As far as I know this was already done for NSFW-content so maybe it could be applied to all content now

Almost certainly yes, but 1) this requires registering burner accounts, possibly with some regularity as I suspect they'll get banned, and 2) the accounts will need to be linked to phone numbers because Twitter requires this if your account looks suspicious at all.

I don't think this is all that hard but it adds extra cost on top of running a server and it's annoying.

[oelmekki]

Thanks Nitter devs, you have been heroes of privacy, for a while. :)

I don't think this will affect me much, because I have not been interested in Twitter's content for a while. This network has been slowly and painfully dying since Musk bought it (and even before that, it became mostly a trolling platform for political people to hate each others), so whatever. Most of my social feeds go through Mastodon and Lemmy, nowadays, anyway. This is the end of an era, what comes next is exciting!

[nukeop]

Glad to see all sorts of "social" media dying 😍

[stemid]

Can you scrape the embedded tweet instead?

https://platform.twitter.com/embed/Tweet.html?id=1674865731136020505

[soapingtime]

i don't particularly know how nitter scrapes, but i'm able to see tweets and profiles in my browser by setting the useragent to "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

[Trit34]

i don't particularly know how nitter scrapes, but i'm able to see tweets and profiles in my browser by setting the useragent to "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Someone has reported that this trick does not work anymore. Fun fact: it was the same trick that was used to get the pre-Polymer UI back on YouTube, when it was still available.

I don’t know how long this “temporary” measure will last, nor if it will be temporary at all. In the worse scenario, it was a real pleasure to use Nitter, @zedeus ! Let’s stay tuned, but until facts get me wrong, I consider both Nitter and Twitter are dead from now on.

Thank you!

(Now, if you want to do a Nitter clone for Mastodon, to be able to browse it without JS needed, I won’t say no to this)

[notune]

Can you scrape the embedded tweet instead?

https://platform.twitter.com/embed/Tweet.html?id=1674865731136020505

This could definitely work. Problem is that we still have to get the tweets from a specific user.

[12joan]

I'll once again recommend 12joan/twitter-client if you need a quick Twitter-to-RSS solution until things settle down. It's a little easier to self-host than Nitter if you're using Docker, no configuration required. A few of us have been using it for a couple of weeks now without incident.

[ArchivingToolsForWBM]

I noticed that sensitive content flagged by the user (not age restricted) results in a "this page doesn't exist", and is flagged as age restricted on https://nitter.privacydev.net/

Example:
https://twitter.com/canaaaaamin1003/status/1671702937272467459
https://nitter.privacydev.net/canaaaaamin1003/status/1671702937272467459

Logged out:

Logged in:

Nitter:

[Trit34]

Today, on the instance I use (ntr.nah.re), “Tweets” tab and RSS feeds work fine again. Until the next break…

[Metabot24]

This instance works but sensitive content is still restricted. Has there been a solution found for that yet?

[Trit34]

Well, it broke again…
#983

[devgaucho]

the search for this fork still worked intermittently at commit 813a71e until 10:00pm on August 16, 2023

sometimes it returns nothing and the rss feed returns an error 502 (internal error), but eventually it works

from what I saw they use a proxy system with cache because old searches are updated, but new searches return as 404

[devgaucho]

game over? https://twitter.com/nima_owji/status/1691850092385370483

[devgaucho]

Says it's optional and Blue-only for now. We're safe.

I hope https://twitter.com/xDaily/status/1691859235951583630

via dailydot

[erikcas]

the search for this fork still worked intermittently at commit 813a71e until 10:00pm on August 16, 2023

sometimes it returns nothing and the rss feed returns an error 502 (internal error), but eventually it works

from what I saw they use a proxy system with cache because old searches are updated, but new searches return as 404

They use a login based alternative?

See commit d5689f2

[devgaucho]

musk magick formula = less captcha and more subscription

https://twitter.com/elonmusk/status/1691969296543711471

[devgaucho]

the search for this fork still worked intermittently at commit 813a71e until 10:00pm on August 16, 2023
sometimes it returns nothing and the rss feed returns an error 502 (internal error), but eventually it works
from what I saw they use a proxy system with cache because old searches are updated, but new searches return as 404

They use a login based alternative?

See commit d5689f2

probably. from what I noticed they use a cache in the search system, the current lag is more than 10 hours

[devgaucho]

the search for this fork still worked intermittently at commit 813a71e until 10:00pm on August 16, 2023
sometimes it returns nothing and the rss feed returns an error 502 (internal error), but eventually it works
from what I saw they use a proxy system with cache because old searches are updated, but new searches return as 404

They use a login based alternative?
See commit d5689f2

probably. from what I noticed they use a cache in the search system, the current lag is more than 10 hours

the cache prioritizes some profiles, the most accessed I assume

[devgaucho]

in July 21 they exchanged the endpoint of the profiles for the endpoint of the search system, I believe that this is the main source of the tweets that feed the profiles, so they simplify by focusing efforts on only one endpoint

[devgaucho]

as some delay but stil works

[michaelskyba]

as some delay but stil works

Which accounts are working for you besides "jack" and "elonmusk"?
I tried a few from https://en.wikipedia.org/wiki/List_of_most-followed_Twitter_accounts (like BarackObama, justinbieber, Cristiano, rihanna, YouTube) and all of them showed the same "An error has occured in one of your routes." page. All of them are visible without an account on twitter.com.

Or is this a result of the 10-hour cache delay you mentioned?

[devgaucho]

as some delay but stil works

Which accounts are working for you besides "jack" and "elonmusk"? I tried a few from https://en.wikipedia.org/wiki/List_of_most-followed_Twitter_accounts (like BarackObama, justinbieber, Cristiano, rihanna, YouTube) and all of them showed the same "An error has occured in one of your routes." page. All of them are visible without an account on twitter.com.

Or is this a result of the 10-hour cache delay you mentioned?

my personal account is accessible thourght the search box with a 2 hours delay

[devgaucho]

as some delay but stil works

Which accounts are working for you besides "jack" and "elonmusk"? I tried a few from https://en.wikipedia.org/wiki/List_of_most-followed_Twitter_accounts (like BarackObama, justinbieber, Cristiano, rihanna, YouTube) and all of them showed the same "An error has occured in one of your routes." page. All of them are visible without an account on twitter.com.

Or is this a result of the 10-hour cache delay you mentioned?

the cache is local, should prioritize the most accessed sites in the instance in case

[coda101]

All of them are visible without an account on twitter.com.

The ones I checked all had a mix of random new and old tweets almost like "highlights".

[unseenlarks]

apparently, tweets with more likes are being shown first (when viewing a profile when logged out).

https://9to5google.com/2023/08/16/twitter-profile-sort-like-counts-logged-out/

[zedeus]

Superseded by #983

[rohitrsm83]

Hi,

For now the only instance that seems to be working is nitter.net. I usually use unofficialbird but that one--and many others--report the jester route exception error.

[zedeus]

@rohitrsm83 the conversation continues here: #983

[rohitrsm83]

@rohitrsm83 the conversation continues here: #983

Thx