Tweetduck not showing all the comments for a tweet

[scarfa]

For example I click on a tweet with 170 comments but can only scroll to 20. Have to open through a browser to see the rest.

[chylex]

Unfortunately that's how Twitter's APIs have worked for a while, there is no official way to get all replies to a tweet. The app is built on TweetDeck which relies on Twitter APIs, if they don't provide a way it'd only be possible with a workaround.

As for the workarounds, I saw some that use Twitter's search function, but they seem to perform large amounts of API calls - I estimate it could find replies for maybe 5-10 tweets, but then you wouldn't be able to use any search function (including replies) for 15 minutes because of the API's rate limiting.

[scarfa]

Is there a way to scrape the tweet comments from Twitter's own website without the API? Or is that abuse and could get you banned?

[chylex]

You could probably request from the https://twitter.com/i/<username>/conversation/<status_id> endpoint, you'd need multiple requests to actually load everything which may run into issues again, and then do a lookup for all scraped status IDs where the API can process up to 100 tweets with one request. I'll call it possible, but a pain in the ass to implement :P

[chylex]

Closing the issue as it's a limitation of the API and working around it isn't very viable.