"Download your Twitter Data"

Are you aware of the download function at the very bottom of this page?
It seems like it does most of what you're trying to achieve with grain without running into any API limits.
If you additionally download retweet media and replies the set should be rather complete.

[edsu]

@hyperfekt thanks for sharing that download link. Do you happen to know how long that that has been available?

I do not, I only discovered the option myself just recently.

[kyleconroy]

@hyperfekt I was not. This is far better than the Tweet archive. I'm working on a follow up post to point people in the right direction, as well as a set of protocol buffers for parsing the JavaScript files.

[kyleconroy]

The follow up post is complete. I'm now working on the new set of protocol buffers.

[kyleconroy]

You can follow along on the twitter-data branch

[yepyepyep4711]

hello @kyleconroy, many thanks for this project.

I'm trying to find out if this can be used to parse downloaded twitter data. Can it?
I've downloaded both the "archive" and the "data" from twitter, but only the archive have an html viewer, sadly.

What do you say?